Just follow the tutorials of these two bloggers, here is a summary of the problems encountered
Hololens2 first entry - get the color and depth image data stream, and pass it to the program (not web browsing): link
The host side gets the RGBD of Hololens2 in real time Data flow: link
1. #include <Eigen>
It is best to download and configure the problem. I haven’t tried whether the comment can run through. The pch.h in the sln project contains this file. Eigen is a C++ template library for linear arithmetic. You can download it directly from Baidu’s official website. You don’t need to compile and add environment variables and then include vs. At the same time, change #include <Eigen> to
#include <Eigen\Dense>
2. Opencv problem
The cv additional dependencies in the linker input can be changed to your own cv library. My cv library is version 410, and it can be opened without any problem. When I was looking for problems encountered, I even compiled 430 with For the extended release and debug versions, it turns out that my problem has nothing to do with the cv version. The compiled cv has more than 10 G.
3. The problem that py cannot connect
TimeoutError: [WinError 10060] The connection attempt failed because the connecting party did not reply correctly after a period of time or the connected host did not respond.
In this case:
1. First check whether the research mode is turned on.
2. Several InternetClient, InternetClientServer, PrivateNetworkClientServer, WebCam, and SpatialPerception in the Unity buildsetting are confirmed to be checked.
I did this, but it still doesn’t work. I even updated the Hololens2 system because of the research mode. The new system is a bit buggy. The suggestion is not to update.
After looking at the problematic module on git, the author made a try catch for most of the TCP links, and searched for VideoCameraStreamer::StartServer for the output during debugging, and found openl instening fail, so I simply looked at the source code.
In the source code, VideoCameraStreamer is mainly responsible for the StreamSocketListener module of UWP. This try catch is triggered and it is a meaningless code of -232323. After reading it, I found that the author changed the error message to the abnormal state enumerated in SocketError. So it’s a bunch of meaningless numbers, after a simple modification, you can get message_catch: At least one of either InternetClientServer or PrivateNetworkClientServer ca or something, here you can see that InternetClient, InternetClientServer, PrivateNetworkClientServer are not opened, I confirm again in Unity After checking the package.appxmanifest, I found the problem. 
These three are not included at all. Hey, maybe I added it on the basis of the original project, but I also checked it in unity. I don’t know why. Just change it to the picture below 
and then I have verified the output here, and the py can be displayed directly after normal monitoring
Just these few questions first, I will look at the source code later when I have time.