unity 面部捕捉

Doris232 · 发表于 2022-12-26 17:42

github VTuber-Python-Unity
unity Server-Start-Waiting for a connection..
python python main.py --connect
No module named &#39;cv2&#39;
国内镜像pip install opencv-python -i https://pypi.tuna.tsinghua.edu.cn/simple

pip install opencv-python

ModuleNotFoundError: No module named &#39;mediapipe&#39;
Segmentation fault

pip install mediapipe

File &#34;main.py&#34;, line 86, in main
pose_estimator = PoseEstimator((img.shape[0], img.shape[1]))
AttributeError: &#39;NoneType&#39; object has no attribute &#39;shape&#39;
INFO: Created TensorFlow Lite XNNPACK delegate for CPU.

电脑没摄像头 unity start TCPServer.InitTCP()
TCPServer.SetUIInteractables 设置按钮是否可点击
public void InitTCP() {
try {
      // local host
      server = new TcpListener(IPAddress.Parse(&#34;127.0.0.1&#34;), port);
      server.Start();

      serverUp = true;

      // create a thread to accept client
      receiveThread = new Thread(new ThreadStart(ReceiveData));
      receiveThread.IsBackground = true;
      receiveThread.Start();

} catch(Exception e) {
      // usually error occurs if the port is used by other program.
      // a &#34;SocketException: Address already in use&#34; error will show up here
      print(e.ToString());
}
}

private void ReceiveData() {
try {
      // Buffer
      Byte[] bytes = new Byte[1024];

      while(true) {
         print(&#34;Waiting for a connection...&#34;);

         client = server.AcceptTcpClient();
         print(&#34;Connected!&#34;);

         // I/O Stream for sending/ receiving to/ from client
         NetworkStream stream = client.GetStream();

         int length;

            while ((length = stream.Read(bytes, 0, bytes.Length)) != 0) {
            var incommingData = new byte[length];
            Array.Copy(bytes, 0, incommingData, 0, length);
            string clientMessage = Encoding.ASCII.GetString(incommingData);

            // call Hiyori Controller to update values
            hiyoriController.parseMessage(clientMessage);

            print(&#34;Received message: &#34; + clientMessage);

            // SendData(client);

         }
      }
}
catch(Exception e) {
      print(e.ToString());
}
}

hiyoriController = GameObject.FindWithTag(&#34;Player&#34;).GetComponent<HiyoriController>(); Steam
VUP 面部捕捉动作捕捉全身捕捉（含手指） leapmotion Hi5手指捕捉青瞳光学捕捉声音捕捉
摄像头 Noitom 虚拟动力

云端化多人同屏弹幕互动低精度动漫

facerig 面部追踪软件高精度
一些工具
live2d 制作虚拟形象的网站
arkit 苹果52个blendshape
faceit blender的blendshape生成插件,faceit不知道怎么用，照着视频操作，报错了
readyplayer 自动生成角色模型
animation rigging unity里程序化动画绑定IK插件
final ik插件 unity里骨骼控制插件

shadertoy 学习以及写shader的网站
timeline 复杂动作，电影级分镜的过场动画。
资源右键create-timeline,赋值给场景空物体。
多个物体联合动画，场景创建物体cube然后拖动到上面创建的空物体timeline编辑器里。
选择Add Animation Track,开启红点Start recording,移动物体即保存该帧，移动到其他帧，再移动物体完成另一帧，再点击红点可完成动画。
右键片段Convert To Clip Track可转换成可拖动块。

		自动登录	找回密码
密码			立即注册