New TouchDesigner MediaPipe Plugin 0.3.1 Release 🎉
Link to the original video tutorial walking through the component
New features
Smooth Pose Tracking with MediaPipe update to 0.10.7. no more jittery poses
Camera flip toggle on MediaPipe component flips the camera + output
Face mesh example using the source video as texture
Easily track pinch gestures with the new hand_tracking pinch midpoint, position, rotation and distance
Updates
Update to MediaPipe 0.10.7 - now with smoother pose tracking!
Websocket and web server components combined to use a single network port
Results-processing components (e.g. hand_tracking, face_detector, etc.) are now embedded in main toe file so changes will be saved with the main project - no external tox saves required any more
MediaPipe tox file is still external as it's so big and will make save files huge if embedded.
Image examples below of the new features + some nightmare fuel for the face mesh example.
Also huge shoutout to Dom Scott for all their help on this project!
Comments (3)
Actual using mediapipe, it mostly works very well, sometime after so e hours it crashes, but one point ist actually a pain - i changed the format 4k portrait and using a ndi cam 1920x1080 > framed to 420x1080 to stay in the same 9:16 format. The change only works well for handtracking, so the others are "somewhere " 😂 on theire outputs/ images ...
Hi Torin. I've been following your creations and posts for a while now and last week subscribed to your top level. I'm working on an exhibition that is pushing my skills to the limit. I think the TD-mediapipe asset is a great tool and may help me solve some of the interactivity I'm wanting to program in TD using several OAK-Ds. I have been looking at maybe integrating TD MediaPipe plugin with OAK-D by saving out some TOXs from the TD OakSample project and import them into MediaPipe might work. But unsure which components would be best to achieve this or if this is a sensible approach. Maybe there's an easier way....any clues...?
I have no idea how to use this to update my plugin?