DepthAnything TouchDesigner Plugin + Project File: Huge Update! v03
You can find the updated component on the original Patreon post here
DepthAnything turns any webcam feed and now any TOP into a live depth map, showing how far away things are in the scene, similar to the kind of depth data you'd get from a Kinect or Orbbec camera. No install needed, just drag the .tox into your project. Use it to drive 3D particle systems, instance geometry, perform occlusion(where virtual objects appear correctly hidden behind real-world people or objects), and more.
🎉New Features🎉
1) The DepthAnything component now supports any TOP as an input. You can still select a webcam as an option as well (which is slightly more efficient)
2) Much better frame syncing. You can easily sync up either the exact video frame with the depth, or have a nice smooth interpolated video. The component includes a "Smooth Synced Webcam Frames" button if you don't want an exact frame match but still want your webcam to be smooth.
3) Normalization component included in the project. Previously if you use the Limit TOP to try to get the depth values into a visible range, it would cause flickering. The included normalize component samples the min and max and applies a fixed normalization if you want to render the depth.
4) Bug fixes for Windows machines on startup
I'm working on a tutorial for this component and am excited to share it soon!
Thanks again for all your support!
Comments (16)
Hey! Running on Windows, quite beefy specs. Clicking on the tox in palette results in touchdesigner freezing for 5-10 seconds. When imported sometimes the tox just doesn't load (stuck on ... loading ...). And if I try to delete the tox from my project the computer just crashes and restarts.
I wouldn't recommend loading from the palette. Make sure External Tox is enabled in the Common Tab and that it's located next to your .toe file. Also you'll get the fastest results using the Webcam instead of connecting a TOP as an input
when spout to resolume the depth map became red, happened to anyone?
there's no connections on the container, LOL
Dear Torin. is there a way to increase the depth on the z axis? i am trying to make a landscape of an image with your great plugin, but it looks more like a curtain of dots..I hope you can point me in a direction of how to work w increasing the depth field? thanks a lot in advance
Yes! The project file has a point transform TOP with the scale in the Z set to make it smaller (something like .2) increase the value to get more depth
i paid 9$ subscription but this tool is still blocked...
Same
Hey Torin! I got the $9 sub, but I am unable to download the depthAnything tox. I was under the impression this would be included within this tier?
same
hi i paid 9$ subscription but this tool is still blocked to download, how can it be possible?
me too
Hi, I'm trying to use this component to detect presence of a person within a depth threshold. I'm using a threshold top to clip out everything past a certain pixel value representing depth and then doing some top analysis. This works when I'm in the camera's view, but when I step out the values of the background seem to adjust and I get a false positive for presence. It's almost like it's normalizing itself a bit (even without the Normalize comp), and I need the image to reflect absolute depth. Any tips to stabilize this? PS I've been using nvidia background top for presence detection but it has no controls over depth and for this kiosk there will be people behind the user and I want to ignore them. Any help is appreciated!
Yeah I noticed that also. I wonder if you could use media pipe face tracking(that can track up to 10 people) to detect presence and then toggle on and off the depth
HI Torin. I get the following error inside the depth anything small.tox Script errors: Error: A module that was compiled using NumPy 1.x cannot be run in NumPy 2.3.2 as it may crash. To support both 1.x and 2.x versions of NumPy, modules must be compiled with NumPy 2.0. Some module may need to rebuild instead e.g. with ‘pybind11>=2.12’. If you are a user of the module, the easiest solution will be to downgrade to ‘numpy<2’ or try to upgrade the affected module. We expect that some modules will need time to support NumPy 2. Parameter Language: Python Content Language: Python Execute Language: Python Length: 7135 bytes Shared by (2) DATs Any idea's about this?
What version of TouchDesigner are you running? Also what version of the plugin? Tempe latest I titled the folder V0_3