Excited to open-source GMR: General Motion Retargeting. Real-time human-to-humanoid retargeting on your laptop. Supports diverse motion formats & robots. Unlock whole-body humanoid teleoperation (e.g., TWIST).
video with 🔊
Our humanoid now learns loco-manip skills that generalize across space (Stanford) & time (day & night), using egocentric vision, trained only in simulation
visualmimic.github.io
Excited to introduce TWIST2, our next-generation humanoid data collection system. TWIST2 is portable (use anywhere, no MoCap), scalable (100+ demos in 15 mins), and holistic (unlock major whole-body human skills).
Fully open-sourced:
yanjieze.com/TWIST2
🤖Introducing TWIST: Teleoperated Whole-Body Imitation System.
We develop a humanoid teleoperation system to enable coordinated, versatile, whole-body movements, using a single neural network.
This is our first step toward general-purpose robots.
🌐humanoid-teleop.github.io
We’ve seen humanoid robots walk around for a while, but when will they actually help with useful tasks in daily life?
The challenge here is the diversity and complexity of real-world scenes.
Our new work tackles this problem via 3D visuomotor policy learning. Using data from
Introduce 3D Diffusion Policy (DP3), a simple visual imitation learning algorithm that achieves:
- 55.3% relative improvement on 72 simulated tasks, most with 10 demos
- 85% success rates on 4 real-world tasks, with 40 demos🥟🌯
Open-sourced!
Code/Data: 3d-diffusion-policy.github.io
I’ve been training dogs since middle school. It’s about time I train robot dogs too 😛
Introducing, UMI on Legs, an approach for scaling manipulation skills on robot dogs🐶It can toss, push heavy weights, and make your ~existing~ visuo-motor policies mobile!
Excited to open-source GMR: General Motion Retargeting. Real-time human-to-humanoid retargeting on your laptop. Supports diverse motion formats & robots. Unlock whole-body humanoid teleoperation (e.g., TWIST).
video with 🔊
Excited to open-source GMR: General Motion Retargeting. Real-time human-to-humanoid retargeting on your laptop. Supports diverse motion formats & robots. Unlock whole-body humanoid teleoperation (e.g., TWIST).
video with 🔊
Congrats on the new work from Yuke's Group.
Our recent work can also generalize smooth humanoid behaviors to diverse real-world scenes! I guess that's why we need humanoids.
humanoid-manipulation.github.io
The million-dollar question in humanoid robotics is: Can humanoids tap into Internet-scale training data such as online videos due to their human-like physique?
Our #CoRL2024 oral paper showed the promise of humanoids learning new skills from single video demonstrations. (1/n)
I have seen actual live demos several times. This is the definitely most agile and smooth humanoid controller I have ever seen. Especially for its very gentle foot placement, the thing that you might never notice from videos but only from a live demo.
Congrats @qiayuanliao
Our humanoid now learns loco-manip skills that generalize across space (Stanford) & time (day & night), using egocentric vision, trained only in simulation
visualmimic.github.io
Thanks Jin for using GMR; here is a new feature in GMR being used: first, human video --> human via GVHMR, then, human --> robot via GMR. Open-sourced already
