back
user profile

mplappert

258karma·39submissions·June 11, 2020
about
Matthias Plappert. Robotics & ML. Previously OpenAI (robot hand that solved a Rubik's Cube; Codex) and GitHub (Copilot). Now running dfdx labs, an independent R&D research company.

https://matthiasplappert.com

recent activity (39 total)
comment
“Never attribute to malice that which is adequately explained by stupidity.” (or carelessness in this case)
25d ago·view thread
comment
Seems like a hallucination to me; note that the context contains “unmarkBlock” as the function name, which invites a connection to Minecraft. Still shouldn’t happen of course. The alternative explanat…
1mo ago·view thread
comment
I agree with this. I recently went back to writing more code by hand again for this reason: the amount of effort / mental toll it takes me to steer the LLM is sometime just not worth it. I might …
1mo ago·view thread
comment
There’s a lot of confusion here: - There is no double taxation if you just pay yourself a salary (since it’s a normal business expense). If you want to take money out of the company flexibly, a GmbH i…
1mo ago·view thread
comment
Yeah I tried to use ROS / Gazebo about 10 years ago (it was still ROS 1) and getting it set up was an immense pain. I remember that creating new modules required writing CMake files. Maybe this i…
1mo ago·view thread
comment
I’d recommend looking at the SO-101 then. Much much cheaper. And hardware is very fun! It’s also very frustrating. But to me worth it.
1mo ago·view thread
comment
This all makes a lot sense, thanks for sharing! For depth I agree on the VLA route but for ACT / DP-style imitation learning from scratch it seems more feasible (since you’re not fighting a pretr…
1mo ago·view thread
comment
Did you ever a late RGB vs RGB-D? I haven’t seen that much in the literature. Also any thoughts on action space representation? Seems to me people are settling on flow matching mostly, but pi still us…
1mo ago·view thread
comment
Yeah I can see that. Especially the rotation part is pretty awkward (hence why I currently do the axis parallel to table surface trick and only use the yaw angle to rotate the gripper). The space mous…
1mo ago·view thread
comment
This seems indeed useful. I haven't seen this for robotics but I'm sure people need this for larger deployments (either for a distributed fleet or for an "arm farm"-like setup wher…
1mo ago·view thread
comment
Wow very cool project and thanks for the Ariel pointer! Added to my reading list. And yes, having a nice robot makes life so much easier. Very happy with my choice so far!
1mo ago·view thread
comment
Oh very cool! Looks a bit like the TRLC-DK1 (I was looking at this one for a bit). I think pushing the sota is quite hard to do solo but we'll see. Mostly I want to get back up to speed after hav…
1mo ago·view thread
comment
I timestamp everything twice: once with the hardware clock (if available, like for the realsense camera) and once within my robot stack once it gets read from the device (using `time.monotonic_ns()`).…
1mo ago·view thread
comment
I'm only starting down this road but my sense is that ACT and Diffusion Policy both make it pretty feasible to start on real data only. LeRobot also makes it easier to train these. But that'…
1mo ago·view thread
comment
Cool video! What made you stop if I can ask? And yeah I feel you re humanoid. I worked on the Rubik's cube project at OpenAI, which used a humanoid hand, and it was insanely painful and hard. Als…
1mo ago·view thread
comment
Very cool! Have you seen the recent nvidia thing? They do this at scale for robotics manipulation: https://research.nvidia.com/labs/gear/enpire/ …
1mo ago·view thread
comment
Great points and I very much appreciate the input! Right now the static camera is probably really bad: It's mounted on my desk, so its very easy to bump into it and move it. So yeah, it's po…
1mo ago·view thread
comment
That was my take 8 years ago glad to hear it’s still that
1mo ago·view thread
comment
For understanding: I think the level is much deeper if I wrote the code vs reading someone else’s. Same applies to coding agents of course which is why I wrote most of it myself and only delegate some…
1mo ago·view thread
comment
Glad you like it! Re your questions: - The driver situation turned out totally fine; I intentionally picked HW with good python sdk support so that was very painless. - The static camera (the C920) is…
1mo ago·view thread
comment
Thanks Tim and fun seeing you here :)
1mo ago·view thread
comment
Looks very cool! I’m not a huge discord user but how about you shoot me an email and we can figure out how to share notes? (I don’t want to post it directly here but it’s easy to find on my personal w…
1mo ago·view thread
comment
It’s partially my fault I currently clip the max speed _and_ I only input soft control changes when teleoperating to avoid crashing into things. The robot itself could definitely move more quickly th…
1mo ago·view thread
comment
I think there‘s a serious issue with people using AI to do an immense amount of busywork and then never look at it again. Colossal waste.
3mo ago·view thread
comment
I very much agree; I think laziness / friction is basically a critically important regularizer for what to build and for what to not build. LLMs remove that friction and it requires more discipli…
4mo ago·view thread