DumE is a voice controlled autonomous mobile manipulator: a 6 DOF arm on a holonomic (mecanum) drive base, with stereo vision, natural language control, and a personality system. The chassis and arm are designed and built from individually sourced components.
This project seems really cool! right now your BOM is mainly just an off the shelf robot arm and an off the shelf drivetrain kit. We only fund parts you designed yourself, so if you would like this to be an X tier project, please consider designing the arm and chassis yourself!
Hello!
Your BOM seems a bit overpriced.. Try sourcing some parts from aliexpress instead of Amazon.
Once that is done, we will have another look, and if everything is good, you will be approved! You are really close! :D
hey, thanks for making the changes! however, you still don't have any lapse recordings. please make sure to sync those to the stardance project before resubmitting.
Most of the firmware has been updated including the schematics. I am still in the process of making the test and build files because there is some error going on with the test kinematics on my view window.
Sadly smth went wrong with wakatime cuz I havent coded in a while so I just assumed it was turned on.. Unfortunately I only got like a fraction of my actual coding time 😭
Hey!
Some changes need to be made
- There seems to be no software/firmware that is included in your repo... You needs to add that in there.
- There seems to be no schematic or PCB design that I can see to tell me how the Dum-E is going to work.. Please also submit that.
- You need to add timelapses of you actually working on the project.. If you haven't made the schematic or software yet for the project, please use lapse to make that.
I really like the detail on the BOM, and the idea in itself!
Once these changes are made, please submit it again.
Hello really cool project but there are a few issues you need to fix before resubmission:
1) You need .Step files for all of your CAD parts not just one big assembly
2) Please go through all the lapse recordings on this project because you show Aritable, the spiderman movie, blank screens, and a lot more on one lapse.
3) What is the deal with your project images being from an email link and why is your project demo diffrent from the photo in the GitHub repo
Just got the new CAD complete cuz the old one looked ugly.. I have most of the parts already 3D printed. Right now I am working on the code and some other things.
Made some edits to the mecanum wheels.. They were positioned incorrectly and the wheel was also designed wrong
Yess.. I have finally completed the whole design. This time everything was well thought out. Instead of normal wheels I have decided to use mecanum wheels for omnidirectional movement.
Also there will be two cameras instead of one. The first camera is on the chassis as eyes. The eyes give depth perception so the robot can judge how far away an object is without a depth sensor. The second camera will be on the arm head for object detection.
Electronics and the battery sit low at the back of the chassis as a counterweight to balance the arm mounted at the front, keeping the center of gravity stable even when the arm is fully extended.
The arm has 6 degrees of freedom plus a gripper claw. Serial bus servos give position, voltage, and temperature feedback at every joint, which means the arm always knows exactly where it is, no guessing, no drifting. Inverse kinematics handles all the math of translating “go to point (x, y, z) in space” into the correct angles for all 6 joints simultaneously, so I can give the robot a target position in plain language and it figures out how to get there.
Voice commands flow through a full natural language pipeline: a wake word detector listens constantly for “Hey Dum-E,” then Whisper transcribes what I say, then an LLM interprets the intent and converts it into structured robot commands, things like pick up the red block, move left 10 centimeters, go to the charging station, lift your arm, or grab that.
The full pipeline from voice command to physical grab is: wake word, then speech to text, then LLM intent parsing, then object detection, then coordinate mapping, then inverse kinematics, then servo motion. All of this runs on the Raspberry Pi 5 with an Arduino handling the real-time motor and servo PWM timing underneath, because the Pi’s Linux scheduler isn’t real-time and would cause jittery motion if it controlled servos directly.
Devlog #1: Building Dum-E: A Voice-Controlled Mobile Robot Arm.
Hey everyone! I’m building a desktop robot arm inspired by Dum-E from Iron Man the clumsy little arm that Tony Stark keeps yelling at. Except mine is tiny.
The concept is a 4-wheeled mecanum (omni) rover base with a full 5-joint robotic arm mounted on the back, two cameras on the arm head for eyes, and voice control so I can literally talk to it and it responds with movement and personality: beeps, whirs, droopy sad poses when I scold it, excited wiggling when I praise it.
Still in design phase but parts list is locked and I’m about to submit for funding. More updates soon as I start actually building!
