Mini work session. After getting the hand to work with teleoperation, I realized I would need to several things to get this project to work. Firstly, I need to record letters to use, which I plan on doing by incorporating a button system.

I’ve set up 2 buttons that default to a high state. When pressed, the low state indicates that the button is pressed. One button is the recording option, to capture the servo positions, I’m maintaining currently, and store that to the next letter in line. I plan to store these values in a vector, which can be accessed later by the LLM to choose letters to spell out words.

This session, however, I spent finding a camera based sign language model, and analyzing the source code. I am kind of putting off the vector thing, but that’s all right for now. I found this repo online, that works well for my purpose, and I plan to use it, or at least repurpose it.

That’s all for now.