Devlog II

So after managing to get MediaPipe working fairly quickly yesterday I decided to try to start working on the 3D rendering aspect of the project. I’m using three.js to do this in the browser with JS, but it has a bit of a learning curve so I’m struggling a bit. Rendering a simple cube is fine but getting an STL model I got from printables on the screen took me a lot longer than I anticipated

Anyways, the next steps to take will be to get the model rotating and resizing based on the detected head size and orientation. Turns out that MediaPipe gives me the matrixes, and that three.js comes with built-in functions for this (sweet), except this means that I need to merge my two JS scripts into one thingy, which is not a fun process. I started today, but I need some recovery time before I finish

After that I’ll probably need to do some work on the models, adding colors and all that. I’m planning to use Blender, but if anyone has any better ideas/suggestions plz do let me know. Also idk if it’s possible to add Hackatime to Blender, so that’s smthn imma have to figure out too… Basically I’m happy with how it’s going, but there’s still a ways to go

If you wanna check out the half-baked stuff I’ve got so far, I so far have a head-tracking demo and a Iron Man helmet rendering demo. As always, I’m happy to hear if y’all have any ideas on how I can improve :)

Devlog I

So I’m building suit-up, which is a website that should let you overlay Iron Man onto you. Started this cuz I keep seeing ppl building iron man and spiderman stuff on my insta, and cuz I’m not skilled enough to do that I decided this would be the next best thing.

I started with Python, except then realized that building a tool that runs an AI model and renders 3D models in parallel is gonna suck and kill my laptop. After some research I found that I could either do this in the web (as there are libraries that let me do this efficiently), or I could spend hours struggling with C++… the choice was pretty easy honestly

Anyways, I’ve now gotten a cameo working with an overlay of the landmarks that are detected by the mediapipe model I’m using. Had to use Gemini to understand the docs for the model as they’re cryptic as heck and incredibly overcomplicated. Next up I’m gonna see how I can render a 3D model, and then imma try to implement that as an overlay. Got a long way to go, but I think it’s gonna be cool

Btw, there is actually a cameo but I made it transparent for the screenshot cuz it’s still too early for a face reveal lol

You can try my really rough demo here if you’re interested. All feedback is appreciated, but plz keep in mind this is still in early dev stages