Devlog #1

I have added a ton of new features to gesture sandbox recently. More importantly, I have found many critical bugs. Here’s what I’ve been working on:

New Features

Previously, when a user selected and object and started moving it, it would drag from their palm. I re-anchored this so that it would drag from their fingers.

For some gestures such as the delete gesture, the user is required to hold the gesture for multiple seconds. This used to require the user to keep the exact same position of their hand for every frame of those seconds. This would often get interrupted by slight hand movements or camera shake. I fixed this by having the AI ignore inconsistencies that only lasted a few frames.
When the site first opens, camera access is requested. The site used to completely crash if camera access was not granted for some reason. I changed the site so that it displays an error message and reattempts to get camera access instead of crashing.
Since gesture sandbox relies on MediaPipe for the gesture recognition AI, it would sometimes crash from a corrupted download (dont ask how i know this i definitely didnt try to upload my own model to replace mediapipe). I fixed this by doing a checksum verification before each download