Face-Activated Servo

@saanvi_neema on Face-Activated Servo · 14 days ago

9h 15m 17s logged

I am working on upgrading my face-servo project to be a face-activated robotics car. When a face is detected, the car should track the face and move toward it. If the face is I’ve already built the car and I am working on getting the Arduino motor shield and the ESP32 camera tracking set up.

Open comments for this post

@saanvi_neema on Face-Activated Servo · 29 days ago

11h 44m 28s logged

Formatted and cleaned up code and improved the Readme. I also tried to make face-detection more accurate, because the algorithm was detecting some objects that weren’t faces as faces. I’ve attached a picture of the app detecting my face (you can see the green box around my face).

Ship #1 Pending review

@saanvi_neema on Face-Activated Servo · about 1 month ago

I built a real-time face detection system on the AMD Kria KV260 board that spins a servo motor when a face is detected. The KV260 runs a Python app that uses OpenCV to detect faces from my webcam. Then it sends commands to the Arduino Elegoo Mega 2560, which spins the servo motor. The hardest part was the communication between the KV260 and the Arduino board. The Python side sends the angle (from 0-180) and waits. The Arduino needs some time to boot before it can accept commands. Getting the timing right was difficult. I'm proud of the integration between software and hardware, because this was my first hardware project. Testing it will be difficult, as it works locally (has to be on the local network). But you will need:
1. Flash servo_test.ino onto the Elegoo Mega
2. Connect the Mega to the KV260 via USB (it will appear as /dev/ttyACM0)
3. Run python kria_app.py on the KV260
4. Open http://kria.local:5000 in a browser on the same network
5. Wait for some time since the Mega needs to initialize

2 devlogs
16h build

Video of Project → See source code →

Open comments for this post

@saanvi_neema on Face-Activated Servo · about 1 month ago

5h 12m 2s logged

Improved some code and added some test/utility files for fun. Attaching a picture of me recording my demonstration video.

Open comments for this post

@saanvi_neema on Face-Activated Servo · about 1 month ago

11h 15m 23s logged

Project is finished – the code is finished and the face activation is working properly! It took a while to get it working, but it works. I wasn’t sure what to put as a screenshot because it’s a hardware project, so I’m attaching a screenshot of the method that was the hardest/took me the longest to figure out.