You are browsing as a guest. Sign up (or log in) to start making projects!

Veya - Smart Glasses

Hardware
  • 2 Devlogs
  • 1 Total hours

Veya - AI-powered smart glasses that detect eye diseases A wearable device using Raspberry Pi and computer vision to screen for cataracts, conjunctivitis, and pterygium. Captures eye images, runs a TensorFlow Lite CNN model locally, and sends diagnosis + confidence score to a mobile app via WiFi. Built for underserved communities in Central Asia where ophthalmologists are scarce. Under $350 vs $10k+ professional screening devices. All processing happens on-device (no cloud, privacy-first).

Ship #1 Pending review

I built Veya — smart glasses that detect eye diseases using AI and a Raspberry Pi 4. The system captures close-up eye images through an Arducam Hawkeye camera, processes them locally with a trained neural network, and identifies conditions like cataract, conjunctivitis, and pterygium in 2-3 seconds. Results are transmitted via WiFi to a companion mobile app that displays the diagnosis, confidence score, and health recommendations. The project includes three main components: (1) the ML pipeline with a MobileNetV2 model optimized for edge deployment, (2) a Flask API running on the Pi for communication, and (3) the Veya mobile app for viewing scan history and results. I also built a web interface (veya-web repo: github.com/ulacoder/veya-web) for educational cuctions. Total hardware cost is under $280,through an Arducam Hawkeye camera, processes them locally with a trained neural network, and identifies conditions like cataract, conjunctivitis, and pterygium in 2-3 seconds. Results are transmitted via WiFi to a companion mobile app that displays the diagnosis, confidence score, and hoject includes three main components: (1) the MLgithub.com/ulacoder/veya-web) for educational content and device setup instructions. Total hardware cost is under $280, making professional-grade eye screening accessible to communities without ophthalmologists.

The biggest challenge was optimizing the CNN to run on the Raspberry Pi 4 without killing accuracy or battery life. MobileNetV2 is designed for mobile, but gettingquired converting to TensorFlow Lite, applyingint8 quantization, and stripping the model down to ~4MB. Balancing three disease classes plus "healthy" was tricky — medicadatasets are heavily imbalanced, so I had to aud use weighted loss functions. On the hardwareside, camera positioning is critical — the Arducam Hawkeye needs to be mounted at exactly the right distance and angle to capture enough retinal detail for accurate detection. I'm also about to start the hardware assembly phase now that all the software is ready — connecting the camera, Pi, and power bank into a wearable form factor that's actually comfortable is the next major hurdle.

I'm proud that this works end-to-end and is genuinely affordable. Commercial eye screening devices cost $10,000+, but Veya does it for under $280 in parts. The model hitsl datasets, which means it can actually catchdiseases early enough to matter. I'm also proud of the UX — the Veya app has a clean onboarding flow that explains eye health
in simple terms, step-by-step connection instruwith actionable recommendations. It's not just a tech demo — it's designed for real people in rural clinics, schools, or disaster relief situations where bringing a $10k machine isn't an option. The fact that all processing happens locally (no cloud, no privacy concerns) makes it usable even in areas with zero internet.

To test Veya, you'll need:

Hardware:
- Raspberry Pi 4 (4GB RAM recommended)
- Arducam Hawkeye camera module
- 10,000mAh power bank
- 32GB microSD card
- USB-C cable

Software repos:
- ML pipeline: github.com/ulacoder/veya-ml
- Web interface: github.com/ulacoder/veya-web
- Mobile app: (coming soon — still in development)

Testing steps:

1. Clone the ML repo:
git clone https://github.com/ulacoder/veya-ml
cd veya-ml
pip install -r ml/requirements.txt
2. Run inference on test images:
python ml/inference.py --image sample_eye.jpg --model veya_model_lite.tflite
2. The model outputs: disease class (Healthy / Cataract / Conjunctivitis / Pterygium) + confidence score.
3. For full hardware testing (once I finish assembly):
- Flash Raspberry Pi OS to the SD card
- Install the Flask API: python api/server.py
- Connect your phone to the Pi's WiFi hotspot
- Open the Veya ap

  • 2 devlogs
  • 1h build
Video of Project → See source code →
Open comments for this post

17m 1s logged

DEVLOG #2

Productive day — got the core ML pipeline working and built out the web interface:

  1. Trained the detection model — fine-tuned EfficientNet-B0 on 80k+ retinal OCT images. Hit ~95% validation accuracy across 4 disease classes (CNV, DME, DRUSEN, NORMAL). Training took ~25 min on Colab’s GPU. Model weights saved and ready for Pi deployment.

  2. Built prototype web interface — simple site for device usage and real-time results display. Users can see detection confidence scores + disease info. Planning to add more educational content about each condition. You can try it here: veya-web-zeta.vercel.app

Next: quantize the model down to ~5MB for faster inference on Pi, then test the full pipeline (capture → predict → display) end-to-end.

3
0
21
Open comments for this post

32m 20s logged

DEVLOG #1

Got some real progress today:

  1. Designed the smart glasses form factor — sketched out how the Raspberry Pi, camera module, and display will fit into a wearable frame. Trying to keep it lightweight so it’s actually comfortable to wear for screening sessions.

  2. Wrote full project documentation — complete (EfficientNet-B0 for retinal disease detection), hardware architecture, and deployment strategy.

Next up: prototyping the camera mount and testing inference speed on the Pi to make sure we hit real-time detection (<500ms per frame).

0
0
9

Followers

Loading…