You are browsing as a guest. Sign up (or log in) to start making projects!

Maicol's Dev Lab (TalkinEyes, Mayllo & Web Projects)

  • 17 Devlogs
  • 31 Total hours

Maicol’s Dev Lab (TalkinEyes, Mayllo & Web Projects)

Open comments for this post

3h 16m 31s logged

Devlog: TalkinEyes OS — Días 1 y 2
Objetivo: Evolucionar TalkinEyes V1 (prototipo espagueti) a TalkinEyes OS (arquitectura modular en POO) para el OpenCV AI Competition 2026.
Se ve un poco mas fea que la anterior pero es que el enfoque ahorita esta en hacerlo robusto no tanto bonito
El mayor logro de estos dos días fue reescribir la lógica usando Programación Orientada a Objetos (POO).

En V1, teníamos el mismo código repetido 5 veces para los menús. Ahora, una sola clase Menu maneja todos los menús de forma dinámica.

Se separaron las responsabilidades: la lógica de visión vive en core/, la comunicación en communication/, la interfaz en ui/, y el cerebro en main.py.
El Núcleo de Visión (Modular y Estable)
Se creó un pipeline de visión paso a paso, donde cada archivo hace una sola cosa:

Camera: Abre y gestiona la webcam de forma limpia.

FaceDetector: Envuelve MediaPipe y convierte los frames de BGR a RGB (solucionando errores de memoria contigua).

Creamos una interfaz en Tkinter capaz de cambiar entre formato “cuadrícula” (menú principal) y “lista” (submenús).

Botón de Calibración: Se integró un flujo en vivo que permite al usuario calibrar el sistema sin cerrar la aplicación.

Se dejaron atrás los umbrales universales. Ahora, el sistema mide el EAR del usuario con los ojos abiertos y cerrados.

Calcula umbrales personalizados mediante interpolación lineal.

Persistencia: Los datos se guardan en un archivo perfil_usuario.json y se cargan automáticamente al iniciar la app.

(Debugging)
Manejo de errores de future imports.

Solución al error de MediaPipe: Reference mode is unavailable if data is not c_contiguous.

Protección del sistema contra frames donde no se detecta rostro (evitando cierres inesperados).

0
0
3
Open comments for this post

35m 30s logged

Today, I worked on the main menu interface for TalkingEyes.

I designed the main buttons: EAT, BATHROOM, PAIN, and SLEEP.
I adjusted the sizes, colors, and layout to make the options easier to see.
I continued using Tkinter to build the interface.
I set up the structure so I can add submenus for each option later on.

I didn’t make much progress on the detection side today, but I did make the V1 interface much clearer.

0
0
2
Open comments for this post

49m 9s logged

Today, I continued working on the TalkingEyes interface, specifically the blink-based selection system.

First, I fixed a major issue: the block being selected didn’t always match the one visually highlighted. The problem lay in how the index was updated after switching blocks. I adjusted the logic so that the index always represented the currently selected block.

Afterward, I tested the system again and confirmed that the selection process is now working correctly.

I also began implementing the EAT submenu. The idea is that, after selecting a category, various preset phrases appear that can then be selected using blinks.

0
0
2
Open comments for this post

1h 30m 56s logged

I started by taking EAR measurements:
Open-eye EAR averaged between 0.20 and 0.30.
Closed-eye EAR was almost always around 0.05 (or similar) down to 0. We also implemented a state machine. Furthermore, we successfully set it up so that an eyelid movement selects a menu item, and both the menu and the camera view are visible.

0
0
1
Open comments for this post

53m 34s logged

Devlog: Selection menu + repository setup

Today, we made progress on two fronts. On the interface side, I guided my brother (14, with no prior coding experience) to build the communication menu using Tkinter: four Kahoot-style blocks (EAT, BATHROOM, PAIN, HELP) drawn on a Canvas, featuring an automatic “scanning” highlight system that lights up each block in turn every second—the standard pattern for blink-based accessibility systems.

On the computer vision side, I added frame-counting logic to distinguish an intentional blink from noise or natural blinking, using an EAR threshold and a minimum number of consecutive frames.

I also set up the GitHub repository (though I still need to clean up the .gitignore file to exclude the virtual environment).

Next step: connect both parts so that an intentional blink signals the menu to make a selection.

0
0
1
Open comments for this post

55m 33s logged

TalkinEyes Devlog 1 — Starting TalkinEyes
So this is TalkinEyes — a device that lets people who can’t speak or move communicate just by blinking. The idea is the camera watches your eyes, you blink to pick an option from a menu (eat, bathroom, pain, etc.), and it turns that into speech. Kind of inspired by how Stephen Hawking communicated, but way simpler.
I’m building it for a physics/tech event at my university, but honestly I want to keep pushing it further than just that.
What I’ve done so far:

Got face tracking working with MediaPipe — it tracks 468 points on your face in real time through the webcam. Took some fighting with Python/VS versions to get it installed right.
Narrowed it down to just the 6 points per eye I actually need to tell if an eye is open or closed.
Wrote the function that calculates the EAR (basically a number that tells you how open your eye is). Found and fixed a bug where it was only running once instead of updating every frame — that one took me a bit to catch.
Tested it on myself, got EAR values around 0.28 with eyes open, which is right where it should be.
Started keeping a formulas.md file in the repo so it’s clear which parts are formulas/techniques I looked up vs. stuff I built mysel

0
0
1

Delete project?

Are you sure you want to permanently delete this project? This action cannot be undone.

All devlogs, followers, and associated data will be removed.

Followers

Loading…