Stardance!! 🌟
.
Back story
This project is a continuation from flavourtown (https://flavortown.hackclub.com/projects/10428), initially to help students use AI to make studying faster.
A short summary for those unfamiliar: Mesa AI would create summary notes, quizzes and chats in a interface called notebooks. It’s meant to be similar to Notebook LM, but actually make notes and offer more exam accurate (subject-based instructions) notes & quizzes.
Unfortunately, I couldn’t finish Mesa AI in time (took almost 100 hours!). In Stardance, I aim to complete this project’s ambitious plans, and finally ship it.
Here are the things I intend to change or add:
- Complete all the unfinished pages
- Migrate to a fully custom RAG engine
- Move towards openrouter and Vercel AI gateway after that gemini outage which plagued Mesa AI in most of flavourtown
- Move from a read-only summary notes to notes which you can actually edit, and Mesa AI will edit them with you (agentic studying)
.
All those changes would need me to fundementally rewrite how Mesa AI was built, and make this journey on Stardance even more interesting. Mesa AI could also evolve to not just be a notetaker, but a researcher and an entire online tutor too.
.
First Devlog
To start off this rewrite, I’ve already made the custom RAG engine, which replaces Google’s file search API (too slow, unreliable, and locks me into using a Google API key).
All files are indexed automatically by a combination of Jina (PDF to markdown) and Mistral (PDF to markdown too), along with OpenAI’s embedding models. A 20-word summary is then generated with Gemma 4 such that search queries are more relevant without relying on file name alone.
To test this, I made a barebones boilerplate to simulate a real chat. (See the image!) Sorry I don’t have more pictures! This devlog was mainly backend.
In my testing, indexing (turning the file into embeddings and the summary) takes about 20s, with subsequent messages regarding that file taking about 5-8s (search and retrieval). Really pleased with the accuracy though!
Sadly i forgot to install hackatime on my mac so a few hours were lost when i was working outside :(