NOVA - AI Memory

Two Major Milestones…

Context system is done! There’s a lot of data flow, async operations, and flexibility involved.

Model calling is also done. LiteLLM is very powerful… But it requires a lot of error checking with configs and model preferences.

The world model is being built… And it’s feeling more like a separate project itself. A ridiculous amount of data flow is involved here… More than context. And even more logic. Considering that with AI memory, accuracy and precision drops mostly in the retrieval part. Not the storage.

But, slowly, I’m making progress! Writing down my thoughts has helped a lot.

Thought about prompt caching and the OpenAI API. As long as the system prompt stays the same… It doesn’t matter what’s included in ‘user’ or ‘assistant’. You’ll still be able to use prompt caching!

Also cleaned up code and added many edge cases/logic improvements.

Lots of refactoring… But /nova can now take input from multiple endpoints, and have context ready, when an AI API needs it.

Learned a lot about classes and asyncio logic!

Messy, messy code.
I was 95% there to getting a clean response…

But, after 30 minutes of debugging, I’m able to get a response from Ollama Cloud! Next step is to clean up my code, and see if I can split it.

(Shoving everything into ‘File1.py’ gets messy)

Spent time creating a way to take inputs from a program, assemble it into a python dict, and convert that into a JSON block. Will use later with LiteLLM!