It turns out I’ve been building a retreival augmented generation system for AI all along.

I did this without even realizing it was called that!

Since last time, I’ve hooked up a text-embedding engine to turn text into vectors.

Next, I did some math to calculate cosine similarity between the vectors so I can see how similar these vectors are. I also added some helper functions to help retrieve the vectors that are similar enough and only take the top K (5) values.

I hooked this all up to the command line chat!

It still doesn’t seem to remember properly though… I’m going to spend some time to debug this.