It turns out I’ve been building a retreival augmented generation system for AI all along.
I did this without even realizing it was called that!
Since last time, I’ve hooked up a text-embedding engine to turn text into vectors.
Next, I did some math to calculate cosine similarity between the vectors so I can see how similar these vectors are. I also added some helper functions to help retrieve the vectors that are similar enough and only take the top K (5) values.
I hooked this all up to the command line chat!
It still doesn’t seem to remember properly though… I’m going to spend some time to debug this.