Project architecture

At first, I thought I could train a big LLM on my PC with a lot of parameters and create something similar to ChatGPT, but I was wrong. My RTX 4070 Super is too weak to train such a large model.

Because of that, I will use an open-source model and basically fine-tune it using DPO.

I was thinking about how I should build this AI Chatbot. I thought I could use CulturaX as a dataset for my LLM, but that was a horrible idea. For now, I’ll choose Argilla’s UltraFeedback dataset, basically to give my model an understanding of good and bad responses.

Today, I was thinking about the architecture of the future Chatbot. I actually used AI quite a lot to give me some advice.