A platform that enables anyone, regardless of their experience level or hardware capabilities, to train and finetune LLMs on their own devices. The project will begin as a web based LLM finetuning engine and evolve into a complete system optimized for local hardware, allowing users to train LLMs efficiently using advanced techniques.
Devlog #1: Trainbox
Hey! I am Nikolas, and I am really obsessed with local AI and LLM training. But I discovered a problem… If someone wants to fine-tune a model, they will have to buy pricey hardware or a very expensive cloud subscription. So, that leads to LLM fine-tuning (and training) being very hard for beginners to start.
Solution: My project (it’s called Trainbox) is a local large language model fine-tuning center that helps people train LLMs with local hardware easily. This project will consist of different parts, like a fine-tuning center, a dataset creator (for context, datasets are the organized data LLMs are trained on), a fully local LLM inference engine (so you can chat with your LLM without changing apps), and many more!
Thanks for reading my first Devlog! I hope I really stick with the project and don’t abandon it… I am eager to hear your suggestions or questions about my project!
