About to ship the project. if anyone wants to try it please set it upon your computer. Because I have an AMD GPU I haven’t been able to set the LLM up to run on GPU in Docker. You will be able to see the UI and interact with it but you can’t get responses without setting it up locally. I am using Gemma4 but other lightweight LLMs that can accept the context to turn them Scottish should work and you can adjust it easily in the code. This has been a really great project and I’ve learnt so much. Thanks for reading!
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.