You are browsing as a guest. Sign up (or log in) to start making projects!

30m 13s logged

As of this project sounds a bit of corporate. It isn’t..

I’m onboard this project thanks to my college’s “Micro Project”.

I’m going to show this project as a “Micro Project” in my college.

The status of the application so far is that only I have make it crawl (not even working as intended).

You can say that current status is the MVP of MVP.

I’ve only attached an LLM using the GROQ’s API (Llama’s 70b model).

And I’m planning to use a smaller model (maybe: Llama 8b). Because..

I found out that GROQ only gives 500k tokens per day. And mostly that becomes half if we use bigger model like 70b or GPT OSS 120b.

So, even though my application doesn’t need that much thinking power. I’ll be planning to use better context pipeline to feed it welll even in the small model.

I’ll be sharing my architecture of this project soon…

Happy hacking ;)

0
14

Comments 0

No comments yet. Be the first!