You are browsing as a guest. Sign up (or log in) to start making projects!

Open comments for this post

23m 13s logged

Added a queue to the backend so that you don’t get a rate limit or high usage error when messaging easyAI!

There were a lot of messages coming through with “No response” or rate limit errors. I fixed this by changing the mini backend so that instead of just sending the requests to the AI, it also queues the requests and only delivers them back when the AI is available and they are at the front of the queue line.

I learned a bit about react and typescript, as that is what most of the backend is built out of. I also had to mess with SQL so I got to know that better too.

I decided not to make a visible queue line, that’s a bit too complicated and I just wanted to make sure users didn’t have any gaps in the AI returning responses.

0
2

Comments 0

No comments yet. Be the first!