You are browsing as a guest. Sign up (or log in) to start making projects!

Open comments for this post

3h 31m 34s logged

I rewrote the whole pipeline in Node.js and parallelized all the agents because the Python sequential version was timing a 7-claim article at 68 seconds, which is not usable. The rewrite took about 90 minutes and the rest of the session was debugging differences between the Python and Node versions, mostly around how I had structured the retry logic. Running 14 concurrent API requests at once got me rate-limited immediately, so I added a concurrency queue capped at 4 simultaneous calls, and the same article that took 68 seconds dropped to 14 seconds.

0
1

Comments 0

No comments yet. Be the first!