i crashed node 😭😭😭

the final pieces were adding lists of already-visited websites, and rate limiting myself so i don’t crash goBILDA. whoops….

i need to break up writes to the file in smaller pieces. i’ll probably write per product processed.

and since things are bound to go wrong with a scraper there’s probably some exception to the rule with some random product that doesn’t make it in the scraper / isn’t processed correctly.