20 hour in and I’m getting apprehensive as to the utility of this run. Lots of code changes and testing. The process is a well defined one, at least conceptually. It is still on step 1 of 5. The first step being scraping government websites in a country (not the US) that ostensibly has a lot of open data, but practically tries to restrict scraping by any means necessary.
Codex is dutifully writing, running, and updating numerous scrapers to deal with the random 403s that shouldn’t 403, data inconsistencies on government websites, and connecting records via trial and error.
But I heard a long time ago never to attribute to malice what is more likely simply incompetence.
