Refactoring Dataset Generation

Implementing dataset generation checkpoints, in case generation fails, I can just start from where I left off. Also employs synthetic dataset generation.

Basically I’m rewriting the compile_confirmed_dataset and same for negative dataset to include checkpoints and all, because last time when I tried to generate dataasets without this it led to the endpoint giving an error and my whole generation is wasted. Even though it took 12+ hours to generate it