Devlog 3 - StudyBuddy

wrote a script that reads each papers own answer key out of the source pdf and diffs it against my database. so the paper grades me instead of me grading myself. those 14 sheets scored 1 of 14 the first time i pointed it at them. tonight theyre 14 of 14.

barely any of it was the model.

one paper stored 8 of its 15 questions. the model had read all 15

• the log said dropped 6 unreadable question(s). a count. no reason. it said that for two days
• made it print which field rejected the question and it told me on the first run:

choices.0.label: Too big: expected string to have <=8 characters

• answer labels are capped at 8 chars, but the cap runs before the function that shortens them. that function only exists cuz the model returns A. 60 instead of A
• so the cap was checked against exactly the thing the transform was written to fix. coordinate geometry paper, every option reads A. (-2, 3), ten chars, binned
• a count with no reason cant tell u “model returned garbage” from “ur schema is stricter than the paper” and those have opposite fixes

also 44 duplicate-answer flags, every one wrong: -2 and 2 both normalised to 2 lol. on a maths paper the sign IS the question.