DevLog #6 making it an actual puzzle game

so i realized it wasnt a puzzle game at all. it was just a terminal that told you when you read the wrong file, which is not a game,

now the machine still makes predictions, but theyre just little thing pointing at stuff you havent seen yet instead of punishing you. reading the wrong file
does nothing now.

added a hint command so if you get stuck it helps you toward the next step, and a decrypt command for the encrypted message. the clues are scattered across
the files and some folders are hidden so do you have to actually look.

theres a real win condition now. figure out what happened, decrypt the last thing, and then do the one move the machine could never predict.

**DevLog #5 (final) **

this session started as a broken little terminal page and ended as an actual finished game.

first it was fixes. the enter key wasnt making new lines so everything looked cramped, then i cleaned up the code and split it into separate files instead of
one big mess.

then the actual game. built the whole filesystem with the lore, hidden folders, and this ai that predicts what youre about to do. read the wrong file and it
hits you with PREDICTION FAILED and the confidence drops lower every time.

four endings now. obey it, fight it, find voss’s message (which is encrypted so you decode it yourself), and a secret one where you type null twice.

made the terminal look nicer too. location prompt is green, errors red, warnings amber, and the ai talks in a cold blue.

then the extra stuff. after an ending you press enter and it starts a new run, theres a model command that shows everything its been tracking about you, and
player.dat remembers how many times youve connected even after you leave.

last bit was the ai talking when you sit idle and more variety in the predictions, then i put the whole thing on github pages so it has a real link now. and you guys can play it

the games completely done, hope you like it!

DevLog #4 Lore and Endings

spent this one on the actual game instead of the look of it. the filesystem is full of real lore now instead of placeholder text, and there are hidden folders
you can only get into if you already know the name.

also got the prediction engine working properly. the ai predicts what file youre about to open and it shows up in /predictions. if you read something else it
hits you with PREDICTION FAILED and the confidence drops, which is basically the whole thing.

there are four endings now. one where you do what it says, one where you keep breaking the predictions, one where you find voss’s real message (its encrypted
so you have to decode it yourself), and a secret one where you type null twice.

the game remembers how many times youve connected now too. player.dat said previous contacts 1 the first run and it goes up every time even after you close
the tab. creeped me out a little honestly.

at one point i had the terminal inside a little window with a titlebar but it looked wrong for the vibe so i took it off and just kept the colors.

next i want to add the ai saying stuff when youre idle and some more variety in the predictions so it doesnt feel so samey.

DevLog #3 Terminal Polish

spent a bit of time polishing the appearence of the terminal, now the little location thing on the left is green so the outputs are seperated more cleanly
I also made the little cursor/arrow blink , like in a real terminal and made some other little changes

at some point i had issue with the terminal not rendering correctly but I fixed it with a center div

for the next devlog i’ll be working on the lore and the
progression of the game, it still needs a bit of work

DevLog #2 The Lore

this part took me alot of time, i ahd to come up with some sort of story for this puzzle, I won’t spoil it for you but i think you guys will love it, I also spent some time making the cat commands refining some thing and fixing some bugs

one of the bugs i encountered was the file path not appearing correctly when using ls, It was pretty easy i just had to include in every argument because or else it wouldn’t show up every time.

I also made the text files with content inside of them and little hints that will allow you to solve this puzzle!

Tonight i’ll work a bit on the appearence of the terminal it looks a bit boring rn

Devlog #1 - The Terminal

This is gonna be the first game i’m making on stardance. I’ll try to no give too many hints or reveal anything on the devlogs, so for this game, you’ll be in the terminal and try to solve a puzzle by navigating through the filesystem and looking at the different files. I spent about 1 hour and a half making the terminal and the filesystem, i cant say it was easy but with a bit of research I managed to get multiple commands working like ls and cd.

I’m also still working on the lore and story and I think you guys will love it!

devlog #17 MI300X vLLM serving
The old GPU box got destroyed, so I spun up a new MI300X with the same SSH key. ROCm 6.2 and Torch 2.5.1 were already set up, so getting the machine ready was easy.
The hard part was vLLM. The pip version is CUDA only, and the ROCm Docker image only supported the multimodal version of Qwen3.5. Our model is text-only, so I had to patch the image.
I added Qwen3_5ForCausalLM, fixed the hybrid KV-cache setup, added the missing Mamba state methods, and mapped the weight names so the text-only safetensors loaded correctly. I also patched the merged config to remove the M-RoPE and dtype fields.
After that, the model served normally.
I ran a one-task test with fix-git. The pipeline worked, but the model got stuck repeating git show until it ran out of turns.
##Shipped
The merged model is now public on Hugging Face as mateo0093/le-gros-chaton under Apache-2.0.
The 5×5 Terminal-Bench pilot finished at 3/25 (25%). All three successes were on fix-git, which shows that the SFT data was too focused on git tasks.
I also tested RLVR with GRPO and a novelty bonus. The reward had almost no variance, so the training signal was basically useless. I saved the step-10 adapter but didn’t merge it.
The GPU used about 12 hours of the 50 hour budget. All the vLLM patches and harness changes are in the repo.
Main lesson: Qwen3.5’s hybrid model is a bit annoying to serve as text-only on ROCm. The model works but i think this was more of a learning opportunity, i know what i’ve done wrong and what i would have done differently, I will be working on a new model in a few weeks once I do a bit more research.

Devlog #16, t4gpu

The T4 16GB fought us the whole way. BF16 was baked into a pre quantized checkpoint, which made each step take 668 seconds because it had to use FP32 emulation. 2K context ran out of memory, the 248K logits ran out of memory too, FP16 started producing NaNs, Kaggle session limits locked us out, and the paged optimizer crashed last.

Every fix seemed to create another problem. We eventually got it working with FP16 compute, chunked assistant token loss, autocast, and plain AdamW.

Then we got access to an AMD MI300X with 192GB of memory. No quantization, 16K context, and enough memory to train full traces instead of cutting them off halfway through a message.

Right now the 16K BF16 SFT run is training on the MI300X. Next up is merging the model, running Terminal Bench, and then RLVR.

Devlog 15 Traces are done

The trace generator finally hit the target and went past it. We got 474 verified trajectories, zero malformed, zero duplicates, 19 templates, and a 95 percent self review pass rate. We were aiming for 450, so we ended up with 474.

The dataset is synced to Hugging Face in two versions: raw and normalized. That part is finally done. It was the longest part of the project, and the model is only going to be as good as the traces, so getting this right was important

The Kimi endpoint also stopped working. The old teacher account started returning 503 errors during generation and eventually died completely. We switched to a second Kimi account, which needed an extra header that we did not have at first. After figuring that out, generation resumed without losing any progress

For GPUs, the 2070 still cannot realistically train the 9B. Kaggle hours are back, so we have 30 hours on a T4. The 4090 from my dad should arrive next week. The plan is to use the T4 for trajectory SFT, then the 4090 for merging, Terminal Bench evaluation, and RLVR.

Status: 474 out of 474 traces done,

Devlog #14 worked a lot, still not done

we worked a lot this week. honestly the main takeaway is that the fable5 sft was good but its traces alone weren’t enough the model needs way more verified agent trajectories, so we’ve been grinding those out (target is 450).

we also ran out of credits mid-generation (the modal endpoint started failing with 503s) and had to switch to a second kimi account. took a minute to get the auth right the new endpoint wanted an extra header we didn’t have. after that the generator resumed fine and it’s been adding verified traces since (~340/450 now).

biggest scare: we found out peft 0.20 silently drops the second adapter when you merge two at once. tested it and yeah, the outputs were identical with one or two adapters so our trajectory sft would have been lost in the merge. fixed it by merging sequentially (base first, then the second adapter). checked against the live model and it matches, so we’re good.

my 2070 couldn’t fit the 9b model for real training, so we’re waiting on a 4090 (my dad’s) next week. all the scripts are ready sft, merge, rlvr, eval, even a setup script for the gpu box. just need the hardware.

status: 340/450 traces, everything ready, waiting on the 4090. we’ve worked a lot, but the real run hasn’t happened yet :/.

Devlog #13 we worked ALOT

so this was the grind day. 18 hours of training babysitting and honestly it felt like 40.

the modal training kept dying every hour. the client would crash and take the whole run with it. we restarted like 3 times before figuring out modal run -d (detached) keeps it alive on their servers even if our computer shits the bed. tested it by literally killing the process and it kept going. ez fix but we worked ALOT to get there.

then we ran out of credits at 93% and switched accounts, but the other account “finished” the run in 6 MILLISECONDS which was sus af. turns out it just re-uploaded the old checkpoint and trained nothing. the resume logic had a bug where it thought 6200 >= 3799 meant done. patched it. another lesson learned.

also we made the model creative lol. added diversity sampling to the trajectory generator (5 solutions per task, keep the novel ones), a novelty bonus reward for RLVR, and a creativity rule in the self-awareness prompt. so the fat cat will be innovative, not just memorize.

current state: SFT is done at 91% (good enough), resume bug fixed, phase 2 (trajectory SFT with creativity + self-awareness baked in) is up next.

18 hours. we worked ALOT. the fat cat will be worth it 😼

Devlog #12 training kept dying

for the last 10 hours the training kept crashing. not the model, not the gp but the modal client. every hour or so it would lose connection and take the whole run down with it. we’d restart, it’d run an hour, crash again. three times.

the fix was simple: modal run -d runs detached, so the training lives on modal’s servers and doesn’t care if our local process dies. killed the client on purpose to test — training kept going. that’s it, that’s the fix.

also worried the loss wasn’t moving but it was fine. lr had wound down on the crashed run, looked scary, re-warmed fine after restart. loss is 0.668 now and dropping.

status: 72% through the fable5 sft. checkpoints safe on hf. after this: trajectory sft with the self-awareness stuff baked in, then rlvr, then real numbers.

** Devlog #11 half way there! **

the training is going pretty well, I fixed a few bugs with the code and added documentation

training is at 50%!

** Devlog #10 the full training is finally running **

ok so phase 1 full training is officially going. 160k rows of fable5 data on modal, resuming from the 12.8k rows we got on kaggle before the session cap killed us. we’re at ~27% and it should take like a day and a half total.

big stuff that happened since last time:

fast kernels actually work now. the model has hybrid linear-attention layers and transformers kept falling back to a slow torch path. the fix was: nvidia cuda-devel base image (needs nvcc to compile), installing flash-linear-attention[cuda] + causal-conv1d, and pinning torch 2.10. took a couple tries but now training is like 4x faster than it would be without them.

had to split across two modal accounts. first account ran out of credits, so we set up a second profile and the script auto-resumes from the huggingface checkpoints when it dies. it’s been rock solid, it happens every 20% plus every hour it saves and uploads. lost zero progress to the account switch.

we gave the model a personality. it’s called Le Gros Chaton (the fat cat) and we’re training self-awareness into it, not as a system prompt but baked into the weights. state-sheets ([STATE] goal/known/tried/failed/next), metacognition lines, and self-review at the end of tasks. the trajectory sft masks out the system prompt so the model learns to track its own state as behavior, not as a script it repeats.

did some benchmark research too. base qwen3.5-9b scores 9.2% on terminal-bench 2.0. comparable 9b fine-tunes hit 24-28%. that’s our realistic target which is 2.5-3x the baseline.

honestly at this point it’s just… waiting. the pipeline works, the checkpoints work, the account switching works. now the model just needs to finish cooking. then trajectory sft, then rlvr, then we actually see the benchmark numbers.

# Devlog #9 — finally training, and now with checkpoints!

so last time i was stuck debugging phase 1/2 on kaggle. well, still debugging lol, but we actually got somewhere.

the first issue was transformers not knowing what the qwen3.5 model was, had to pin transformers 5.14.1. then tokenizers kept fighting with it (0.22.0 wants old huggingface-hub, 0.22.1 is fine). then torch on kaggle kept giving a p100 which modern pytorch just refuses to run on, so we had to tell it to give us a t4 instead.

then the fun one: out of memory on the very first step. batch 2 was too big for the gpu they gave us, so batch 1 it is.

also i learned the hard way that kaggle kills your session after 12 hours. the first long run got cancelled at 80% done and i had nothing saved. so now the training script saves a checkpoint every 20% + every hour and uploads it to huggingface, so if it dies we just resume. it actually saved us, the run got cut and we picked right back up from the checkpoint.

right now the full 160k sft is running on modal (paying for gpus now, kaggle time ran out). it’s at like 9% and should take a couple days. we’ll see how it goes, and then rlvr after that.

the end of the errors… might actually be in sight this time.

Devlog #8 — phase 2 fixes
I’ve been getting a lot of issues with the first two for this model. I’ve gotten a lot of errors in Kaggle and Colab. I’ve tried everything, and I’m still fixing the code. It’s taking a good amount of time, but I think I’m almost there. I’ve gone through a lot of errors, and I’m probably right at the end of the errors. I might be able to start actually training it tomorrow, but for now I’ll stop.

Devlog #7 — phase 2 running

phase 1 (sft) is done and phase 2 (rlvr) is running now on kaggle. this is the part where the model actually gets
trained on solving coding problems with our verifier giving rewards, not just imitating fable data.

honestly this is the part i care about more. sft just makes it mimic. rlvr is where it learns to actually fix
code. grpo with proportional rewards = the model gets partial credit for getting some tests passing, which is way
better than all-or-nothing.

while it runs im just waiting tbh. not much to build. the pipeline works, the eval works, the agent works.

next after this: full benchmark run. humaneval, swebench, agentic eval. we’ll see if all this actually made the
model good at coding or if i just spent a week on a worse qwen lol.

Devlog #6 — training done (phase 1)

finally got the qwen finetune to actually run with 625 steps, took like 8 hours on kaggle. it finished.

havent run full benchmarks yet cause i was busy building other stuff while it trained. but it trained. thats the
main thing.

I also built a swebench agent that can actually navigate repos and edit files and make patches. not just the basic agent
loop that runs commands. this one actually works for real se tasks.

also added swebench eval so we can measure if the model is actually good at fixing bugs and coding

then i’ll run the benchmarks on the trained model and see if its actually any good lol.