stardance has been extended another month! the new deadline is october 31 :)

You are browsing as a guest. Sign up (or log in) to start making projects!

Language Diffusion Model Experiment w/ Sudoku

  • 7 Devlogs
  • 35 Total hours

I wanted to research whether Language Diffusion Models are more effective at solving puzzles which are not solved in a left to right fashion.

This needs changes before we can consider it shipped. Review the Shipwright feedback, make updates, then ship again.

Shipwright walkthrough

This needs changes before we can consider it shipped. Review the Shipwright feedback, make updates, then ship again.

Shipwright walkthrough

Open comments for this post

1h 7m 42s logged

Again I got feedback that the code and README looked too AI generated so this is Attempt 3 at restructuring and rewriting the README.

Idk what to put for the image so I put the README, which is now 100% written by me (I changed it to sort of match the Stardance format)

0
0
7

This needs changes before we can consider it shipped. Review the Shipwright feedback, make updates, then ship again.

Shipwright walkthrough

This needs changes before we can consider it shipped. Review the Shipwright feedback, make updates, then ship again.

Shipwright walkthrough

This needs changes before we can consider it shipped. Review the Shipwright feedback, make updates, then ship again.

Shipwright walkthrough

This needs changes before we can consider it shipped. Review the Shipwright feedback, make updates, then ship again.

Shipwright walkthrough

Ship #1 Pending review

I built an end-to-end experiment comparing diffusion language models with autoregressive models on Sudoku. I learned that confidence-guided, out of order unmasking is well suited to constraint-solving tasks: fine-tuned iLLaDA substantially outperformed much larger models on harder puzzles. The biggest challenge was GPU resources.. bro I need an H100 rack at home

  • 3 devlogs
  • 31h
Try project → See source code →

Delete project?

Are you sure you want to permanently delete this project? This action cannot be undone.

All devlogs, followers, and associated data will be removed.

Followers

Loading…