You are browsing as a guest. Sign up (or log in) to start making projects!

9h 58m 32s logged

MIRAGE Devlog 1 - First 10 Hours

  • Audited Qwen3-Coder-30B-A3B. Direct conversion was rejected: its experts need about 54 GiB in BF16, while the artifact limit is 7.2 GiB.

  • Built the MIRAGE-7B budget solver and preserved all capture, replay, training, Vulkan, CUDA, and benchmark work.

  • Built a real 97M prototype with attention, RoPE, KV cache, shared experts, hard routing, and text generation.

  • Training, checkpointing, routing, and tiny-set memorization worked. File/repository splits and exact/near-duplicate checks were added, but generalization is unproven.

  • The 15,000-step run stayed finite and passed checkpoint round-trip checks, but quality remained experimental.

  • Vectorized bundles were 13.82x faster in isolation. Native Vulkan ray tracing worked, but was 5.17x slower than software and rejected no candidates.- Added frozen search schemas, task/evidence graphs, replay, and untrusted-page handling. Started audited data builders and Qwen3-0.6B upcycling; learning and live web remain unfinished.

0
3

Comments 0

No comments yet. Be the first!