NCM: The End of LLMs? Not So Fast (Local Tests)

Next-Concept Modeling (NCM) from Stanford’s Hazy Research writes an answer as a rough sketch first and the exact words last, in a handful of passes instead of one pass per token. I ran the released models on a DGX Spark and timed NCM against a same-size word-by-word LLM: it’s up to 4x faster for one request and 4–8x slower at 64 requests. I also trained my own diffusion model, which tied NCM’s 86% on hard Sudoku once it filled the most confident cell first. Paper: https://arxiv.org/abs/2610.14162 Code: https://github.com/HazyResearch/ncm Checkpoints: https://huggingface.co/hazyresearch/ncm-che