Deepseek just did the impossible
Deepseek V4.1 Flash explained #ai #llm #ainews #agi #singularity Thanks to our sponsor Luma. Try it today https://lumalabs.ai/aisearch-sep3
Deepseek V4.1 Flash tech report https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash/blob/main/DeepSeek_V41_Tech_Report.pdf
Also see:
How AI models work: https://youtu.be/U2hZFMVNSE0
DSpark https://youtu.be/J0D7qV3nl7w
Deepseek V4 explained https://youtu.be/XJUpuOBpT-4
00:00 Deepseek V4.1 intro
00:44 The situation
01:28 Prefill vs decode
03:20 The problem
06:28 Causal encoder decoder
08:58 Global vs local cache
09:33 Sliding window attention
11:33 L