Spark-X2.6-4B's CRAZY Thinking Dial: 180 Tests on an 8GB GPU
Spark-X2.6-4B thinking modes tested: none vs low vs high, 180 graded runs on an 8 GB RTX 4060 laptop GPU. Does turning the dial up earn its tokens? In my tests: default to low. Every number and every failure is in the video. What I found (my tests, Q4_K_M, temperature 1.0, 20 challenges x 3 modes x 3 passes): - Correct out of 60: none 48, low 54, high 53 - Tokens generated: none 12,179, low 47,789, high 69,338 - Thinking fixed the logic puzzles (8 to 15 of 15) but did not help debugging, and high used about 45% more tokens than low for no better score - The default Ollama tag (8.2 GB) ran 49%
Discussion
Rejoignez la communauté pour réagir et poser vos questions.
Aucun message pour l'instant. Lancez la discussion !