rs-05-json-value
architecture · deterministic-tests · seed tier 5 · published
Best result per model
| # | Model | Score | Tests | Run |
|---|---|---|---|---|
| 1 | devstral | 0.875 | 7/8 | UD-Q4_K_XL · 24 GB · runner verified |
| 2 | glm-4.7-flash | 0.000 | 0/1 | UD-Q4_K_XL · 24 GB · runner verified |
| 3 | qwen3-coder | 0.000 | 0/1 | UD-Q4_K_XL · 24 GB · runner verified |
| 4 | deepseek-r1-qwen-14b | 0.000 | 0/1 | Q6_K · 24 GB · runner verified |
| 5 | qwen3-coder-next | 0.000 | 0/1 | UD-Q4_K_XL · 24 GB · runner verified |
| 6 | qwen3.5-9b | 0.000 | 0/1 | UD-Q6_K_XL · 24 GB · runner verified |
| 7 | phi-4-mini | 0.000 | 0/1 | Q2_K · 24 GB · runner verified |
| 8 | qwen3.6-27b | 0.000 | 0/1 | UD-Q4_K_XL · 24 GB · runner verified |
| 9 | qwen3.6-35b-a3b | 0.000 | 0/1 | UD-Q4_K_XL · 24 GB · runner verified |
| 10 | qwen3.6-27b-fable-fusion | 0.000 | 0/1 | IQ4_XS · 24 GB · runner verified |
10 models attempted.