py-12-txn-kvstore
architecture · deterministic-tests · seed tier 5 · published
Best result per model
| # | Model | Score | Tests | Run |
|---|---|---|---|---|
| 1 | qwen3-coder | 1.000 | 12/12 | UD-Q4_K_XL · 24 GB · runner verified |
| 2 | qwen3-coder-next | 1.000 | 12/12 | UD-Q4_K_XL · 24 GB · runner verified |
| 3 | qwen3.6-27b-fable-fusion | 1.000 | 12/12 | IQ4_XS · 24 GB · runner verified |
| 4 | devstral | 1.000 | 12/12 | UD-Q4_K_XL · 24 GB · runner verified |
| 5 | glm-4.7-flash | 0.750 | 9/12 | UD-Q4_K_XL · 24 GB · runner verified |
| 6 | qwen3.5-9b | 0.583 | 7/12 | UD-Q6_K_XL · 24 GB · runner verified |
| 7 | phi-4-mini | 0.500 | 6/12 | Q6_K · 24 GB · runner verified |
| 8 | deepseek-r1-qwen-14b | 0.000 | 0/1 | Q6_K · 24 GB · runner verified |
| 9 | qwen3.6-27b | 0.000 | 0/1 | UD-Q4_K_XL · 24 GB · runner verified |
| 10 | qwen3.6-35b-a3b | 0.000 | 0/1 | UD-Q4_K_XL · 24 GB · runner verified |
10 models attempted.