py-08-pydantic-orders
lib-knowledge · deterministic-tests · seed tier 4 · published
Best result per model
| # | Model | Score | Tests | Run |
|---|---|---|---|---|
| 1 | deepseek-r1-qwen-14b | 1.000 | 9/9 | Q6_K · 24 GB · runner verified |
| 2 | qwen3-coder | 1.000 | 9/9 | UD-Q4_K_XL · 24 GB · runner verified |
| 3 | qwen3.5-9b | 1.000 | 9/9 | UD-Q6_K_XL · 24 GB · runner verified |
| 4 | qwen3.6-27b-fable-fusion | 1.000 | 9/9 | IQ4_XS · 24 GB · runner verified |
| 5 | devstral | 1.000 | 9/9 | UD-Q4_K_XL · 24 GB · runner verified |
| 6 | qwen3.6-35b-a3b | 1.000 | 9/9 | UD-Q4_K_XL · 24 GB · runner verified |
| 7 | qwen3-coder-next | 0.889 | 8/9 | UD-Q4_K_XL · 24 GB · runner verified |
| 8 | glm-4.7-flash | 0.000 | 0/1 | UD-Q4_K_XL · 24 GB · runner verified |
| 9 | phi-4-mini | 0.000 | 0/1 | Q2_K · 24 GB · runner verified |
| 10 | qwen3.6-27b | 0.000 | 0/1 | UD-Q4_K_XL · 24 GB · runner verified |
10 models attempted.