py-14-regex-engine
architecture · deterministic-tests · seed tier 5 · published
Best result per model
| # | Model | Score | Tests | Run |
|---|---|---|---|---|
| 1 | qwen3-coder-next | 1.000 | 19/19 | UD-Q4_K_XL · 24 GB · runner verified |
| 2 | deepseek-r1-qwen-14b | 0.895 | 17/19 | Q6_K · 24 GB · runner verified |
| 3 | qwen3-coder | 0.684 | 13/19 | UD-Q4_K_XL · 24 GB · runner verified |
| 4 | devstral | 0.526 | 10/19 | UD-Q4_K_XL · 24 GB · runner verified |
| 5 | glm-4.7-flash | 0.421 | 8/19 | UD-Q4_K_XL · 24 GB · runner verified |
| 6 | qwen3.5-9b | 0.316 | 6/19 | UD-Q6_K_XL · 24 GB · runner verified |
| 7 | phi-4-mini | 0.158 | 3/19 | Q6_K · 24 GB · runner verified |
| 8 | qwen3.6-27b-fable-fusion | 0.000 | 0/1 | IQ4_XS · 24 GB · runner verified |
| 9 | qwen3.6-27b | 0.000 | 0/1 | UD-Q4_K_XL · 24 GB · runner verified |
| 10 | qwen3.6-35b-a3b | 0.000 | 0/1 | UD-Q4_K_XL · 24 GB · runner verified |
10 models attempted.