heack/Math-Physics-Qwen3.6-10.5B-GGUF
A text model for mathematics and physics, pruned and distilled from Qwen3.6-35B-A3B. It answers in English and Chinese and fits one 16 GB graphics card.
- Parameters
- 10.5 BFrom a 35 B base model
- MATH-500
- 80%32 of 40, levels 4–5; a small fixed subset, Q8
- GPQA-Diamond physics
- 80%24 of 30; a small fixed subset, Q8
- Download
- 6.48 GBQ4_K_M; Q8_0 is 11.17 GB
py -m venv .venv .\.venv\Scripts\python.exe -m pip install --upgrade huggingface_hub .\.venv\Scripts\hf.exe download heack/Math-Physics-Qwen3.6-10.5B-GGUF g64full_kd-Q4_K_M.gguf examples/chat.py setup-runtime.ps1 --local-dir math-physics cd math-physics powershell -NoProfile -ExecutionPolicy Bypass -File .\setup-runtime.ps1 .\runtime\llama-server.exe -m .\g64full_kd-Q4_K_M.gguf -ngl 99 --host 127.0.0.1 --port 18085 -c 8192 -np 1 --jinja --reasoning-format deepseek -fa on -ctk q8_0 -ctv q8_0 -a math-physics-10.5b