Hardware Llm Optimizer

Hardware LLM Optimizer

Detects PC hardware configuration and recommends which large language models can run.

Features

1. Auto-detect: CPU, RAM, GPU (NVIDIA/AMD), VRAM
2. Calculate: Maximum runnable model size
3. Quantization: FP16 / 8bit / 4bit / 2bit recommendation
4. Model Suggestion: Llama 2/3, Qwen, Mistral, Phi, Gemma, Yi, etc.
5. Bottleneck Analysis: System constraint diagnosis
6. Deployment Tools: Ollama, Llama.cpp, vLLM, Chatbox
7. Optimization Tips: Low VRAM solutions
8. Minimum Config Table: 3B/7B/13B/34B/70B requirements

Usage

When user asks about running LLMs on their computer:

检测电脑配置
大模型推荐
能跑什么模型
硬件检测
LLM优化

Quick Run

python3 skills/hardware-llm-optimizer/detect.py

Requirements

• Python 3.8+
• psutil: pip install psutil
• nvidia-smi (optional, for NVIDIA GPU detection)

Minimum Config Reference

Chinese Interface

This skill outputs in Chinese for user convenience.