Gradio Chat Demo (CPU Optimized with GGUF)
Model:
unsloth/gemma-3-270m-it-GGUF
| Quantization:
gemma-3-270m-it-Q4_K_M.gguf
Chat History
Your Message
Model Parameters
▼
System Prompt
You are a helpful assistant.
Max New Tokens
↺
1
4096
Temperature
↺
0.1
1
Top-p (Nucleus Sampling)
↺
0.1
1
Clear Chat History