Settings:
Model size:
Small: 200MB; Medium: 400MB; Big: 1.4GB. Big will probably crash this website.
Models are cached in your browser and run locally (when available with webgpu).
Infos:
Using SmolLM2 Models and Transformer.js.
External Models:
Get one at console.groq.com. The key is stored in this browser only and is sent straight to Groq — it never reaches this website's server.
The models are hosted on Groq and run on their hardware. Your chat messages are sent to them. Their Privacy Policy applies.