/ sandbox / browser-llm

In-browser LLM · WebGPU

2 files · monaco editor↗ Open on GitHub
chat
// session start

Everything runs on your device.

Pick a model on the left and hit Load. First run downloads weights (~100MB+). After that, it's instant forever.

promptload a model first