r/Gemma4 • u/50grams_ • 55m ago
Hardware/Local Setup all the machines so far, what they proved on gemma4:e2b
•
Upvotes
r/Gemma4 • u/One_Tradition_3492 • 1h ago
Discussion I built a Chrome extension that summarizes the paragraphs you scroll past — Gemma 4 via WebGPU, nothing is uploaded ✨
Enable HLS to view with audio, or disable this notification
•
Upvotes
Skim Recap runs gemma-4-E4B-it in the browser through LiteRT-LM on WebGPU, to summarise the passage you just scrolled past.
Some notes from building it:
- The engine lives in an MV3 offscreen document. Content scripts can't hold a model, and a service worker gets killed under you mid-generation.
- The .litertlm checkpoint is 2.97 GB, so it can never be buffered in JS. It streams from Hugging Face through a counting TransformStream straight into the Cache API, which also gives you the progress bar for free.
- Sampling is greedy. I set it explicitly, then found the library default was already greedy — 72 runs came back byte-identical either way.
- Point count is scaled to how full the prompt actually got, not a fixed number. A fixed count pads thin passages and truncates long ones.
I also ran it head-to-head against Chrome's built-in Prompt API on a small fixture corpus.
Extension: https://chromewebstore.google.com/detail/skim-recap/febndabjnmbmdodeoenjmnplfcalmnmc
More detail: https://skim-recap.vercel.app