the word 'Google' as a name
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "Google" when it names the company or its products, such as Google Docs or Google Plus. When it was turned up, the written text drifted off into unrelated topics, so the steering results do not show a clear effect.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
»⏎Filed under: Android, General technology, Google, Media, Services, Augmented reality, eyeglasses, feature, featured, glasses, Google, Google Plus, Google Project Gass, google virtual reality glasses, New York Times,
-
, the usually-installed word processors and spreadsheets like Microsoft Word and Excel are way past their famous years and are giving way to web software like Google sheets and Google Docs. The huge company is even launching its new laptops known as Chromebooks and
-
are some people out there who come up with creative ideas to close the gap.⏎To celebrate the 40 year aniversary of the first moon landing Google released Google Moon. Now, a
-
parts of the task and transform students learning. An example of this is using the commenting service in Google Docs, for instance, to collaborate and share feedback on a given task task.⏎
-
cheadlines⏎Google has started a new page on Google Plus to share their vision of what its augmented reality glasses could be. They are
-
revolution and rotation of the blade are further analyzed, as shown in the figure.<|endoftext|>Source: The Independent – independent.co.uk⏎Up, Up and Away on Google’s Wi-Fi Balloon⏎By: Will Oremus
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the same- and- and------------------------------------------
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
warehouse: The raw material warehouse is used to store the raw materials used in production. Such<|endoftext|>The Leading eBooks Store Online⏎for Kindle Fire, Apple, Android, Nook, Kobo, PC, Mac, BlackBerry ...⏎DK Eyewitness Books
-
who overdrive the conditions.<|endoftext|>Viewing page 28 of 101⏎It looks like you're using a mobile device. We recommend using a physical keyboard for transcription entry.⏎28 REPORT NATIONAL ADVISORY COMMITTEE FOR
-
In the past 12 months, the app was downloaded almost three-quarters of a billion times, which is more than the combined downloads of Facebook, Instagram, and WhatsApp. It is currently in the crosshairs of numerous governments for alleged data
-
Add your thoughts below. You can sign in with Google, Twitter, Facebook, Yahoo! to get your story posted straight away - or just post a comment to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:2362 excites
- L20:2450 excites
- L4:1704 suppresses
- L10:2610 suppresses
- L3:997 excites
- L4:1788 weakly excites
- L21:1454 weakly suppresses
- L10:2738 weakly excites
- L21:904 weakly suppresses
- L12:1878 weakly suppresses
- L20:688 weakly suppresses
- L6:701 weakly suppresses
- L21:2239 weakly suppresses
- L4:1346 weakly suppresses
- L3:139 weakly suppresses
- L0:2140 weakly suppresses
- L21:1835 weakly excites
- L16:1879 weakly suppresses
- L2:800 weakly excites
- L13:1736 weakly suppresses
- L5:1972 weakly suppresses
- L9:3032 weakly suppresses
- L21:2705 weakly suppresses
- L17:3035 weakly suppresses
Feeds later layers
- L23:505 excites
- L25:2577 weakly excites
- L24:1798 weakly excites
- L26:1379 weakly excites
- L23:1816 weakly excites
- L24:481 weakly excites
- L24:271 weakly excites
- L23:2979 weakly suppresses
- L25:2208 weakly excites
- L23:953 weakly excites
- L25:149 weakly suppresses
- L26:1758 weakly excites
- L24:2590 weakly excites
- L24:284 weakly excites
- L27:2513 weakly suppresses
- L24:223 weakly excites
- L23:2697 weakly suppresses
- L23:2829 weakly excites
- L27:578 weakly excites
- L27:2870 weakly suppresses
- L25:612 weakly excites
- L24:2963 weakly excites
- L26:988 weakly excites
- L25:16 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Express
- 플
- Discovery
- faces
- plus
- 他知道
- Pure
- +l
- Works
- +(\
Suppresses
- Boeh
- asticsearch
- itted
- ollapsed
- principals
- -sectional
- olding
- -Identifier
- isque
- HTTPHeader