'it' in 'as it sounds' idioms
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'it' (or a similar word) in phrases like 'exactly what it sounds like', 'the way it is expected' and 'as it should be'. Turning it up made the model write unrelated text, so the phrase pattern is the main clue.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
We are very excited about the Bay Area Priority Conservation Area (PCA) program’s new urban greening designation.⏎Like PCAs, urban greening means exactly what it sounds like—improving our quality of life through trails, parks, street
-
system in order to detect bugs in the product so that they get fixed. Testing is an integral part of QC as it helps demonstrate that the product runs the way it is expected and designed for.⏎To summarize, think of everything as an assembly line
-
was a wave that brought in immigrants from Asia and Africa.⏎And so, there were times in our history where the U.S. was just not the country it was supposed to be.⏎In that sense, the story of how our nation has come
-
liver disease is a condition that can have a significant impact on quality of life, yet it is not something we hear about very often. The condition is exactly as it sounds. Fatty liver disease develops when an excessive amount of fat builds up in
-
00. Within four months, these men<|endoftext|>Our discourse by now may have proved to the reader that the⏎British Empire is not as mythical as the propaganda would have us believe.⏎We quote from THE NATIONAL MESSAGE, of London, England,
-
actual glimpse of its mystic history. From ancient buildings to the modern wonders Delhi offers anything one can desire for. The rulers who have ruled India from Delhi have left their influence in the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: if the following, if it is, and if it, and if it, and if it, and if it, and if it, and if it, and if it, and if it, and if and only if, and if
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
.⏎Discovering this now, we object to this language – we are same-sex attracted, and we wonder at how this woolly description was approved, and on whose recommendation. However, in mitigation, this version
-
grief. Now in whose grief does a newborn child weep? That’s the question, which can be
-
no evidence indicating that if you eat after a certain time, you are guaranteed to gain weight. Based on your body type and height, your body needs a specific number of calories in order to maintain your present weight. If you consume all of those
-
of the fasting month Ramadan.⏎- Laylat al-Qaddr (Night of Measure): ≈ 27th Ramadan*⏎Muslims believe that it was on this night that God has first send down the first verses of the Quran via the angel
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L13:1847 suppresses
- L14:925 suppresses
- L15:1132 excites
- L13:1770 suppresses
- L15:1407 excites
- L15:1923 excites
- L13:2980 excites
- L15:835 suppresses
- L12:1255 suppresses
- L13:2715 suppresses
- L8:2827 excites
- L14:1854 suppresses
- L13:1147 excites
- L15:836 excites
- L14:2886 suppresses
- L13:2267 excites
- L13:2376 excites
- L7:934 excites
- L12:1218 excites
- L12:2578 suppresses
- L12:870 suppresses
- L14:1779 excites
- L14:2359 excites
- L6:894 excites
Feeds later layers
- L18:780 suppresses
- L18:1983 suppresses
- L17:1528 suppresses
- L21:1420 excites
- L17:1689 suppresses
- L18:2459 suppresses
- L17:2942 suppresses
- L17:2044 suppresses
- L18:2328 suppresses
- L18:1829 weakly suppresses
- L20:1388 weakly suppresses
- L18:2027 weakly suppresses
- L18:2157 weakly suppresses
- L18:1577 weakly suppresses
- L18:1410 weakly suppresses
- L18:483 weakly excites
- L19:2637 weakly suppresses
- L18:517 weakly suppresses
- L17:1477 weakly excites
- L20:2137 weakly suppresses
- L18:2379 weakly excites
- L17:2696 weakly suppresses
- L17:2057 weakly suppresses
- L17:2504 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ulk
- ul
- 实务
- ologies
- chồng
- urers
- oint
- trak
- ост
- index
Suppresses
- 的产品
- 的商品
- したもの
- 的东西
- 的女儿
- 的房子
- 的文章
- 指导下
- 的时间里
- 的结果