"a" before "bit" or "little"
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "a" when it comes before "bit", "little" or "lot", as in "a little bit" or "a lot like". Turned up, the model wrote mostly about "a bit" type phrases in a jumbled way. Steering results mostly looked unrelated.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
. Sometimes a part of the melody will lend itself to particular words. Go with them if they sound right and fit the melody perfectly, even if the words clash a little bit with the rest of the lyrics or don't even make sense. Many
-
important in pop music. Be willing to cut a word or two here or there to make it fit. If you have to, change the melody a bit. Use this to your advantage at different parts of the<|endoftext|>Also found in
-
one how it moves its movements and how they regard each other sending rays to one another,<|endoftext|>Down with Zero Tolerance⏎It might be time to ease up a bit when it comes to disruptive students and detention. The American Psychological Association (APA
-
el each other slightly. This effect is mostly canceled out due to the strong attraction to the nucleus, but it does cause electrons in the same shell to spread out a little bit. Lower shells experience this effect more
-
for 50 minutes. I’m very deliberate about the progression and flow of my lectures. I believe that students tend to get sort of tired and space out a bit if a lecture on any topic goes on and on in the same way,
-
a cone⏎- Glue the nose onto the face using a dot of glue on the nose (this allows⏎the mustache to stick out from the edges a bit in a slightly 3d manner).⏎- Gl
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: all the time, all the time, all the time, all the time, all the time, all the time, all the time, all the time, all the time, all the time, all the time, all the time,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ponges if animal sponges did not exist.⏎Sponges live under water. Most sponges
-
, the two members consisted of a Candida strain of infectious yeast and an antibiotic-resistant pathogenic bacterial strain, such as Enterococcus faecium or Staphylococcus aureus, the researchers report in mBio® this week.⏎
-
of Kolkata (and the location of Writers’ Building) – gets its name.<|endoftext|>Article: Palaeoecology of the mid-Cretaceous siphonate bivalve genus Goshoraia(Mollusca, Vener
-
time; in fact, scientists think that some live sponges could be as many as 5,000 years old.⏎The
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L17:188 excites 'a' before a noun phrase
- L20:901 suppresses
- L19:751 excites the article 'a' before a noun
- L16:880 suppresses
- L4:137 excites
- L9:59 suppresses "a" meaning per (a day, a year)
- L18:1547 weakly excites
- L0:19 weakly excites
- L14:245 weakly suppresses
- L13:373 weakly excites
- L18:828 weakly suppresses
- L8:629 weakly suppresses
- L16:2248 weakly excites
- L2:3039 weakly excites
- L19:1007 weakly excites
- L8:73 weakly suppresses
- L15:2619 weakly excites
- L4:128 weakly suppresses
- L21:1072 weakly suppresses
- L16:2239 weakly excites
- L14:255 weakly excites
- L20:14 weakly suppresses
- L11:1675 weakly excites
- L9:2971 weakly excites
Feeds later layers
- L25:2820 suppresses
- L25:2580 weakly excites
- L23:2823 weakly suppresses
- L23:2460 weakly suppresses
- L26:1149 weakly excites
- L25:1380 weakly suppresses
- L23:1846 weakly suppresses
- L27:185 weakly excites
- L23:2791 weakly suppresses
- L27:506 weakly excites
- L25:1283 weakly excites
- L26:2458 weakly excites
- L23:1987 weakly suppresses
- L24:1875 weakly suppresses
- L25:1849 weakly suppresses
- L23:3011 weakly suppresses
- L24:1025 weakly suppresses
- L24:368 weakly suppresses
- L27:666 weakly excites
- L27:1509 weakly excites
- L23:2881 weakly excites
- L24:2892 weakly excites
- L26:1329 weakly suppresses
- L24:1668 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- bit
- bit
- little
- _bit
- lot
- →bit
- amilies
- 小
- /bit
- Bit
Suppresses
- easiest
- eller
- ATIVE
- 中最
- 地上
- ellers
- tiği
- serter
- hence
- 反正