'a' after verbs like require or without
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "a" when it comes right after a verb or a word like "without" or "require", such as "without a clear path" or "requires a level of precision". Turning it up didn't produce anything that clearly matches this pattern, so the steering results don't add much.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
standards for washability, mold and microbial resistance, and fire safety. Ceiling panels with these characteristics are ideal for patient rooms, treatment rooms and other spaces that require a balance of cleanliness and quiet.⏎Ceiling panels with a NRC of 0
-
PV works year round. It uses daylight to generate electricity. Naturally, on rainy days or shorter winter days, there is less daylight so the system will not produce a lot of power. Call to our office to see our fully functioning solar PV system
-
aver in an emergency. If there is a fire in your home, for example, a single stairwell may become unusable, leaving family members and tenants without a clear path to safety. In basements, egress windows are essential.⏎An
-
When women were accorded full status as electors in August 1920 by the Nineteenth Amendment to the federal Constitution, the...⏎Users without a subscription are not able to see the full⏎to access all content.<|endoftext|>Great
-
freedom they deserved. The slaves were like puppets that the American people could control. The slaves couldn’t vote, they didn’t have a choice on what they were going to do that day, and they couldn’t say
-
breathing, while vocal cord surgery addresses similar problems with sound and articulation.⏎In many cases, surgeons operate on delicate structures such as minute blood vessels, which requires a level of precision and expertise that our medical staff are skilled at providing. Common procedures
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I am a new software development software and I have been told that software test software test software test software test software test software test software test software test software test software test software test software test software test software test software test software test software test software
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
help you fall asleep, too much will have you “ping” awake in the middle of the night. This will drastically affect your quality of sleep.⏎- Create total darkness and quiet
-
Mitanni was a multiethnic empire composed of different kingdoms spread out through the land between Anatolia (modern Turkey) and Babylon (modern Iraq).⏎Mitanni took brief control of the region in the Tigris and Euphrates basin between
-
is Noether's theorem, which states that there is a one-to-one correspondence between each one of them and a differentiable symmetry of
-
to force tax hikes onto local residents in an effort to bring funding for poorer school districts into greater parity with wealthier districts. It was at this point that the concept of self
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:487 excites
- L19:2406 excites
- L18:934 suppresses
- L18:2815 suppresses
- L17:2009 suppresses
- L18:2720 suppresses
- L18:1498 suppresses
- L18:1084 excites
- L18:861 excites
- L15:2133 suppresses
- L18:1359 weakly suppresses
- L8:336 weakly excites
- L17:2659 weakly suppresses
- L3:1218 weakly suppresses
- L18:178 weakly suppresses
- L19:2761 weakly suppresses
- L19:262 weakly excites
- L10:155 weakly suppresses
- L17:2685 weakly suppresses
- L19:1180 weakly excites
- L16:513 weakly suppresses
- L10:783 weakly suppresses
- L17:2914 weakly suppresses
- L1:689 weakly suppresses
Feeds later layers
- L24:153 suppresses
- L21:1501 excites
- L22:1081 excites
- L22:496 weakly suppresses
- L27:434 weakly excites
- L23:1535 weakly excites
- L22:211 weakly excites
- L25:390 weakly excites
- L25:284 weakly suppresses
- L21:675 weakly suppresses
- L26:174 weakly suppresses
- L25:425 weakly suppresses
- L27:1102 weakly excites
- L27:814 weakly excites
- L21:2557 weakly excites
- L22:626 weakly suppresses
- L26:678 weakly suppresses
- L22:1881 weakly excites
- L25:410 weakly excites
- L23:1529 weakly excites
- L26:2099 weakly excites
- L21:758 weakly excites
- L23:218 weakly excites
- L27:556 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- sense
- approach
- sense
- 度
- knack
- 一场
- 률
- basis
- standpoint
- degree
Suppresses
- øj
- ighbors
- olutely
- ног
- dotyczące
- payments
- 鸨
- ây
- anz
- miejscowości