'their' after work and manage verbs
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'their' when it follows a verb like 'work on', 'manage' or 'keep', as in 'work on their plantations'. Turning it up made the model's text drift toward generic talk about importance and personal relationships, which is not clearly linked to the trigger.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
professionals⏎- They manage laboratories and the keeper check for possible contamination regarding the manufacturing processes.⏎Careers in the stream of microbiology⏎A microbiologist can perform their duties for government and private company.⏎A microbiologist can
-
47, the War Assets Administration sold the orphan locos to the Atlantic Coast Line and Louisville & Nashville Railroads, which put the Challengers to work on their jointly-owned subsidiary, the Clinchfield, Carolina & Ohio. Thus six engines
-
coming from South-India over 1000 years ago and the "Plantation-Tamils" whose ancestors were brought by the British to work on their tea plantations in the 19th century.⏎The foremost concentration of the
-
Tim. 3:8). That may suggest they were responsible for the finances of the church. Deacons are also supposed to have a demonstrated ability to manage their households well. This may suggest they had certain administrative functions within the church.[i
-
discrimination in the workplace, and sometimes, a very subtle one. Supervisors must continually keep their eyes and ears open for signs of sexual stereotyping. Keep ears open for the
-
Consortium said that this year’s “dead zone” could be the largest since measurements began in the 1980s. The scientists used computer modeling for their prediction and will take shipboard measurements in July throughout the gulf. The dead
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the author's work. This is the first thing that the author does. This is the first thing that the author does. This is the first thing that the author does. This is the first thing that the author does. This is the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
cent bacterium Vibrio fischeri to look for the presence of toxicity in bottom sediments.⏎of ENFO Project)⏎The TTU also provides technical oversight of Whole Effluent Toxicity (WET) testing programs required at some industrial
-
’s Jet Propulsion Laboratory, a division of the California Institute of Technology in Pasadena, for NASA’s Science Mission Directorate, Washington D.C. UCLA is responsible for overall Dawn mission science. The Dawn framing cameras have been developed and built under the leadership
-
control us? This fundamental question of life still remains elusive despite decades of research. Genes are blueprints for proteins, but it is the proteins that actually carry out vital
-
re processing operations at Newmont Boddington Gold - AusIMM⏎The process flow sheet at Newmont Boddington Gold (NBG) comprises primary crushing, closed circuit secondary and tertiary crushing using High Pressure⏎Mines and Projects -
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L5:797 suppresses
- L6:1355 weakly suppresses
- L6:981 weakly suppresses
- L3:858 weakly excites
- L1:2422 weakly excites
- L6:386 weakly suppresses
- L6:2471 weakly excites
- L5:1092 weakly excites
- L5:85 weakly excites
- L4:705 weakly excites
- L5:2668 weakly excites closing parenthesis after a place or name
- L6:2058 weakly excites
- L5:1692 weakly suppresses
- L6:326 weakly suppresses
- L6:1497 weakly excites
- L2:285 weakly suppresses
- L4:1812 weakly excites
- L5:604 weakly excites
- L3:56 weakly suppresses
- L6:1871 weakly excites
- L0:81 weakly excites
- L6:1836 weakly excites
- L1:951 weakly excites
- L1:198 weakly suppresses
Feeds later layers
- L10:3018 suppresses
- L18:2504 suppresses
- L12:2097 suppresses
- L9:608 suppresses
- L12:1998 suppresses
- L8:833 suppresses
- L14:1795 suppresses
- L20:2417 suppresses
- L8:1308 suppresses
- L8:1620 suppresses
- L10:1943 suppresses
- L13:1996 weakly suppresses
- L19:2993 weakly suppresses
- L17:1440 weakly suppresses
- L13:766 weakly suppresses
- L22:1318 weakly suppresses
- L9:1683 weakly suppresses
- L24:2465 weakly suppresses
- L9:798 weakly excites
- L10:2829 weakly suppresses
- L13:2290 weakly suppresses
- L8:2380 weakly suppresses
- L17:2008 weakly suppresses
- L8:1726 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 圩
- ValuePair
- atsby
- eneg
- coalition
- approaching
- _PHYS
- 的信任
- .statusStrip
- atti
Suppresses
- ınız
- ��
- ирования
- тор
- 惑
- чество
- ывает
- unting
- 睡觉
- trl