sentence end right before a line break
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires at the end of a sentence, where a period or question mark is followed by a line break, especially in web text and lists. It is quieter on words like "also" or "many" that lead into "more". Turning it up gave text that did not clearly show this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
How does an elephant pick up a tortilla chip without breaking it? How long does an elephant take to urinate? What animal makes cube-shaped poop and why?⏎Answers to these questions fall in the area of animal biomechanics. Learn how
-
grizzly bears, mountain lions and beavers. The Grand Canyon can be found in the Rocky Mountains. The plateaux tend to be areas of semi-desert.⏎The states of California and Oregon can be found along the Pacific Coast. The climate
-
icable settlement. 4. Agreement :- Mediation confirms and clarifies the terms of settlement and reduces the settlement into a clear, complete, concise and concrete agreement.⏎(4) WHAT DOES A MEDIATION DO- • Mediation is impartial
-
importance of Dussehra-Vijaya Dashami-Dasara Festival, how to celebrate Dussehra-Vijaya Dashami-Dasara festival⏎Dussehra or Vijaya Dashami or Dasara is an important
-
more important that the people of Kansas determined their government rather than not having one because of the issue of slavery.⏎Keywords: African Americans; Constitutions; Kansas Territory. Governor; Railroad land grants; Schools; Slavery; Voting; Walker, Robert
-
wounded soldier is strapped in, and it takes off. It lands at the Mobile Army Surgical Hospital. Soldier on stretcher is shifted from helicopter into a military ambulance.⏎This historic stock footage available in HD and SD video. View pricing below video player
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been a teacher and I have been a student and I have been friends and I have been a family and I have been a work and I have been a and I had and and and and and and and and and and and and
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
to fundamental movement skills, object control, stability factors and, last but not least, reaction speed. Countless sporting activities and games such as running, jumping but also catching or throwing objects require some well-developed motor skills that will allow the child
-
Biography of former United States President George Herbert Walker Bush.⏎Sign up today for free teaching ideas, lesson plans, online activities, tips for your classroom, and much more.⏎Choose your grade range:⏎See a sample ><|endoftext|>In any hospital,
-
the field of home automation, robotics and many more. You can simply browse in the menu and on the page or leave a
-
Kids!⏎Compilation of great sources of information for children on plants, botany, gardening, horticulture, hydroponics, and much more. [Recommended by Ms. McKnight's class in Delaware.]⏎Root
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:2444 suppresses
- L6:520 excites
- L6:1230 suppresses
- L6:912 excites
- L12:1585 excites
- L9:1055 suppresses
- L11:876 suppresses 'other' after 'among' in lists
- L10:816 excites
- L10:105 suppresses
- L7:50 suppresses
- L11:646 excites
- L7:6 weakly suppresses
- L5:531 weakly excites
- L8:57 weakly excites
- L11:1272 weakly excites unclear: sentence ends in factual prose
- L5:5 weakly suppresses digit after a label like paper or type
- L8:1645 weakly excites
- L5:203 weakly suppresses
- L6:1596 weakly excites summary transition phrases like 'in short'
- L7:163 weakly suppresses
- L8:7 weakly excites
- L3:70 weakly suppresses
- L10:801 weakly excites
- L7:210 weakly suppresses
Feeds later layers
- L14:1116 excites 'and' inside lists
- L15:2277 excites
- L15:38 excites
- L16:2432 suppresses
- L15:3020 excites
- L17:1499 suppresses
- L17:2323 excites
- L16:2442 excites
- L14:1335 suppresses
- L18:2202 excites
- L16:767 excites
- L26:347 suppresses the 're' in self-reliant and similar
- L16:1141 weakly suppresses
- L23:379 weakly suppresses
- L15:986 weakly suppresses
- L16:2861 weakly excites
- L14:936 weakly suppresses 'and' or 'or' in a list of three or more
- L14:1382 weakly suppresses
- L14:757 weakly suppresses
- L21:739 weakly suppresses 'both X and Y' pairing words
- L19:1506 weakly suppresses
- L15:143 weakly excites
- L16:3064 weakly excites
- L19:1605 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 特别声明
- utex
- allo
- olio
- ימה
- ling
- specific
- ull
- 怀抱
- ope
Suppresses
- eker
- mouseClicked
- isers
- ksen
- }s
- 和社会
- правило
- pund
- igt
- стью