unclear: document ends and timestamps
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The strongest cases are a mix: the end-of-document marker, and spots inside date and time stamps. The negative cases are pieces of words split in the middle of a name. We could not find one clear story for this neuron, and the steered outputs do not point to a single theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
will print you need to store it in 6 bytes, with the last byte equal to 0.⏎October 3rd, 2010, 07:44 AM⏎We are not going to do you homework.⏎
-
other early math activities.⏎Do you have any other fun ways that you re-use candy at your house?⏎What else have you made from an egg carton?<|endoftext|>Newport Aquarium's 150-year-old turtle dies⏎Newport Aquarium
-
support your answer.⏎problem6. Compare and contrast a peer-to-peer network architecture to Client-Server architecture. Support your answer with proper diagrams and exs.<|endoftext|>The Minister for Housing, Local Government and Heritage, Darragh O’Brien,
-
being caused by curve space when neither were in motion, what causes the force to act upon each other.⏎Hope this is clear enough to get my question across.<|endoftext|>Yesterday I cut myself some fresh pineapple, then promptly proceeded to
-
al-install, you can manually download and install bool-extras:⏎tar xzf bool-extras-0.3.0.tgz⏎./Setup.lhs<|endoftext|>Education Pioneers recruits, develops, and connects professionals from diverse backgrounds to resolve
-
taste works⏎Scientists have discovered an ion channel that allows taste buds to communicate with the brain.⏎Wed, Mar 06, 2013 at 03:20 PM⏎taste buds on mouse tongue (Photo:
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I need to find the number of the number of the number of the number of the number of the number of the number of this is the number of this is the number of this, and the number of this, where the number is a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of which are particularly flexible, while others carry meshes of wires within them for electrical connectivity, and yet others act as insulators.<|endoftext|>Heb. 'eshel ( Genesis 21:33 ; 1 Samuel 22:
-
., in association with Lou Weller (Caddo), the Native American Design Collaborative, and Polshek Partnership Architects of New York City; Ramona Sakiestewa (Hopi) and Donna House (Navajo/Oneida)
-
from 20 countries in a Bangkok, Thailand, workshop to help set up a tsunami early warning system for the Indian Ocean, in a bid to avoid a reply of the December 2004 tsunami. Presumably, many of
-
indoor evaporator coil. The heat laden freon then flows back out to the outdoor condensing unit, which then dispells the heat to the outside, via the outdoor condenser coil.⏎Both the indoor
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:262 strongly excites
- L11:321 strongly excites
- L11:435 strongly suppresses
- L11:232 strongly suppresses
- L13:415 strongly suppresses
- L11:235 strongly suppresses
- L13:37 strongly suppresses
- L11:183 strongly excites
- L13:183 strongly suppresses
- L13:87 strongly suppresses
- L13:65 strongly suppresses
- L12:263 strongly excites
- L13:117 excites
- L13:256 suppresses
- L12:323 excites
- L11:284 suppresses
- L13:343 suppresses
- L13:219 suppresses
- L12:209 excites
- L12:338 suppresses
- L13:253 suppresses
- L12:121 excites
- L11:2429 excites
- L13:177 suppresses
Feeds later layers
- L17:826 excites
- L15:2313 suppresses
- L15:1627 excites
- L17:2271 suppresses
- L15:431 suppresses
- L15:538 excites
- L16:2114 suppresses
- L15:1251 excites
- L16:1116 excites
- L17:748 suppresses
- L16:596 suppresses
- L15:453 suppresses
- L16:851 excites
- L16:870 excites
- L15:375 suppresses
- L15:1076 suppresses
- L15:1071 excites
- L18:214 suppresses end of document marker
- L15:472 suppresses
- L16:1874 excites
- L15:1186 suppresses
- L16:1974 excites
- L17:614 suppresses
- L16:1187 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ponsible
- ista
- naire
- Powered
- 骄傲
- 的背后
- ่น
- lijk
- 四级
- 中新
Suppresses
- ieg
- еры
- ете
- AML
- amel
- cá
- emas
- flen
- amus
- ums