opening bracket that adds a synonym
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the opening bracket in phrases that add an explanation or another name, such as "motor fuel (or gas)" or "kefir (fermented milk)." Turning it up or down changed the model's writing in ways that did not seem to relate to brackets.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
falling prey to malware — including spyware — is by adhering to several best practices: Install a software or hardware firewall that can detect and selectively block incoming traffic (such as attacks from hackers via your broadband connection to the Internet) and outgoing traffic
-
this acceleration in prices. We divide the “basket” of goods and services that make up the CPI into twenty-three items—such as medical care, motor fuel (or gas), apparel, education, and rent—and examine the change in each item
-
, usually aged 40 or older, experiences any of these symptoms on a regular (usually daily) basis: eyes that feel dry, moist or watery (yes, Dry Eye Syndrome can sometimes result in eyes that overflow with tears); eyes
-
the best available top probiotic foods.⏎Probiotic Drinks List⏎Probiotic drinks include:-⏎– kefir (fermented milk)⏎– water kefir (fermented fruit juice / sugar water
-
for its defense.⏎As nuclear policy evolved during the Eisenhower Administration, three factors combined to produce a new American reliance on nuclear weapons: pressure to control the federal budget (the “bigger bang” argument); competition as each branch of the American military
-
fun—and tasty!—way to make the parts of the cell more concrete for students is to create edible cells. Using materials such as Jell-O® (to represent cytoplasm) and sprinkles (to represent ribosomes) will not
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the first time I saw the movie, the story is about a person's dream, the hope that the person has been dreaming about, the hope that the person has been dreaming about, the hope that the person will achieve that dream, the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
ranged from 26 to 48 feet (8 to 14.7 meters), and they were between 8 and 16 feet (2.5 and 5 m) wide.⏎The other two ships the researchers examined
-
or plants that has characteristics of both parents; hybrid.⏎- A mule is a cross between a horse and a donkey.⏎part of speech: verb⏎inflections: crosses
-
to 12 feet (0.61 m to 3.66 m) in width, and 8 feet to 12 feet (2.44 m to 3.66 m) in height. These
-
and safety.⏎What is a Risk Assessment?⏎A risk assessment is a very thorough examination of a job, process or task within the workplace, in order to determine what potential risks might occur within that environment. Its intention is to discover any potential causes
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L15:389 excites
- L16:1646 excites
- L15:2000 excites
- L16:2384 excites
- L16:2665 excites
- L16:1977 excites
- L14:1076 excites
- L15:2056 suppresses
- L16:2247 suppresses
- L16:521 excites
- L14:393 excites
- L16:717 suppresses
- L16:826 suppresses
- L16:2251 excites
- L16:2327 excites
- L16:2200 suppresses
- L16:2880 suppresses
- L16:2021 suppresses
- L16:2457 excites
- L15:1783 suppresses
- L15:816 excites
- L15:3020 suppresses
- L15:2190 excites
- L15:2277 suppresses
Feeds later layers
- L18:2118 strongly suppresses
- L20:610 strongly suppresses
- L18:1403 strongly suppresses
- L18:2838 suppresses
- L19:1605 suppresses
- L20:156 suppresses
- L19:1089 suppresses
- L20:1083 suppresses
- L19:867 suppresses
- L20:460 excites
- L19:980 excites
- L19:1820 suppresses
- L18:1179 excites
- L19:2057 suppresses
- L21:739 suppresses 'both X and Y' pairing words
- L21:301 excites
- L18:593 excites
- L18:1965 suppresses
- L18:2663 suppresses comma ending a clause before an action
- L19:1369 suppresses
- L19:210 excites
- L20:1312 suppresses
- L18:670 excites
- L19:1262 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- */⏎⏎
- »⏎⏎
- -elect
- ''⏎
- ночь
- ándose
- 」⏎⏎
- mell
- '''⏎⏎
- allocating
Suppresses
- ;
- <|endoftext|>
- ;⏎⏎⏎
- ;⏎⏎⏎⏎
- ; ⏎
- ;⏎
- ;
- ; ⏎
- \Persistence
- , ⏎