opening parenthesis after a term
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron wakes up on an opening bracket that comes right after a name or term, where the text is about to give a short form or another name for it, such as "International Monetary Fund (IMF)". Turning it up did not produce a clear change in what the model wrote.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Financial Protection Bureau (CFPB) released a study reviewing financial education research priorities for America’s youth.⏎Congressmen Bill Foster (D-IL) and French Hill (R-AR) both introduced H. Res. 327, which
-
variety of cultivated vegetables and wild greens are eaten as well as bamboo shoots. Meals often are accompanied by lentils, pickled relishes, and balachaung (made from fried dry prawns). There are a variety of
-
the sergeants and corporals were to be named by the captains. Those who participated in these organizations would be exempt from service as couriers and cordilleras (rangers), and their horses would be exempt from seizure for auxiliaries
-
percentile value) were associated with an increased risk of diarrheal disease (incidence rate ratio = 1.39, 95% confidence interval: 1.03, 1.87), but only after a
-
over a period of 15 years (1996 to 2011) with different levels of harvesting intensity, including selective harvesting at low (13.0% removal of growing stock volume), medium (29.
-
a funding source for Greece.⏎On 2 May 2010, the Eurozone countries, European Central Bank (ECB) and International Monetary Fund (IMF), later nicknamed the Tro
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the other side, the other side of the other side, the other side of the other side of the other... and of the of of of of... the of the of of of of of... of of of... of of... of
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
demonstration. It took about 10 minutes to fire up the steam pump to 140 pounds pressure. A cistern buried in the intersection (placed there for fire protection) provided the source of water. Using three hoses at once
-
resemble the wood of Olive trees in the Olea genus. And it should come as little surprise that Olive Ash can be a dead ringer for actual Olive (with the exception of the porous grain structure, which gives its true identity away easily),
-
Centre of Excellence in Quantum Computing.<|endoftext|>In ancient China one’s Zodiac sign was fixed by the position of the planet Jupiter during the year of one’s birth (it takes twelve years for Jupiter to orbit the sun). On this level, Ai Wei
-
cause of equine ulcers. The lifestyle of many horses, which includes confinement, high level competition, high energy diets rather than pasture, contributes to stress (and ulcers). So does any significant change in the horse’s routine or life style
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:2872 strongly suppresses
- L12:2745 excites
- L6:2439 excites
- L14:880 suppresses
- L14:166 excites
- L14:2752 excites
- L11:50 excites
- L10:66 suppresses opening parenthesis after a citation or term
- L12:1807 suppresses
- L0:1978 excites
- L14:1548 suppresses
- L10:1580 excites
- L11:1579 suppresses
- L13:1078 excites
- L14:2066 excites
- L7:419 excites
- L14:43 weakly suppresses
- L11:2689 weakly excites
- L10:242 weakly excites
- L14:1209 weakly excites
- L13:840 weakly excites
- L14:1526 weakly excites
- L9:2259 weakly suppresses
- L13:2609 weakly excites
Feeds later layers
- L17:933 suppresses
- L16:634 weakly excites
- L18:299 weakly suppresses
- L16:882 weakly suppresses
- L17:617 weakly excites
- L19:911 weakly excites
- L16:2250 weakly suppresses
- L18:1403 weakly suppresses
- L18:83 weakly excites
- L16:2251 weakly suppresses
- L16:1977 weakly suppresses
- L21:2393 weakly suppresses
- L22:592 weakly excites
- L18:1174 weakly suppresses
- L19:871 weakly suppresses
- L16:2018 weakly suppresses
- L21:1341 weakly suppresses
- L16:565 weakly excites
- L18:3022 weakly suppresses
- L18:2651 weakly suppresses
- L19:1982 weakly excites
- L16:2048 weakly suppresses
- L19:376 weakly suppresses
- L19:2060 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- --- ⏎
- -Mart
- -Se
- --*/⏎
- 认识到
- -drive
- dı
- ----------- ⏎
- ivery
- -labelledby
Suppresses
- bish
- lore
- yes
- AGIC
- yeah
- lotte
- .ac
- cce
- yog
- YES