unclear: weak "and" in lists
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron barely responds. Its strongest hits are weak and mostly fall on "and" in lists of names or items, plus a stray "vier" in Elsevier. Turning it up or down produced nothing readable.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
monitor the trends in NCD prevalence, their risk factors, and treatments.⏎Copyright © 2020 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.<|endoftext|>We all grew up hearing the phrase, “
-
be difficult for you to envision, but at one time a unified story of humankind — the grand narrative — dominated how people thought of the past, present, and future. The grand narrative refers to the overarching, all-encompassing story of
-
eo. After nearly 1000 years of rule, Silla fragmented into the brief Later Three Kingdoms, Silla, Hubaekje, and Hugoguryeo, handing over power to its successor dynasty Goryeo
-
including literacy and numeracy) and social-emotional development.⏎Fundamental to the Framework is a view of children’s lives as characterised by belonging, being and becoming.⏎Belonging is the basis for living a fulfilling life. Children feel
-
throughout life – from childhood through adulthood. Just as getting older brings changes in career, family and activity goals, it also brings physiological changes that may affect how much and what kind of protein is needed to achieve goals for a healthy, active lifestyle.⏎
-
, enlightenment and passing away of Lord Buddha over 25 centuries ago.⏎Among the tribals in northeast India, Chakma, Mog, Uchoi and Barua tribes follow Buddhism.⏎"Lord Buddha made humanity his religion. This has
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been thinking about lately: I have been thinking about lately: I have been thinking about lately: I have been thinking about lately: I have been thinking about lately: I have been thinking about lately: I have been thinking about lately
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
left is both a __________________ and __________________.⏎Your brain also solves mysteries in language. Imagine you find the cryptic note to the right on a food container. Good thing your brain needs only the first and last letter of a word to be in the
-
highest counts). Eliminate the other majors. Use ANOVA – single factor in Excel’s Data Analysis ToolPak to test whether there is a relationship between the two variables. Use an alpha of
-
events were reported and the ketamine injections were well tolerated by the study participants, the study authors said that more research on complex pain syndromes, particularly CRPS/RSD in adolescents
-
erticulitis. At the end of the day, as much as you may love your coffee, coffee and Diverticulitis are not a match made in heaven. Drinking coffee can trigger a worsening of symptoms of Diverticul
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:59 excites
- L4:23 excites
- L3:50 excites
- L4:19 suppresses
- L3:115 suppresses
- L3:691 excites
- L3:421 suppresses
- L4:229 excites
- L1:1464 excites
- L1:2683 excites
- L4:245 excites
- L4:12 suppresses
- L3:456 suppresses
- L1:1973 suppresses
- L3:187 excites
- L1:951 excites
- L1:92 excites
- L4:85 suppresses
- L4:120 suppresses
- L4:21 excites
- L4:804 suppresses
- L1:1099 excites
- L0:1301 suppresses
- L1:2801 excites
Feeds later layers
- L7:1 strongly suppresses
- L11:4 suppresses
- L7:0 suppresses
- L14:6 suppresses
- L16:182 suppresses
- L11:41 suppresses
- L16:166 suppresses
- L14:25 suppresses
- L6:18 excites
- L14:21 suppresses
- L16:203 suppresses
- L14:12 suppresses
- L14:14 suppresses
- L14:19 suppresses
- L16:213 suppresses
- L16:201 suppresses
- L16:165 suppresses
- L6:2 excites
- L14:45 suppresses
- L12:130 suppresses
- L6:12 excites
- L7:136 excites
- L15:780 suppresses
- L7:12 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- WebpackPlugin
- 真皮
- :<?
- 对她
- ochrome
- 麻痹
- чь
- iT
- thôi
- Crom
Suppresses
- -
- andon
- Gordon
- orado
- -action
- First
- -for
- unt
- \\