'national' or 'state' as government level
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 10 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the words 'national' and 'state' when they name a level of government or territory, like 'national, state and local'. Turning it up did not make the writing noticeably more about government, so its effect on text is unclear.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
identity and continuity;⏎- R.2: Inscription of the element on the Representative List would contribute to the visibility of intangible cultural heritage at the local, national and international levels and promote respect for cultural diversity and creativity expressed in the variety of
-
of Oklahomas German-born population in 1910 lived in⏎one of three cities: Oklahoma City, El Reno or Enid.⏎At its statehood, Oklahoma was also home to second group generally⏎thought of as German,
-
Bottled water is a safe, healthy, and convenient packaged food product, which is comprehensively regulated at both the federal and state level.⏎Strictly regulated as a packaged food product by the U.S. Food
-
44 adobe building, formal gardens and landscaped grounds. It is a national, state and local landmark, owned and operated by the city as a public museum and historic
-
acore.⏎While computer-assisted irrigation is not new, Spain believes that no other country is as yet organizing it at a national level. So far 200,000 farmers have signed up
-
bar charts showing the projected annual effect of Obama’s tax plan on total personal income taxes, per household disposable income, and total employment, each on the national, state, and district levels. In addition, we generated state maps with color-coded congressional
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have been working on something (I have been doing it) and I am doing something else (I have been doing it), and I have been doing the same thing (I have been doing it) and I have been doing it,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
cannot impede the lawful and constitutional functioning of the State Government," the Bill said.⏎"As the Constitutional Head of the State, the Governor owes a responsibility to the people of the State. It is trite in law that any constitutional authority must perform
-
your doctor if it is the right treatment for your child.<|endoftext|>Driving an embedded car save not just time but it can save lives as well. A microsecond of negligence and divided focus while driving is enough to cause very lethal and fatal consequences.
-
the body from infection. When germs get onto our skin or into a cut or other break in the skin’s surface, they are unable to invade deeper into body tissues due to the acid mantle (pH) of our skin. The lower
-
before his imprisonment, he said that the illumination of the candle “is giving light at the cost of one’s own substance, so that one is consumed in the process. Anyone who wants to comprehend
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L8:1389 suppresses
- L6:1729 suppresses
- L7:2513 suppresses
- L5:2669 excites
- L4:1557 suppresses
- L8:1442 excites
- L5:2029 weakly suppresses
- L6:2148 weakly excites
- L9:435 weakly excites
- L5:1265 weakly excites
- L6:2078 weakly suppresses
- L1:1915 weakly excites
- L2:1642 weakly excites
- L0:1859 weakly excites
- L7:1040 weakly suppresses
- L6:1331 weakly excites
- L6:2000 weakly excites
- L3:2097 weakly excites
- L2:1960 weakly suppresses word endings in health and biology compounds
- L2:1084 weakly excites
- L6:69 weakly suppresses
- L7:1225 weakly excites
- L8:707 weakly suppresses
- L9:1649 weakly excites
Feeds later layers
- L12:1897 excites
- L11:1317 excites
- L13:1435 excites
- L11:1993 excites
- L17:1786 excites
- L12:1835 excites
- L13:2291 excites
- L12:947 excites
- L27:1987 excites
- L12:1345 excites
- L11:1838 excites
- L11:813 weakly suppresses
- L14:2462 weakly suppresses
- L12:1607 weakly excites
- L12:836 weakly suppresses
- L15:2853 weakly excites
- L14:1129 weakly excites
- L25:2122 weakly suppresses
- L13:843 weakly excites
- L12:889 weakly suppresses
- L16:2569 weakly excites
- L14:639 weakly excites
- L13:1875 weakly suppresses
- L13:1937 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- -level
- 区域性
- ropdown
- componentDidUpdate
- averages
- racial
- ]<=
- -local
- -cap
- racial
Suppresses
- 铄
- Brothers
- .ReadFile
- 译
- 听取
- ButtonType
- 这个人
- 那份
- iciary
- 古城