abbreviation pieces in organisation names
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the short letters that make up an abbreviation or acronym, such as 'UK' in 'UK HFCA', 'US' in 'USDA' or 'Y' in 'YCDC', and on the start of 'fracking'. It goes negative on words inside country names like 'United States'. Turning it up produced loose text about kids and groups, so the steering does not clearly confirm this.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
fuel cell car fleet may hit top gear within five years, but only if there is enough investment in filling stations, the UK Hydrogen and Fuel Cells Association (UK HFCA) told Reuters on Friday.⏎Fuel cells convert hydrogen into electricity, with
-
certainly far more gas available than most thought possible just a few years ago. The development of hydraulic fracturing (‘fracking’) has raised US gas production dramatically, and helped double the estimated global gas
-
innovative programming such as the Family Innovative Supportive Housing (FISH) Program. A collaborative effort between the Children's Home of York, Y Community Development Corporation (YCDC), and the York County Office of Children, Youth, and Families (OC
-
in the United States has surged dramatically—thanks largely to technological advances such as high-volume hydraulic fracturing, more commonly known as “fracking.” This rapid increase has generated widespread debate, with proponents touting economic and
-
first petitioned to be listed under the Endangered Species Act (ESA) in 1995, and the U.S. Fish and Wildlife Service (USFWS) completed a 90-Day Finding of no warranted action in response
-
samples were first washed or peeled prior to being tested so the rankings reflect the amounts of the crop chemicals likely present on the food when is it eaten.⏎The USDA and FDA tests have produced hard evidence of widespread presence of pesticide residues on conventional crops.
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the United Kingdom, the United Kingdom, the United Kingdom, the United Kingdom, the United Kingdom, the United Kingdom, the United Kingdom, the United Kingdom, the United Kingdom, the United Kingdom, the United Kingdom, the United Kingdom,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
osin. All of these new methods will have important applications for<|endoftext|>Synthetic cannabinoid use and related emergency department (ED) visits are skyrocketing in the United States. Here
-
<|endoftext|>National Conservative Political Action Committee⏎The National Conservative Political Action Committee (NCPAC; pronounced "nick-pack") was a New Right political action committee in the United States that was a major contributor to the ascendancy of
-
,1940) was an Irish American Jazz Age novelist and short story writer, who is generally regarded as one of the greatest American writers of the Twentieth Century. Fitzgerald's The Great Gatsby was perhaps the great American twentieth century novel
-
Great American Novel" is the concept of a novel that is distinguished in both craft and theme as being the most accurate representation of the spirit of the age in the United States at the time of its writing or in the time it is set. It
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L16:679 suppresses
- L14:698 suppresses
- L18:95 suppresses end of a document marker
- L18:2644 excites
- L13:1155 suppresses
- L16:715 excites
- L16:2181 weakly excites
- L18:1545 weakly excites
- L15:1576 weakly suppresses
- L15:10 weakly suppresses
- L18:1846 weakly suppresses
- L6:2599 weakly excites
- L16:1426 weakly excites
- L14:990 weakly suppresses
- L13:1800 weakly suppresses
- L0:378 weakly suppresses
- L8:1610 weakly suppresses
- L3:1202 weakly suppresses
- L17:868 weakly suppresses
- L12:1065 weakly excites
- L18:395 weakly excites
- L7:1537 weakly suppresses
- L16:676 weakly excites
- L4:1236 weakly excites
Feeds later layers
- L25:652 strongly excites
- L21:144 suppresses
- L27:129 excites
- L20:1338 suppresses
- L20:824 excites unclear: opposite pairs and citation digits
- L26:394 excites
- L20:1080 excites opening paren before an acronym
- L27:134 excites
- L21:111 excites
- L23:957 excites
- L21:837 excites
- L21:1291 excites
- L27:115 suppresses
- L25:446 excites
- L23:404 excites
- L26:291 excites
- L25:1685 excites
- L21:26 excites
- L27:680 excites
- L20:304 suppresses
- L26:1309 excites
- L24:142 weakly excites
- L25:1105 weakly excites
- L27:216 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- kids
- kid
- 债
- devs
- meds
- kids
- 's
- algo
- said
- says
Suppresses
- ParameterValue
- 中华民族
- HeaderComponent
- (environment
- 科学技术
- 中国人民
- Pathfinder
- removeObject
- _information
- photographic