opening bracket before an acronym
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 24 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the opening bracket or first letters just before a short abbreviation is spelled out, such as the "(" in "deep belief networks (DBN)" or "Rural Fire Service (RFS)". When it was turned up, the model's writing became unrelated and rambling, so the steering shows no clear effect.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
So, for a language to be type safe, we have to provide another alternative to the CTS, which is the Common Language Specification.⏎- Common Language Specifications (CLS):⏎CLS is a set of rules that describes, in detail, the minimal
-
colour of the mineral using crossed polars).⏎Minerals have different characteristics using the different types of light – plain polarised (PPL) and cross polarised (XPL) . As an example, in a Cornubian granite, the
-
ratified later in 1865, began<|endoftext|>In late December, at the very peak of our region’s fire emergency, somebody rang our Rural Fire Service (RFS) headquarters and complained: ‘Why haven’t you put the fires out
-
innovative programming such as the Family Innovative Supportive Housing (FISH) Program. A collaborative effort between the Children's Home of York, Y Community Development Corporation (YCDC), and the York County Office of Children, Youth, and Families (OC
-
.⏎As reported by Overclock3D; the study results are based on the widely accepted Greenhouse Gas Protocol [GHGP] established by the World Resources Institute [WRI] and World Business Council for Sustainable Development [WBCSD and were
-
fuel cell car fleet may hit top gear within five years, but only if there is enough investment in filling stations, the UK Hydrogen and Fuel Cells Association (UK HFCA) told Reuters on Friday.⏎Fuel cells convert hydrogen into electricity, with
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: how to use the properties of real or virtual characters (e.g., character loop loops or character loops) vertically horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally horizontally
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
MS, SD, WI, WV, and, VT). Roughly a third of Hispanic women were poor in six states (IN, MS, NC, PA, RI, TN).⏎Yet again, these numbers underscore the importance of federal and state
-
University of Otago’s Department of Psychology, they performed this feat by tracking the statistical likelihood that “bigrams,” letter pairs such as “EN” and “AL,” were more likely associated with words or non-
-
Live kids. Need I say more?<|endoftext|>New life breathed new life into Woodford County’s historic African-American community⏎WOODFORD COUNTY, Ky. (WKYT) – Ten years after the last resident left a historic African American community in
-
;⏎P0 = 0xB0;⏎P0 = 0x99;⏎P0 = 0x92;⏎P0 = 0x82;⏎P0 = 0xF8;⏎P0 = 0
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L21:496 strongly excites
- L22:1393 suppresses
- L23:404 suppresses
- L19:1778 excites
- L21:732 suppresses
- L18:2520 excites
- L23:326 excites
- L23:672 excites
- L20:2327 suppresses
- L22:839 excites
- L21:1594 excites
- L21:306 excites
- L23:383 suppresses
- L20:1338 excites
- L19:1781 weakly suppresses
- L20:1675 weakly suppresses
- L17:2755 weakly suppresses
- L20:2727 weakly suppresses
- L20:680 weakly suppresses
- L21:1355 weakly suppresses
- L19:2045 weakly excites abbreviation pieces in organisation names
- L19:1011 weakly excites
- L22:1705 weakly excites
- L19:761 weakly suppresses
Feeds later layers
- L27:340 excites parenthesis introducing an acronym
- L26:257 excites
- L27:830 excites
- L26:1756 suppresses
- L26:45 suppresses
- L26:1235 excites opening parenthesis before an acronym
- L25:1105 suppresses
- L27:1072 excites
- L26:380 weakly excites
- L27:229 weakly suppresses
- L27:1009 weakly excites opening parenthesis before an acronym
- L26:293 weakly excites
- L25:522 weakly excites
- L27:1781 weakly excites
- L27:1059 weakly excites
- L27:1210 weakly suppresses
- L25:354 weakly suppresses
- L26:219 weakly suppresses
- L25:687 weakly excites
- L25:2623 weakly suppresses
- L25:673 weakly suppresses
- L27:412 weakly suppresses
- L26:2162 weakly suppresses
- L27:1453 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- lando
- eur
- abc
- salsa
- ddd
- ccc
- XYZ
- efe
- ronics
- ABC
Suppresses
- horizontally
- YM
- YL
- YT
- ys
- orrow
- YT
- DS
- getObject
- antage