opening parenthesis after a noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to an opening bracket that comes right after a word, usually to add a short alternative, abbreviation or number, like 'child(ren)' or 'National Weather Service (NWS)'. Turning it up made the model's writing repetitive and loopy, with no clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
of the Guardian ad Litem is to investigate the facts of the case for the Judge and report back to the Court – to talk with both parents, the child(ren) and other important witnesses in the case. The types of case where Guardian
-
the use of English and official language in the content classrooms, typically mathematics and science. According to Cummins, bilingual education is defined as “the used of two (or more) language of instruction at some point in a student’s school career”
-
ments: layers of accident-containing steel and concrete.⏎One of fission’s byproduct is heat. (Another byproduct may be gamma rays.) The heat boils (clean) water, producing steam, which turns a turbine and produces electricity. If
-
The real beauty of this method is<|endoftext|>In a divorce or other family law case, if the Judge finds that it is in the best interests of the minor child(ren) in the case, the Judge can appoint a “Guardian ad L
-
, heroes, and villains that ascribe meaning to history and purpose to current events. These are found location to location.⏎In his dissertation research, Matthews saw twelve (12) moderating variables emerge from metanarrative.
-
done to relieve the shortness of breath that a large pleural effusion can cause.⏎Normally the pleural cavity contains less than 20 milliliters (4 teaspoons) of clear, yellowish (
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: it's a new idea that I have not seen in a lot of people. It might be a very simple and simple to solve, but I don't know. I don that. I don't know. I'm not sure. I
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
change the look of Kentucky gardens for years to come, said Nicole Ward Gauthier, extension plant pathologist for the University of Kentucky College of Agriculture, Food and Environment.⏎Impatiens downy mildew was first reported in the state in
-
spirit and the letter of the law, recognise a legal problem and understand whether expert advice is required.⏎Who can advise me further?⏎The Department for Culture, Media and Sport has produced Guidance to help people understand the Dealing in Cultural Objects (
-
, the Ministry of Environment, Forest and Climate Change has come up with the first draft of the amendments to the Indian Forest
-
ian Hilfrich; Senior Lecturer in American History and Robert Mason, Professor of Twentieth-Century U.S. History from School of History, Classics and Archaeology. You can sign up for this free course here: The Making of
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L14:2276 excites opening bracket after a term or number
- L4:493 excites
- L14:915 suppresses
- L14:730 suppresses
- L14:1073 excites
- L7:1310 excites
- L7:2976 suppresses
- L14:1924 weakly suppresses
- L13:2918 weakly suppresses
- L14:3 weakly excites
- L10:899 weakly excites
- L13:1942 weakly suppresses
- L14:500 weakly suppresses
- L14:2002 weakly suppresses
- L9:2547 weakly excites
- L10:1654 weakly excites opening parenthesis before an acronym
- L9:2019 weakly suppresses
- L11:558 weakly excites
- L13:1126 weakly excites
- L14:470 weakly excites
- L13:1770 weakly suppresses
- L6:924 weakly excites
- L11:1743 weakly excites parenthesis after prophet or Allah names
- L4:1142 weakly suppresses
Feeds later layers
- L16:665 suppresses
- L19:224 excites
- L16:480 suppresses
- L17:324 weakly excites
- L20:1380 weakly suppresses end of citations and titles
- L17:566 weakly excites
- L22:451 weakly suppresses 'to' before a verb of purpose
- L22:595 weakly suppresses the word 'number' after 'the'
- L24:2742 weakly suppresses
- L22:2530 weakly suppresses
- L17:582 weakly suppresses
- L22:1913 weakly suppresses
- L17:2093 weakly suppresses
- L16:450 weakly suppresses
- L24:293 weakly suppresses
- L16:337 weakly excites
- L16:1258 weakly excites
- L17:1612 weakly excites
- L16:627 weakly excites
- L19:1530 weakly excites
- L17:2286 weakly suppresses
- L16:743 weakly suppresses
- L24:336 weakly excites
- L16:2249 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 太过
- ipsis
- 城镇
- خفض
- enko
- 帆
- -chan
- -san
- foon
- illin
Suppresses
- prise
- orners
- ass
- tempt
- berg
- atest
- 有个
- 率为
- ulated
- tổng