the digit 0 in dates
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 4 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on a zero that appears in the day part of a date, such as "November 01" or "June 05," where the number starts with a zero. It is quiet on most other numbers. Turning it up did not give a clear, readable change in the model's output.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
See the Discussion Board Guidelines and Rubrics⏎Download Discussion Board Guidelines and Rubrics.⏎Reh, F. J. (2018, November 01). Here Is a Look at the Role and Responsibilities of Today's Manager.
-
it can pass in a flash if you don't have a method for attacking it.<|endoftext|>304 North Cardinal St.⏎Dorchester Center, MA 02124⏎When you’re manually operating a boat, the act of
-
⏎July 08, 2009 |<|endoftext|>Computer Science Concentration for Students Mat
-
ERS; ENVIRONMENT CLUSTERS; OTHER FACTORS. I. Identification. 1. The Issue The …⏎BONN, Germany (June 05, 2014) – Programs and policies to reduce tropical def
-
'd love to try it and maybe you would like to do it too!⏎Winter Olympics | Pocantico Hills School⏎This page was last edited December 02, 2005.⏎e-mail us at:<|endoftext|>Courtesy ESA
-
the Gates Foundation’s Measures of Effective Teaching (MET) project outlines the most important findings on research-based evaluation systems.⏎Teacher Evaluation 2.0⏎October 05, 2010⏎Teacher evaluations need serious fixing. Here’s
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "The sum of the following is true: "If the sum is true. The statement is true. The statement is true." (A) The correct answer is: "If the sum is true. (B) The correct answer is
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
graphing. It is an art type of symbolizing any information that may be plotted on a graph in a way that permits the reader to interpret it and draw conclusions from it. There are a couple of ways
-
for his narrative by offering a sound that insinuates the struggles of the slaves’ physical labor.⏎For example, the droning
-
, and she does not know what he is talking about - "Is the king dead?" she asks. She seems to be totally unaware that Hamlet is insinuating that Claudius has killed his father, and Gertrude's former husband
-
of disease on the individual and the family. Some suggestions to the departments of community medicine on organizing family studies are also provided.⏎Conclusion. Availability of a systematic and comprehensive approach would improve students’ understanding of the social
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:651 excites zero in dates inside URLs
- L0:208 excites the digit zero inside codes or numbers
- L1:1821 weakly excites
- L3:106 weakly suppresses
- L3:2464 weakly suppresses
- L3:897 weakly excites
- L3:187 weakly excites
- L3:501 weakly suppresses
- L3:91 weakly excites
- L3:122 weakly excites
- L3:160 weakly suppresses
- L2:864 weakly excites
- L3:5 weakly suppresses
- L2:2917 weakly suppresses unclear: 'ardu' and 'axi' word fragments
- L3:66 weakly suppresses
- L3:133 weakly excites
- L3:271 weakly suppresses
- L2:3007 weakly suppresses
- L2:524 weakly excites
- L3:1210 weakly excites
- L1:1069 weakly suppresses
- L2:2107 weakly excites
- L1:2622 weakly suppresses
- L3:1488 weakly excites
Feeds later layers
- L8:3030 suppresses
- L9:1477 suppresses
- L12:1933 excites
- L10:1257 weakly suppresses
- L5:1043 weakly suppresses
- L5:95 weakly suppresses
- L7:1960 weakly excites
- L8:2334 weakly suppresses
- L7:1026 weakly excites
- L10:1188 weakly suppresses
- L21:2612 weakly suppresses
- L5:1004 weakly suppresses
- L8:2429 weakly suppresses
- L12:427 weakly excites
- L9:1578 weakly suppresses
- L5:2942 weakly excites
- L5:1979 weakly suppresses
- L11:496 weakly suppresses
- L16:2416 weakly suppresses
- L7:1925 weakly excites
- L23:294 weakly suppresses
- L12:2517 weakly suppresses verbs of finding out or thinking
- L15:326 weakly excites
- L10:2430 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Eff
- tan
- 教
- only
- even
- probe
- nte
- '
- (entries
- entries
Suppresses
- 合理的
- avourite
- losures
- @return
- AllWindows
- -back
- oggle
- borrow
- скоп
- ABL