requirements, thresholds and standards
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 7 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to words about meeting a requirement or passing a level, such as meet the standards, above 250, at least one, and grade-level standards. Turning it up produced text about counts, conditions and levels, a loose match.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
are checked to verify they meet the required specifications.⏎<|endoftext|>RASPBERRY Pi - LEARNING HOW TO MAKE
-
the German composer<|endoftext|>PANS and PANDAS are clinical diagnosis and based on whether presenting symptoms meet the diagnostic criteria, as set forth by National Institute of Mental Health (NIMH
-
ones in your blood or urine mean that you don’t have enough insulin in your body. You may need to check for ketones when:⏎Your blood sugar is above 250 mg/dL (milligrams per deciliter
-
an operation. Thus, those planning to enter the hospital should consider making sure their vitamin D level is above 30-40 ng/ml.⏎Pneumonia is yet another
-
all students in grades 3 through 11. The test measures student achievement in reading, writing, mathematics, and science based on the state’s grade-level standards. In grades 4, 8 and 10 students take a writing
-
pumping normally.⏎If one of the baby’s parents has a heart defect, the risk is increased. As you attend your prenatal checkups and your doctor monitors the sound and size of your baby’s growth, you will be made aware of any potential
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I have a 5-year-old child, and the child is not in the age range of 1 to 5 years old,. This is the case in a certain scenario, and the scenario is that a family has a different set
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
likly one to⏎pick out is the mice because there are 9 mice and only 5 frogs and⏎4 worms, also to pick out at least one of each you would need to⏎pick out 15 sweets because the first
-
the Students from Student table whose marks is more than Average of all marks.⏎(Select Avg(M<|endoftext|>Euler's Equation and the Physical Reality. =. a) Euler's Equation as a mathematical reality.⏎Euler's identity is
-
old cereal boxes) and then cut out the cards and boards.⏎The Rules: To play, you need to print out the deck of picture cards and at least one board for each player. Each player will also need a dozen or so dried beans
-
als. The quadratic residue Gauss walk exhibits a more complex behavior whose shape is roughly determined by the remainder of modulo 24.⏎Contributed by: Erqian Wang (June 202
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:526 excites
- L6:697 excites
- L6:268 suppresses
- L6:195 suppresses
- L4:361 excites
- L5:1792 excites
- L3:1744 suppresses
- L6:2696 excites
- L6:2125 suppresses
- L6:1398 weakly excites
- L3:2644 weakly suppresses
- L1:779 weakly excites
- L4:433 weakly excites
- L6:695 weakly suppresses
- L6:1433 weakly suppresses
- L6:838 weakly excites
- L6:295 weakly suppresses
- L5:2481 weakly suppresses
- L6:1141 weakly suppresses
- L6:534 weakly excites
- L6:753 weakly suppresses
- L3:1832 weakly excites
- L6:576 weakly excites
- L6:2969 weakly suppresses
Feeds later layers
- L10:2905 suppresses
- L8:882 suppresses
- L10:628 suppresses
- L8:1427 suppresses
- L8:976 suppresses
- L10:263 suppresses
- L8:2378 suppresses
- L9:406 suppresses
- L9:388 suppresses
- L12:649 suppresses
- L10:750 suppresses
- L8:228 suppresses
- L10:1786 weakly suppresses
- L8:2479 weakly suppresses
- L18:2077 weakly excites
- L10:1485 weakly suppresses
- L8:312 weakly suppresses
- L9:840 weakly suppresses
- L10:659 weakly suppresses
- L11:2011 weakly suppresses
- L14:444 weakly excites
- L15:341 weakly excites
- L9:942 weakly suppresses
- L9:712 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- -offs
- partido
- utra
- فو
- ��
- فة
- 递给
- idy
- .freeze
- -off
Suppresses
- 趣味
- hazi
- anax
- [Index
- Logic
- 功劳
- leness
- ologia
- succeeded
- ��