unclear: mixed, mostly math and instructions
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 8 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
The strongest examples are weak and scattered, across geometry, folding paper, decision trees and graph theory, with no obvious shared thing. Negative examples are also weak. The pattern is not clear enough to name confidently.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
. Part A: Short Answer (1 problems, 12 points). 1. Let S and T be linear spaces and A : S T be a linear map. Say V and W are particular solutions of the equations A V = Y
-
paper they like. Here’s the easiest way I know.⏎- Choose any piece of paper.⏎- Fold the paper in half.⏎- Starting and ending at the fold, make the first stroke of the number 2.⏎- Cut along the line
-
circle and. . . .⏎X is a moveable point on the hypotenuse, and P and Q are the feet⏎of the perpendiculars from X to the sides of a right angled⏎triangle. What position of X makes the length
-
an even 90 degree piece, this will be very easy. Draw 3 circles from the midpoint of the existing circles(From the left circle go up until it is parallel with the other circle, draw the new cirles from there)
-
are the lines that never intersect and perpendicular lines are the lines that intersect at 90 degrees.⏎Answer: Lines with the same slope are parallel and if the slope of one line is the negative reciprocal of the second line, then they are perpendicular
-
equal.⏎Label this plum tree graph to make it totally magic!⏎A graph is a set of vertices (or nodes), together with a set of edges (or arcs).⏎Look at
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the amount of time that I have been thinking about this, the amount of time that I have been thinking about this... So this is a problem of optimization, or a problem of... So this is a problem of... So this is a
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
present in the data . There are many deep learning techniques currently used in various applications. These include auto-encoders, stacked auto-encoders, restricted Boltzmann machines (RBM), deep belief networks (DBN) and deep convolution
-
we detect circadian cellular change that is indicative of cancer, and do not rely on specular reflective capabilities of varying tissue densities to make our diagnosis. Our historic false negative result of 17.<|endoftext|>Native Animals of the Thar Desert⏎The
-
1, 86. Our estimates predicts 32 members of this sequence starting from 6. In fact, the sequence has 30 conjectured members. Similarly, our estimate predicts 2.5 members starting from 86
-
her hypothesis will fail.⏎If the hypothesis is able to withstand 100 or 1000 experiments, then the hypothesis has high probability of being true. But if hypothesis failed in most or all of the 100 or
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:1315 weakly suppresses 'of' after nouns like 'variation' and 'section'
- L5:221 weakly suppresses
- L0:3037 weakly excites
- L1:2688 weakly suppresses
- L6:85 weakly excites
- L7:2142 weakly excites
- L6:838 weakly excites
- L6:2246 weakly excites
- L6:2348 weakly excites
- L5:3022 weakly suppresses
- L4:1741 weakly excites
- L7:140 weakly excites
- L2:771 weakly excites
- L6:1569 weakly suppresses
- L3:91 weakly excites
- L5:2080 weakly suppresses
- L3:1103 weakly excites
- L7:336 weakly suppresses
- L7:316 weakly suppresses
- L6:587 weakly suppresses
- L0:1523 weakly excites
- L1:1131 weakly excites
- L7:60 weakly suppresses
- L1:2375 weakly suppresses
Feeds later layers
- L10:1431 suppresses
- L10:1102 suppresses
- L10:2561 weakly suppresses
- L10:1299 weakly excites
- L15:188 weakly suppresses
- L13:1935 weakly suppresses
- L9:420 weakly suppresses
- L16:1478 weakly suppresses unclear: verbs and prepositions in news prose
- L11:1133 weakly suppresses
- L9:637 weakly excites
- L9:634 weakly suppresses
- L11:924 weakly excites
- L12:1962 weakly suppresses
- L14:2747 weakly suppresses
- L13:1137 weakly excites
- L9:855 weakly excites
- L9:823 weakly excites
- L11:1157 weakly excites
- L12:843 weakly suppresses
- L9:1869 weakly excites
- L19:2703 weakly excites
- L15:1275 weakly suppresses
- L10:1931 weakly excites
- L10:396 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- "</
- ]] ⏎
- ">{{
- (",
- stin
- (sorted
- orted
- "]; ⏎
- 족
- ]</
Suppresses
- Nhi
- hydrate
- -loading
- .loading
- tượng
- ucking
- 为你
- ripple
- =DB
- loading