numbers and offsets in formulas and code
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on numbers and index positions inside maths formulas and code, like the 0 in 'multiply by 100' or the bracket in 'len(array)'. Turning it up did not produce anything clearly about numbers.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
’s try this with a while loop:⏎given_arr = [1, 2, 3, 4, 5] i = len(given_arr) - 1 while(i >= 0): print(given_arr[i]) i
-
case of a number, you can use the following formulas: 1350pc, x, or %. Then, multiply the result by 100 to get the percent. This method is also useful for finding the exact value of
-
ways. Arranging eight different tiems in a line can be done in 8×7×6×5×4×3×2×1 ways,
-
to know its total mark. In order to find this, use basic arithmetic. Divide the mark by the highest possible mark and multiply the answer by 100 to get the percent. Alternatively, you can try using
-
If we want to iterate an array in reverse order, we need to create a sequence for the for loop using range with:⏎- start as length of the array - 1⏎- stop as -<|endoftext|>12 April 1953
-
1991-1995⏎The materials in this archive are copyright © The Manitoba Library Association. Reproduction for personal use is permitted only if this copyright notice is maintained. Any other reproduction is prohibited without permission Copyright information for reviewers
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the story of a boy who is a dragon, as a dragon in the sky, where he has a sword and with his dragon's eyes, and he is a dragon in the next day, he saw the same dragon, and he was
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
6,000-lb load would use the following calculation:⏎[(4,000 lbs + 6,000 lbs) × 1.25] ÷ 4 = 3,125 lbs
-
ance for product A is (90,000 – 100,000) *
-
of capital, or they will invest elsewhere.⏎The following is the WACC calculation formula:⏎WACC = E/V × Re + D/V × Rd × (1 - Tc)⏎Re = cost of equity⏎Rd = cost of debt
-
. So to solve the second part, on average, we need to find five correct answers per four tests. Is it true that a(5) ≤ 4? If so, can we use it to show that a(30)
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:2381 weakly suppresses
- L11:283 weakly excites
- L12:726 weakly suppresses
- L6:1366 weakly excites
- L12:535 weakly suppresses
- L9:1901 weakly excites
- L7:1868 weakly suppresses
- L10:2812 weakly excites
- L12:2676 weakly excites
- L11:1165 weakly suppresses
- L8:91 weakly suppresses
- L0:2724 weakly excites
- L10:1772 weakly excites
- L12:2018 weakly suppresses
- L10:1164 weakly excites
- L10:1954 weakly excites
- L12:2408 weakly excites
- L7:1706 weakly suppresses
- L1:934 weakly excites
- L12:277 weakly excites
- L13:2922 weakly excites
- L4:67 weakly excites
- L7:2494 weakly excites
- L2:1292 weakly excites
Feeds later layers
- L21:2682 weakly suppresses
- L22:2000 weakly excites
- L15:2128 weakly suppresses
- L15:2837 weakly suppresses
- L17:3070 weakly suppresses
- L20:1509 weakly suppresses
- L22:2380 weakly excites
- L16:2429 weakly suppresses
- L22:2367 weakly suppresses
- L15:2069 weakly suppresses
- L18:3038 weakly suppresses
- L19:2904 weakly excites
- L22:934 weakly suppresses
- L15:1903 weakly suppresses
- L25:1229 weakly excites
- L18:1015 weakly suppresses
- L20:2377 weakly suppresses
- L21:2503 weakly suppresses
- L22:1192 weakly suppresses
- L26:2446 weakly suppresses
- L24:750 weakly suppresses
- L24:1029 weakly suppresses
- L19:2692 weakly suppresses
- L17:2956 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 技术研发
- azzo
- _INITIALIZER
- achts
- urette
- assertNull
- ernity
- uninitialized
- 技术人员
- lé
Suppresses
- 心
- faces
- comprehension
- 笑脸
- 诉
- 入
- lãnh
- mural
- Cour
- rulings