spot right before a quantity
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the empty spot just before a quantity, especially after words like 'about' or 'exceed', as in 'about [blank] 1,500 cycles'. Turned up, the model's text got loose and listy, with no clear link to the trigger.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
They don't degrade quickly over time, even after being recharged 30,000 times. Conversely, lithium-ion batteries suffer in performance after about 1,500 charging cycles
-
level of concern such that no additional data requirements to protect bees are triggered.⏎EPA is also prohibiting application if wind speeds exceed 10 mph and requiring a 12-foot on-field buffer on the down
-
ovicic, that marks the boundary between the bottom of the crust and the top of the mantle.⏎In the Sierra Nevada, the Moho is usually located about 35 kilometers beneath Earth's surface. But when researchers looked at the western footh
-
Accreted matter is usually hydrogen rich. It forms the outer envelope of a neutron star, which contains a hydrogen burning shell, with an energy release of about 5 MeV/nucleon in a stable burning. Helium ashes from hydrogen
-
high pH value (10 to 14), which can be quite caustic. The use of acidic products with a low pH value (0 to 6) can produce the same outcome; levels on either side can be caust
-
) is the same.⏎- To this day we follow the model that Galileo created.⏎ag = g = 9.81m/s2⏎ag = g = acceleration due to gravity
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: on the one of the two add-ons of a new one- from the point of view of the onomology on the bird, onomololonomolon from the bird's bird of a bird's bird of a bird
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
a shortcut of DOSBox-0.74⏎You can paste your application path which you want to run using Run
-
Ministry of Education, aimed at helping teachers in their use of social media and other forms of electronic communication.⏎Working in conjunction with BeSmartOnline!,
-
SP) environment, marrying XML data to Java-based services and applications is easier than ever before. The September 17 release of the JavaServer Pages 1.2 specification (⏎- The new specification includes better mechanisms for accessing and describing XML data
-
.Tables ' Get a specific table by name. Dim table As DataTable = tablesCollection("Suppliers") Console.WriteLine(table.TableName) End Sub⏎Available since 1.1<|endoftext|>A musical trip through the 60’s featuring the songs of Simon
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L7:92 excites
- L18:233 suppresses
- L15:184 weakly excites
- L9:46 weakly suppresses
- L21:121 weakly suppresses
- L3:130 weakly excites
- L4:267 weakly excites
- L5:1051 weakly excites
- L9:207 weakly suppresses
- L15:779 weakly suppresses
- L2:24 weakly suppresses
- L13:2186 weakly excites
- L9:2581 weakly excites
- L13:2861 weakly excites
- L17:2055 weakly suppresses
- L18:2313 weakly suppresses
- L11:223 weakly excites
- L1:2687 weakly suppresses
- L21:525 weakly excites
- L7:72 weakly excites
- L6:2071 weakly suppresses
- L19:198 weakly suppresses
- L7:1645 weakly excites
- L17:1401 weakly excites
Feeds later layers
- L24:452 weakly excites
- L23:1877 weakly excites
- L27:368 weakly suppresses
- L27:2529 weakly suppresses
- L24:561 weakly suppresses
- L24:1839 weakly excites
- L24:1652 weakly suppresses
- L23:2387 weakly excites
- L25:2392 weakly excites
- L26:1021 weakly suppresses
- L24:2405 weakly suppresses
- L27:1649 weakly excites
- L24:1896 weakly excites
- L24:3037 weakly suppresses
- L23:784 weakly excites
- L26:2129 weakly suppresses
- L25:873 weakly excites
- L25:395 weakly excites
- L23:2444 weakly suppresses
- L24:1985 weakly suppresses
- L27:1972 weakly suppresses
- L24:1915 weakly excites 'in' after a noun phrase
- L23:854 weakly excites
- L24:2940 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- жи
- supper
- UND
- AGER
- /Branch
- ngth
- лин
- spa
- toHave
- hardt
Suppresses
- ólica
- ellular
- olis
- êm
- arbonate
- vessel
- Bulls
- {(
- ores
- 模