blank spot right before a number
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 22 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the empty spot just before a number, such as the gap in 'less than [blank] 0.01' or 'the level of [blank] 280ppm'. When turned up, the model tended to write numbered lists and bracketed numbers.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
The ocean’s breadth and depth remain the most extensive, unexplored habit.⏎Activity 2 – Freshwater Habitats⏎Freshwater Habitats cover less than 0.01 % of the earth’s
-
79. He completed construction of the Flavian Amphitheatre, better known as the Colosseum, and opened it with ceremonies lasting more than 100 days.⏎What was Tit
-
is now above 400ppm and well above the pre-industrial level of 280ppm.⏎After examining the warming evidence Wadhams identifies a
-
contours are from the ground-water modeling report. Water-level elevation contours were digitized from a map at a scale of 1:250,000. The maps were published at a
-
for all economic activity. Beyond agriculture, water is critical for power generation, mining, industry and the consumer products we rely on every single day. Like the estimated 3000 gallons of water that it takes to make the typical smartphone.⏎
-
their drinking water before consumption as well as their water and sanitation conditions.⏎The researchers found that heavy rainfall events (a 24-hour rainfall total that exceeded the 90th percentile value) were associated with an increased risk of diarrheal
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the value of a table's value for a table with a support table with a support table with a support table... with a support table... for a table that's a support table. The value for the support table's value for the value
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
, ' get its DataSet. Dim thisDataSet As DataSet = CType(DataGrid1.DataSource, DataSet) ' Get the DataTableCollection. Dim tablesCollection As DataTableCollection = thisDataSet.Tables ' Get a specific table by name. Dim table As DataTable =
-
of pressure when the heart is resting between beats.⏎Along with high cholesterol and being overweight or obese, a high blood pressure diagnosis, also known as hypertension (over 130/80), is a major risk factor for heart disease or
-
pressure.⏎If your blood pressure reading is high, you will probably be asked to come back for repeat blood pressure checks. If you have three visits with readings over 140/90 mmHG, you will be diagnosed with high blood
-
decrease your blood pressure through natural methods.⏎Blood pressure is the amount of force your blood pushes against the walls of your blood vessels. A healthy blood pressure is below 120/80.⏎Systolic blood pressure, the top number
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:24 suppresses
- L10:370 suppresses
- L20:567 excites
- L18:66 suppresses
- L10:1032 suppresses
- L11:223 excites
- L13:44 weakly suppresses inside web addresses and citations
- L7:92 weakly excites
- L18:115 weakly suppresses
- L4:76 weakly excites
- L8:328 weakly excites
- L17:257 weakly suppresses
- L16:354 weakly excites
- L12:1120 weakly suppresses
- L19:305 weakly excites
- L19:119 weakly excites
- L9:207 weakly suppresses
- L15:184 weakly excites
- L20:357 weakly excites
- L20:253 weakly excites
- L10:155 weakly excites
- L19:615 weakly excites
- L0:1833 weakly excites
- L10:873 weakly excites
Feeds later layers
- L26:461 excites 'Sch' in surnames
- L27:1779 weakly excites
- L24:405 weakly excites
- L24:1992 weakly suppresses
- L26:787 weakly excites
- L25:542 weakly excites
- L26:1072 weakly suppresses
- L27:615 weakly excites
- L27:967 weakly excites
- L25:386 weakly excites
- L23:1928 weakly excites
- L23:313 weakly suppresses
- L23:758 weakly excites
- L24:862 weakly excites
- L26:1999 weakly suppresses
- L26:348 weakly excites
- L26:822 weakly suppresses
- L24:1188 weakly suppresses
- L23:662 weakly excites
- L27:1899 weakly suppresses
- L23:553 weakly excites
- L23:559 weakly suppresses
- L25:746 weakly excites
- L24:3027 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- {'
- {'
- {⏎
- { ⏎
- {"
- ({'
- [{'
- {⏎⏎
- ,{⏎
- { ⏎
Suppresses
- ustering
- ollah
- omain
- Derby
- aise
- etable
- ieren
- دار
- igue
- lename