blank slot before a year or number
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the empty space just before a year or a count, such as "in 2016" or "over 2,000 bats in 12 countries". It seems to get ready for a number or date to come next. Turning it up made the output fall into bold markdown and repeated letters, which doesn't tell us much about its role.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
.⏎Eureka is the largest coastal city between San Francisco and Portland, and the westernmost city of more than 25,000 residents in the 48 contiguous states. It is the regional center for government, health care,
-
stronger than heroin and morphine, and other synthetic opioids, killed over 21,000 people in 2016 (Vergano, 2017). The
-
higher than those of the national sample for all substance measures except tranquilizers and amphetamines (all P <.05). The greatest discrepancy was observed for 8th grade students: last 30-day substance use RRs were
-
be a reservoir for these viruses, but it was not known to what extent.⏎For the study, the researchers tested over 2,000 bats in 12 different countries across Africa, measuring DNA from blood and tissue samples. They
-
approach to eating seen in anorexia. (The so-called epigenome, the supporting actor to our genes,<|endoftext|>One day in 1939, a young schoolboy named Jim Eyles was walking along
-
. are only 76% of men’s, but the disparity of long-term earnings between men and women is far worse. A study comparing total earnings between 1983 and 1998 showed women averaging just 3
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The number of times we keep thinking about the same thing, and we keep repeating it in our daily life, and we repeat it in our thoughts, and we repeat it in our daily life, and we repeat it in our memories. The
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
StudyMode.com. Retrieved 05, 2012, from http://www.studymode.com/essays/The-Struggle-For-Power-In-The-994323.html⏎"The Struggle
-
report said.<|endoftext|>Determining if a Product is Positive or Negative⏎Recall the following properties of multiplication of signed numbers:⏎(positive)(positive) = positive⏎(positive)(negative) = negative⏎(negative)(negative) = positive⏎
-
-scientific scommunities about your work⏎AIMES, in collaboration with the UK, held five Young Scholar’s Network (YSN) workshops. The YSN goal
-
particular forestation. Via CO-FOR-IT, we will develop an online platform, empowered by artificial intelligence (AI), computer vision (CV), deep learning (DL) and geospatial analysis, allowing G/C and T/C stakeholders (
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:59 strongly suppresses
- L19:1174 strongly excites
- L19:1005 strongly excites
- L22:14 strongly excites
- L21:214 strongly suppresses
- L14:140 strongly suppresses
- L19:124 strongly suppresses
- L16:1421 strongly suppresses
- L17:132 strongly excites
- L17:15 strongly excites
- L22:16 strongly suppresses comma in dates and birth lines
- L22:1262 strongly suppresses
- L16:723 strongly suppresses
- L19:963 strongly excites
- L19:430 strongly excites
- L21:1184 suppresses
- L22:424 excites
- L21:418 excites
- L22:290 suppresses
- L19:2966 suppresses
- L18:2497 excites hyphen inside compound words
- L18:76 suppresses blank spot before a number
- L9:974 suppresses
- L16:1044 excites
Feeds later layers
- L24:483 excites
- L27:561 excites
- L27:482 excites
- L25:17 excites
- L26:459 excites opening bracket before an acronym
- L26:352 excites
- L27:318 excites opening parenthesis after a name or term
- L27:192 excites
- L27:337 excites
- L27:513 excites
- L24:1017 excites
- L27:220 excites end-of-text token between documents
- L27:344 excites
- L26:96 excites
- L26:526 excites
- L27:431 excites
- L27:752 excites
- L27:573 excites
- L27:514 excites
- L24:51 excites
- L27:407 excites
- L27:68 excites
- L27:424 excites hyphen inside a compound word
- L24:31 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- IRR
- **
- łoż
- vern
- Internet
- heck
- итесь
- ’es
- Bring
- și
Suppresses
- rier
- magazine
- Magazine
- dishwasher
- temple
- GT
- FIL
- еры
- Fach
- propor