unclear: sentence-ending periods
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
Fires on the full stop that closes a sentence in ordinary prose, such as the end of a factual claim or a short explanation. It does not seem to care much about the topic. Turning it up made the model drift into repetitive, unrelated text, so the steering results say little about its role.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
II), men were conscripted to battle, leaving fields and livestock unattended. Who stepped in? Women, of course (cause that's what we do). However, we couldn't do it all,
-
who prefer to read about a concept to understand it.⏎- Kinesthetic leaners, who like to use movement or manipulate objects in a "hand on" approach.⏎[NOTE: The word kinesthesia means "muscle sense," which is your
-
to establish a federal holiday in 1894. President Grover Cleveland signed the bill soon afterward, designating the first Monday in September as Labor Day.⏎Learners are Leaders, Inc.’s mission includes uplifting future leaders through learning
-
initiated a new and comprehensive status review which was finalized as the 2018 SSA. Based on the SSA findings, the Proposed Listing was officially withdrawn in 2020.⏎Idaho has a vested interest in wolverine conservation
-
gets filled with water, the air pressure build. As the air pressure builds it pushes a turbine to start spinning. As this turbine starts spinning, electricity is created. Whats also cool, is as the water leaves the compartment, the same thing happens
-
is converted into electric signals through the Optic Nerve behind our eyes and sent to our brain. Our brain then creates the beautiful pictures that we see before us. Our eyes are well-oiled machines (metaphorically speaking, of course
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the question of how to define the function f(x) in the context of the problem, and the function of the idea of defining, and the problem of the function, and the need for the problem, and the idea of the problem,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
are often called Paste tomatoes, but not all plum shapes have the meaty interior of a paste tomato. Some varieties can grow quite long like a horned pepper. Fleshy ones, like the D.O.P protected San Marzano
-
fact, their bowel movements are regular. For example, some people believe they are constipated, or irregular, if they do not have a bowel movement every day. However, there is no right number of daily
-
as a victim of identity theft when you make purchases on websites that aren't secure. There are lots of small online retailers that don't have adequately secure payment systems. The best way to make sure that your information doesn't get intercepted is by simply
-
rosettes often have a bit more white streaking along veins than nodding thistle, though nodding thistle can have whitish leaf margins at times, as shown in the image below. Variegated thistle has much more white
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L9:456 suppresses
- L12:2677 excites
- L11:2220 suppresses
- L12:2436 excites
- L8:149 excites
- L8:430 excites
- L12:1824 weakly suppresses
- L12:1011 weakly suppresses
- L8:319 weakly excites
- L9:12 weakly suppresses
- L9:682 weakly suppresses
- L7:676 weakly excites
- L11:46 weakly suppresses
- L3:182 weakly excites
- L2:92 weakly suppresses
- L11:1025 weakly suppresses
- L7:333 weakly excites
- L9:694 weakly suppresses
- L10:404 weakly excites
- L9:1802 weakly excites
- L9:16 weakly suppresses unclear: periods inside numbers and names
- L7:205 weakly excites
- L7:1197 weakly excites
- L0:933 weakly suppresses
Feeds later layers
- L24:1280 weakly suppresses
- L24:2748 weakly suppresses
- L14:2014 weakly suppresses
- L14:46 weakly suppresses
- L19:1126 weakly excites
- L24:1685 weakly excites
- L17:2164 weakly suppresses
- L20:873 weakly suppresses
- L25:1255 weakly suppresses
- L19:278 weakly suppresses
- L14:1931 weakly suppresses
- L15:2749 weakly suppresses decimal point or digit inside a number
- L15:2314 weakly suppresses
- L15:527 weakly excites
- L23:906 weakly suppresses
- L17:74 weakly excites
- L23:3030 weakly suppresses 'American' in organization names
- L25:2162 weakly suppresses
- L15:1291 weakly excites
- L22:2230 weakly suppresses
- L22:1612 weakly excites
- L14:241 weakly excites
- L24:2515 weakly suppresses
- L15:2597 weakly excites end of a web document
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- anas
- ark
- 一
- 표
- uzz
- ира
- 真
- inter
- 訪
- ana
Suppresses
- oleon
- adına
- ulent
- nonetheless
- ForObject
- 獒
- ityEngine
- nage
- 感觉自己
- .Designer