number in days or time spans
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the number in phrases that say how many days or nights something lasts, like "28 days", "seven days" or "eight nights". When it is turned down the model drifted toward talk about quarters and years instead.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the benefits of managing menstrual hygiene (MHM).⏎Menstrual Hygiene Day was chosen for May 28 because most women’s menstrual cycles last 28 days and their menstruation phase last five days
-
will see new skin underneath.⏎Cold sores typically last about 7 to 10 days. It is contagious and can be spread by direct contact with other people.
-
better.⏎The fever associated with the flu typically lasts between three and five days, but fatigue and other symptoms can persist for weeks.⏎A sinus infection lasts longer than seven days in most cases. Many patients experience “double worsening,” meaning they begin to
-
4 days, depending on the species and the air temperature. In tropical conditions, the first three stages tend to be longer, usually 10 to 14 days.⏎The adult female Anopheles mosquito can live up to a month,
-
start creating your Spark projects and collaborating with other data scientists. When you sign up, you get free access to Watson Studio and all other IBM services for 30 days. Start now and take advantage of this offer.⏎- Learn how it performs
-
easier to understand and encourages participants to change their behaviour patterns.⏎Set a deadline for planning/writing and rehearsing the role-play, giving participants at least 90 minutes to prepare. A late afternoon or evening presentation saves time and often provides the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I am a *centennial* (centennial is a term I'm semi-annually and a semi-centennial... acentennial? Acentennial? Acent... acent... acent... *cent*... *
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
society is trying to help blacks lift themselves up to be able to enjoy a more prosperous and satisfying life. Much progress has been made in this respect in the last half-century but there is clearly still a long way to go in achieving full equality with
-
to) balance the macro world of nature and the micro world within each human.”⏎This year’s ceremony was more lavish than the one Rendeh witnessed nearly half a century ago.⏎“That last one was not so large as this. We were poorer
-
on owner-cultivator principles and a compulsory education system for school-age children to be enrolled at a primary school, at the very least.⏎In the past half century, Korea’s rapid economic growth has evolved around
-
[on sheet with] Plan du Havre de Noel, dans la Terre de Kerguelen, by Cook/Benard, from Atlas du Troisi<|endoftext|>One of
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:1335 suppresses
- L22:1954 suppresses
- L14:1088 excites
- L22:663 suppresses
- L20:1355 suppresses
- L17:2544 suppresses
- L21:1284 excites
- L19:1720 suppresses
- L20:2942 suppresses
- L22:941 suppresses
- L21:708 suppresses
- L17:2964 suppresses
- L22:1998 suppresses
- L21:375 suppresses
- L20:1133 suppresses
- L20:2953 suppresses
- L4:2982 excites
- L20:1680 suppresses
- L21:620 weakly excites
- L20:1155 weakly excites
- L7:229 weakly excites first digit of a split number
- L5:50 weakly excites
- L1:2605 weakly excites
- L1:2540 weakly suppresses
Feeds later layers
- L24:1368 suppresses
- L26:1448 suppresses
- L25:1717 weakly suppresses
- L27:1105 weakly suppresses
- L27:2995 weakly suppresses
- L24:450 weakly suppresses
- L24:2891 weakly suppresses
- L26:2733 weakly suppresses
- L25:1323 weakly suppresses
- L25:3005 weakly excites
- L24:2365 weakly excites
- L25:1377 weakly excites
- L24:2941 weakly suppresses
- L27:1449 weakly excites
- L26:2331 weakly suppresses
- L26:284 weakly suppresses
- L25:1013 weakly suppresses parenthesis introducing an acronym
- L25:804 weakly suppresses
- L24:478 weakly suppresses word fragment inside a longer word
- L25:2729 weakly suppresses
- L27:566 weakly suppresses
- L25:2346 weakly suppresses
- L25:2996 weakly suppresses
- L24:282 weakly suppresses the 'conc' word fragment
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- rokes
- ivity
- -days
- >Data
- Hanna
- 面孔
- 脸
- Brains
- exhaustion
- riff
Suppresses
- 月
- ⽉
- 季度
- 月至
- 季
- 年
- year
- quarter
- month
- _month