"this" after a time phrase
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 19 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "this" when it comes right after a time word and points to the present period, as in "released this year" or "this month". When turned up, the model's writing kept coming back to the word "year", which fits the same theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
and interpret global magnetic and gravity data.<|endoftext|>Federal species protection laws and the religious rights of Native Americans are clashing in a U.S. District Court in Seattle this week, where a 47-year-old man is on trial for violating the
-
team of researchers from Kerala Council for Historical Research (KCHR) is set to join the team involved in the excavations at Khor Rori in Salalah this month itself. The excavations are being carried out to establish links between Khor
-
Ligon, Guinevere Nell, and Karen A. Campbell, “Obama Tax Hikes: The Economic and<|endoftext|>According to a Popular Science article published this month, Americans should expect a tough flu season -- and an early one. While
-
using design thinking. Great example of a school-business partnership.⏎- Design & Thinking Official Trailer (02:28)⏎Design & Thinking is a documentary released this year about design thinking. I haven't seen it yet, but I'm loving
-
.⏎For information call 9<|endoftext|>The Parliamentary Commissioner for the Environment has announced:⏎Parliamentary Commissioner for the Environment Dr Jan Wright released her interim report on fracking this afternoon.⏎The report, Evaluating the environmental impacts of fracking in New Zealand,
-
day or 135 minutes a week.⏎The requirements were implemented for elementary and middle school students in 2003, and extended to high schools this year. It reverses a trend toward more classroom instruction as
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: that the like, like, like, like, like, like, like, like, like, like, like, like... in the like, like, like, like... in the like, like, like... in the like,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of Un<|endoftext|>Water is the essence of life, and access to safe drinking water is a right that should be guaranteed to every person on the planet. However, that’s not always the case. Water can contain many contaminants that are invisible to the
-
get this book, download the free Human Anatomy and Physiology Pdf right now from our website. As you know, that both of the subjects are broad subjects and on one side if they are related on
-
Constellation of Orion. It’s on the opposite side of the sky from the Milky Way Core, and that means it’s going to be in the night sky when it’s not “Mil
-
they use a small space covered with old pieces of calamines as their kitchen.⏎Aleja works washing clothes. She earns around $21 per week, and that is how she supports her family. She uses the money to pay the rent,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:1004 excites
- L4:968 excites
- L17:221 suppresses
- L4:468 excites "that" after "than" or "like"
- L0:1035 excites
- L15:470 suppresses the word 'this' after a preposition
- L5:98 suppresses
- L9:82 suppresses
- L1:1318 excites
- L17:560 excites
- L11:199 excites
- L15:1187 weakly suppresses
- L18:569 weakly excites
- L16:1780 weakly excites
- L18:726 weakly suppresses
- L16:34 weakly excites
- L17:437 weakly excites
- L4:2480 weakly suppresses
- L17:1843 weakly excites
- L11:2155 weakly suppresses
- L18:90 weakly excites
- L16:898 weakly excites
- L16:4 weakly excites
- L16:455 weakly suppresses
Feeds later layers
- L21:1730 excites
- L24:2037 excites
- L20:1175 excites
- L21:2736 excites
- L21:518 excites
- L22:2916 excites
- L22:2625 excites
- L25:926 excites
- L22:1081 excites
- L21:492 weakly suppresses
- L21:592 weakly excites
- L21:1119 weakly excites
- L25:1220 weakly excites
- L22:260 weakly excites
- L24:2399 weakly excites
- L20:1651 weakly suppresses
- L20:42 weakly excites
- L25:390 weakly excites
- L23:2952 weakly excites
- L24:2603 weakly suppresses
- L23:795 weakly excites
- L21:2334 weakly suppresses
- L25:2232 weakly excites
- L21:2105 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ular
- year
- week
- week
- bie
- .#
- icular
- page
- 辈子
- manship
Suppresses
- oref
- rapped
- rome
- rollable
- opsy
- ances
- fried
- ive
- دراس
- ernel