dates and timestamps, party letters negative
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 11 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the spot in a date or time stamp, such as the comma after 'September 11' or the space in 'Page 1 of 1'. It goes strongly negative on the party letter in a politician's name, like the 'D' in 'Harry Reid (D-NV)'. Turning it up or down gave rambling text that did not mention dates, so the steering does not confirm the pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
field from August 2 – August 20.<|endoftext|>Genetics as it applies to evolution, molecular biology, and medical aspects.⏎10 posts • Page 1 of 1⏎Hope somebody can help, I've got an A level
-
// in Elliot Hildner / University of Bremen⏎The main crack<|endoftext|>analysis of algoritms⏎robert.kern at gmail.com⏎Fri Sep 10 00:10:22 CEST 20
-
New Bovine Footbath⏎Press release date: September 11, 2013⏎Plastruct Canada Inc. has broadened their
-
and PollinatorsA student-built pollinator garden is one of Muhlenberg College’s newest sustainability initiatives.⏎By: Grace Oddo '22 Wednesday, June 30, 2021 02:03
-
.codeguru.com/algorithms/factorial.shtml I don't happen to think that the code there is easily understandable though...⏎January 10th, 2004 01:32 AM⏎Tim_axe
-
are at right angles<|endoftext|>The latest news from academia, regulators⏎research labs and other things of interest⏎Posted: September 29, 2006⏎Magnetic nanobridge brings two worlds together⏎
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I need to find my own to be a student, and for my future to be in a place where I can use myself, and for my identity to be in a place where I can use myself, and for my future to be
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
week, Senator Harry Reid (D-NV) invited more than 30 teams of researchers from the physical and
-
On the same day, the Consumer Financial Protection Bureau (CFPB) released a study reviewing financial education research priorities for America’s youth.⏎Congressmen Bill Foster (D-IL) and French Hill (R-AR) both introduced H. Res
-
, Bible is scheduled to testify at a Capitol Hill hearing before the Senate Agriculture Committee, which is considering the carbon-farming legislation. Introduced by senators Mike Braun (R-Indiana) and Debbie Stabenow (D-Michigan), the bill
-
Hill exhibition, we’re coming across new questions as fast as we can answer the original ones. There’s a long way to go yet.⏎Senator Bill Nelson (D-FL), in his keynote address, highlighted the crucial importance of providing funds to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:1491 weakly suppresses
- L5:1684 weakly suppresses
- L7:933 weakly excites
- L9:1067 weakly suppresses
- L7:1430 weakly suppresses
- L3:350 weakly suppresses
- L2:75 weakly suppresses
- L8:1878 weakly excites
- L4:993 weakly suppresses
- L9:1230 weakly suppresses
- L10:1148 weakly excites
- L6:591 weakly excites number and sequence words in math text
- L8:1614 weakly excites
- L2:1634 weakly suppresses
- L7:1973 weakly suppresses
- L2:2438 weakly excites
- L7:1202 weakly suppresses
- L0:66 weakly suppresses
- L0:2501 weakly excites
- L6:2178 weakly excites
- L8:1924 weakly suppresses
- L2:1043 weakly suppresses
- L10:450 weakly suppresses
- L3:2159 weakly excites
Feeds later layers
- L15:1912 weakly suppresses
- L14:2554 weakly suppresses
- L12:1858 weakly excites
- L15:1640 weakly excites
- L13:1329 weakly suppresses
- L12:1888 weakly suppresses
- L15:2198 weakly suppresses
- L14:2830 weakly suppresses
- L14:699 weakly excites
- L15:822 weakly suppresses
- L17:1365 weakly suppresses
- L13:1631 weakly suppresses
- L15:396 weakly suppresses
- L21:2070 weakly excites
- L17:1957 weakly suppresses
- L15:982 weakly excites
- L16:467 weakly excites
- L13:363 weakly excites
- L12:2450 weakly excites
- L18:1665 weakly suppresses
- L12:1182 weakly excites
- L13:323 weakly suppresses
- L19:700 weakly suppresses
- L23:590 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ";⏎⏎⏎
- ENTIAL
- usp
- '};⏎
- QPainter
- ";}⏎
- ();}⏎
- Bureau
- ";}
- "]];⏎
Suppresses
- owi
- mine
- isateur
- 越大
- ously
- [url
- parameters
- former
- owy
- sted