the word new before a noun
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 17 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
It reacts to the word "new" when it comes before a noun that names a time or event, such as "the new school year", "a new era" or "a new surge". The strongest hits are all that one word. Turning it up pushed the model toward unrelated sums and questions, so the steering output does not show the word itself.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
school safely⏎Summer vacation is drawing to a close, and soon the bells will be ringing to bring in the new school year.⏎Keeping children safe is the Olympia School District’s top priority, especially
-
in a fun, productive manner that keeps kids engaged! Here are five ways to prevent summer learning loss and help your student retain information to help them succeed when the new school year begins.⏎1. Create a routine to stay on track.⏎Most students
-
both types of declaw.4 This study as well as a similar study did find that cats decl<|endoftext|>With the human population expected to grow by billions over the new few decades, the United Nations is predicting that by 2050 our
-
But is it true? How can peer pressure be affected or aggravated through social media?⏎The endless struggle to keep young teens away from bad influences have moved into a new battlefield– the Internet. The latest studies show that people, especially teenagers, who
-
weight in the end. Yoyo dieting may also put other strains on different parts of your body, as your system must constantly recalibrate to deal with a new weight.⏎Some minor change in weight is consistently minor in the effects on your body
-
anding Role for Genetics Counselors⏎The completion of the human genome sequencing launches a new era in genetic medicine. With the decoding of the letters that make up the recipe
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "I was a child first, then I got to the first place of the first place of the first of the first of the first of the first of the first of the first of the first of the first of the first of the first
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
diverse set of controls, as well as in a discontinuity analysis on observations near the borders between anglophone and francophone countries.⏎- Colonial rule⏎ASJC Scopus subject areas⏎- Economics and Econometrics⏎- Organizational Behavior and
-
|Number of pages||12|⏎|Journal||Classical and Quantum Gravity|⏎|State||Published - Jul 7 2003|⏎ASJC Scopus subject areas⏎- Physics and Astronomy (miscellaneous)<|endoftext|>Most computer
-
the city of Jerusalem by which the St Lazarus hospital was established is still known today as the St Lazarus Gate.<|endoftext|>There's actually a major health crisis today in terms of the shortage of organs. The fact is that we're living longer
-
European scientists, led by researchers from the University of Geneva (UNIGE)’s Faculty of Medicine in the context of the GEUVADIS project, today present a map that points to the genetic causes of differences between people. The study
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:2828 excites
- L16:2071 excites
- L4:2459 weakly excites
- L4:479 weakly suppresses
- L15:699 weakly excites
- L4:2480 weakly suppresses
- L16:282 weakly excites
- L2:2903 weakly suppresses
- L12:2476 weakly excites
- L13:2325 weakly suppresses
- L12:480 weakly excites
- L3:1615 weakly suppresses
- L15:190 weakly excites
- L6:2965 weakly excites
- L2:2749 weakly excites
- L12:3065 weakly excites
- L10:431 weakly excites
- L11:518 weakly suppresses
- L16:2301 weakly suppresses
- L16:227 weakly suppresses
- L5:1018 weakly suppresses
- L11:2562 weakly excites
- L16:2395 weakly suppresses
- L8:2881 weakly excites the word 'new'
Feeds later layers
- L19:2826 excites
- L19:106 weakly excites
- L27:3044 weakly suppresses
- L18:1944 weakly excites
- L19:2963 weakly excites
- L21:1790 weakly excites
- L22:2368 weakly excites
- L24:23 weakly excites
- L20:1608 weakly excites
- L20:2375 weakly suppresses
- L22:1216 weakly excites
- L19:2587 weakly suppresses
- L21:2818 weakly suppresses
- L18:2189 weakly excites
- L20:558 weakly suppresses
- L21:716 weakly excites
- L19:457 weakly suppresses
- L21:808 weakly excites
- L27:606 weakly excites
- L19:3024 weakly suppresses
- L18:3002 weakly suppresses
- L18:2333 weakly excites
- L18:2367 weakly excites
- L23:401 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- _SPE
- york
- 市长
- ty
- Scient
- _ARR
- uesta
- year
- state
- (State
Suppresses
- tract
- 仍是
- ifold
- 击杀
- pill
- inite
- boxing
- still
- ibles
- abinet