'by' after a past participle
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'by' when it follows a verb like 'represented', 'indicated' or 'referred', as in 'represented by a scatter plot'. Its negative side is weak and fires on 'about' after words like 'story' or 'information'. Turning it up gave text that drifted to new topics, not anything about this word.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
worse. This comes as more international analysts have also began to question the accuracy of the Meles government’s double digit economic growth claims and similar disputed government statistics referred by institutions like the<|endoftext|>An hour before liftoff, things were going as planned
-
30. It tells you the oil’s thickness or viscosity. A thinner motor oil — indicated by a lower number — flows more easily. Conversely, a thicker oil — with a
-
school events each week and time spent watching videos online each week⏎- temperature and watermelon sales⏎Some data is collected for each pair of variables listed and represented by a scatter plot. For each pair of variables, how do the scatter plots support
-
room, or humidity produced by water within the capped horticultural tubes that flowers were mounted in during sampling). The intensity of floral humidity produced by flowers, represented by (the average peak difference in relative humidity in the flower species' headspace compared
-
10 MPa excess pressure within the magma chamber, generating the stress field. Layers dips by 20-degree increments, with differing elastic moduli, represented by stiffness ratios (EU/EL) ranging from 0.01 to
-
use of memes. A meme is a conception, technique or custom that escalates from one person to another with the purpose of sending a particular meaning or idea represented by the meme. The spread of memes has significantly shaped how people communicate, and they
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I am a 24-year-old woman, 22 years old, I am in my 23rd month. I am 24 years old, I am 22 years old, and I am in my
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
. She befriends a little boy called Amir who is very unhappy when it is time to say goodbye. Perhaps Pebble could keep him company too?⏎A story about the power of friendship in desperate circumstances.⏎As Lubna talks to Pebble,
-
a writing folder as a<|endoftext|>This page provides information about the questions in Sundanese, also called the interrogative form. This will
-
being pro-choice in this song, he talks about being anti-street-harassment in this song. But he also — it's an autobiographical song about being a young black male growing up<|endoftext|>Despite progress, measles kills 40
-
insights TikTok is gathering on its users. TikTok app user interaction data can be utilized to create detailed individual “psychometric” profiles. These profiles contain information about a person’s interests, hobbies, emotional triggers, lifestyle choices, etc. Such
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:2257 weakly suppresses
- L0:1651 weakly excites
- L0:1232 weakly excites
- L0:376 weakly excites
- L0:1812 weakly excites
- L0:2806 weakly suppresses
- L0:2845 weakly suppresses
- L0:1943 weakly suppresses
- L0:839 weakly excites
- L0:1830 weakly excites
- L0:1035 weakly suppresses
- L0:909 weakly suppresses
- L0:1861 weakly excites
- L0:2447 weakly excites
- L0:2007 weakly suppresses 'key' after 'The'
- L0:1747 weakly excites
- L0:725 weakly excites
- L0:1555 weakly excites
- L0:421 weakly excites
- L0:1979 weakly excites
- L0:255 weakly excites
- L0:1820 weakly suppresses
- L0:285 weakly excites
- L0:327 weakly suppresses
Feeds later layers
- L8:1097 suppresses
- L18:2339 weakly suppresses
- L3:355 weakly suppresses
- L3:409 weakly suppresses
- L15:1676 weakly suppresses punctuation after names and book titles
- L9:2067 weakly excites
- L11:2124 weakly suppresses
- L12:719 weakly excites
- L17:2574 weakly suppresses
- L21:2377 weakly suppresses
- L6:734 weakly suppresses
- L8:2322 weakly excites
- L5:413 weakly excites
- L12:937 weakly suppresses
- L3:1772 weakly suppresses
- L2:2756 weakly suppresses
- L2:610 weakly suppresses
- L6:1802 weakly suppresses
- L2:26 weakly suppresses
- L10:484 weakly suppresses
- L9:3005 weakly suppresses
- L20:2753 weakly suppresses
- L3:804 weakly suppresses
- L25:2064 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- goggles
- 랐
- 圆满完成
- ContextHolder
- atical
- ophone
- collectively
- complète
- stereotype
- 狠抓
Suppresses
- nc
- entials
- xs
- STANCE
- anja
- thic
- ning
- 多个国家
- ![
- parcel