"of" after "regardless"
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 0 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word "of" in the phrase "regardless of". Turning it up did not produce any clear change in what the model wrote about.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
grow female parts, even if it’s genes are male. Similarly, testosterone levels during fetal development will determine what gender the person will identify with later in life regardless of their genetic sex. During early childhood, testosterone drives the rambunctious behavior
-
further claims that a long-life may not be the best ideal to strive for; because people are scared of death, they want to live as long as possible regardless of whether or not they will be able to fill that extra time with something profound.
-
Pioneer researchers say this winter's weather could have some impact on pest populations, but many pests are just lying in wait.⏎"We see pest problems every year, regardless of conditions," reports Paula Davis, senior manager for insect and disease traits at DuPont
-
reduction in the energies. This energy effect operates regardless of the interpretation of red-shifts. It must be applied as a matter of course
-
, year-round in 2010 made 77 cents for every dollar men earned across the country. This comparison includes all male and female workers regardless of occupation
-
ability that overwhelms the circulatory system of their prey, which leads to death. Then the anaconda swallows it whole! They will hunt any animal regardless of size, and if the opportunity strikes, this slimy giant won’t hesitate in
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the problem of a single person in a room. I have been thinking about how to approach it. I think it's possible to have a single person in a room, but I can't help to make a decision. I have
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
drawing a picture of.⏎"God," he said.⏎"Why Johnny," she said, "you can't do thatbecause nobody knows what God looks like."⏎"They will when I'm finished," he assured
-
average-this-probably-will-work value, or is there more to it than that? And if it is just an average, what knowledge is necessary<|endoftext|>from The Century Dictionary and Cyclopedia⏎- n. A grain of rice.⏎-
-
-ocean ridges. Now, the obtained cores showed: No piece of the drilled ocean floor was older than 200 million years, and therefore<|endoftext|>this is an origami ruler. you can make one out of scrap paper, so
-
… Read more<|endoftext|>problem 1: Define the term IT. describe different IT trends and their advantages to
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
None: this is the first layer.
Feeds later layers
- L1:344 suppresses
- L1:119 suppresses
- L1:204 excites
- L15:1474 excites
- L1:907 excites
- L3:558 suppresses
- L14:620 weakly suppresses
- L14:2545 weakly excites
- L14:327 weakly suppresses
- L1:1019 weakly suppresses
- L9:2376 weakly suppresses
- L22:1404 weakly excites
- L1:189 weakly suppresses
- L3:2748 weakly excites
- L19:2274 weakly excites
- L21:366 weakly suppresses
- L3:468 weakly excites
- L18:2502 weakly excites
- L13:2163 weakly excites
- L16:1382 weakly excites comma after an introductory phrase
- L27:1244 weakly excites
- L11:2175 weakly excites
- L4:2156 weakly excites
- L15:2597 weakly excites end of a web document
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- :');⏎
- 直升
- ).</
- aving
- ⾊
- ""); ⏎
- ])):⏎
- 淅
- ');</
- '/');⏎
Suppresses
- atar
- arian
- ology
- eker
- 亿美元
- alignment
- guarantees
- гаранти
- тон
- .Identifier