uppercase words starting with O
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 3 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron gives weak responses to capital-letter words that begin with 'O', such as 'ORNL', 'OHIO' or 'OBLO'. The responses are small compared with the neuron's top cases elsewhere, and the pattern is not very clean. Turning it up did not change the writing in a clear way.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
).⏎Regional and global biogeochemical dynamics data can now be located and acquired through a metadata search system at the ORNL DAAC.⏎The ORNL DAAC recently released six additional data sets from
-
tool can move linearly. In this way, the best cutting condition can be maintained on the entire path.<|endoftext|>OHIO DEPARTMENT OF AGRICULTURE⏎Division of Plant Industry – Ap
-
from the folks at Edutopia that shares what one teacher wishes she had known at the beginning of her career
-
in order to disassemble and fully reassemble the toy. It consists of an outer round layer (the container), a lid and 10 removable pieces. OBLO is colored with three primary colors and one secondary color to appeal to its audience
-
to keep the system’s data safe. And as ARPANET gave way to the purely academic world of the early internet, the idealistic graduate students who<|endoftext|>OF FATTY ACID METABOLISM⏎coma due to a disorder of
-
rophilic Substitution has several factors that affect its relative rates and this includes the following: substituents, solvent and temperature. Substituent like –OH and Br has an effect in electrophilic aromatic
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the fact that, in the first place, the fact that, in the first place, the fact that... (the fact that) (1) the fact that... (the fact that) (1) the fact that... (1
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
men heard the shells edging closer. “And then bang!—one of the big shells struck the ground right in front of us and we all went up in the air. But we all come down again.”⏎York was showered with honors
-
THC . Attempts to use them clinically have been unsuccessful, due to difficulty separating the desired properties from unwanted psychoactive effects. Illicit drug manufacturers seized on the mind-altering potential of these chemicals and began distributing synthetic cannabinoid compounds in the early
-
quirrels. Indeed, following arrival of Pine Martens, Red Squirrels are now recolonising some forests from which they had been absent<|endoftext|>THE RAATZ ROUNDUP⏎Submitted for use on April 22, 20
-
and launched the project "Je tuin intekenen en vergelijken" on the citizen science platform MijnTuinlab (My Garden lab).⏎The project
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L2:7 suppresses
- L0:2969 excites
- L2:355 weakly excites
- L0:1301 weakly suppresses
- L2:49 weakly suppresses
- L0:425 weakly suppresses
- L1:55 weakly excites
- L0:1224 weakly suppresses
- L0:178 weakly suppresses
- L0:1184 weakly suppresses
- L2:87 weakly excites
- L1:13 weakly excites
- L0:1280 weakly excites
- L0:1072 weakly suppresses
- L2:2328 weakly suppresses
- L1:2119 weakly excites
- L1:1099 weakly excites
- L2:1607 weakly suppresses
- L0:3069 weakly suppresses
- L2:833 weakly excites
- L2:493 weakly suppresses
- L2:1559 weakly excites
- L2:1376 weakly excites
- L2:38 weakly excites
Feeds later layers
- L7:2095 excites
- L14:901 excites mid-word fragments in technical terms
- L5:1071 weakly excites
- L20:1037 weakly excites
- L5:2484 weakly suppresses
- L19:1320 weakly excites
- L20:374 weakly suppresses
- L14:1425 weakly excites
- L18:871 weakly excites
- L26:1420 weakly suppresses
- L4:2163 weakly suppresses
- L10:709 weakly excites
- L4:2535 weakly suppresses
- L26:1362 weakly excites
- L21:1312 weakly suppresses
- L18:1401 weakly suppresses
- L18:954 weakly suppresses
- L18:2565 weakly suppresses
- L5:1641 weakly suppresses
- L17:2031 weakly suppresses
- L11:854 weakly excites
- L23:2001 weakly excites
- L15:1130 weakly excites
- L20:1329 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- iele
- öh
- alion
- rien
- 更何况
- omers
- nets
- życie
- olders
- ieux
Suppresses
- ==
- obvious
- thern
- ’aut
- .reporting
- 自
- ptive
- ADF
- gy
- 万千瓦