"as ... as possible" phrasing
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "as" in the common phrase "as ... as possible" (as soon as possible, as simple as possible). When it was turned up, the model kept producing the word "possible" over and over.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
member companies, other industries and with federal, state and local governments to prepare for hurricanes and return operations as quickly and as safely as possible.⏎API member companies also independently work to improve preparedness for hurricanes and other
-
of the donor and acceptor domains in order to be harnessed as an energy source. Researchers had believed that keeping the donor and acceptor layers as pure as possible was the best way to ensure that the excitons could travel unimpeded
-
be certified by a physician, licensed clinical psychologist or psychiatrist.⏎The goal of homebound instruction is to facilitate the student’s return to the current classroom setting as soon as medically indicated. Homebound instruction is temporary. Requests for homebound instruction extending beyond
-
, or surgery that will cure osteogenesis imperfecta (OI). The goal of treatment is to prevent deformities and fractures and allow the child to function as independently as possible. Treatments for preventing or correcting symptoms may include the following:⏎Management of
-
"deferred" items in relation to accounting transactions, we begin to go further into the reporting side of accounting, and in order to keep this article as simple as possible, we are not going to expand on the relationship of deferred items to balance
-
, these controversial findings run counter to the predominant belief that high-yield farming is bad for the planet.⏎Typically, the practice of squeezing out as much food as possible from a parcel of land is associated with over-application of fertilizers and pesticides
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the use of a special asator in the nixen asator asator asator asator in the last line of this: *Oliy, oliy, oliy, oliy, oliy,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
You are not alone. Many people go through this. Feelings of anxiety often accompany approaching social situations after dealing with a loss. Stress is caused by trying to make sense out of the loss. You may feel abandoned, and the paranoia and anxiety
-
all the digits are⏎consecutive. How many times like this are there between midnight⏎and 7 a.m.?⏎These practical challenges are all about making a 'tray' and covering it with paper.⏎My cousin was 24
-
and write in the box in the worksheets on missing numbers from 1 to 25.⏎Math Only Math is based on the premise that children do not make a distinction between play and work
-
their spaceships. There⏎are two rows of seats in the waiting room. Using the rules, where⏎are they all sitting? Can you find all the possible ways?⏎What is the best way to shunt these carriages so that each
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:2590 strongly suppresses
- L19:2608 excites
- L14:1642 excites
- L19:1406 suppresses
- L18:2974 suppresses
- L19:1461 suppresses
- L14:1287 suppresses
- L20:2868 suppresses
- L20:999 excites
- L11:2591 weakly suppresses
- L18:1951 weakly excites
- L19:1682 weakly excites
- L15:712 weakly excites
- L18:2565 weakly excites
- L12:273 weakly excites
- L13:1003 weakly excites
- L18:2198 weakly suppresses
- L12:2241 weakly suppresses
- L17:1765 weakly excites
- L12:1619 weakly suppresses
- L10:1431 weakly suppresses
- L3:403 weakly excites
- L7:2627 weakly suppresses
- L12:3022 weakly suppresses
Feeds later layers
- L27:955 strongly excites
- L24:766 strongly excites
- L25:2051 strongly excites
- L25:1792 excites the modal word 'may'
- L26:466 excites
- L23:1449 excites 'as' in 'as ... as possible'
- L22:1486 excites
- L22:1422 excites
- L22:1588 excites
- L22:981 excites
- L23:2058 weakly excites
- L22:2358 weakly excites
- L25:757 weakly excites
- L24:789 weakly excites
- L25:1211 weakly excites
- L25:1767 weakly excites
- L25:1746 weakly suppresses
- L23:691 weakly excites 'it' before 'is important to'
- L22:1104 weakly excites
- L22:2524 weakly excites
- L23:1342 weakly excites
- L26:1137 weakly suppresses
- L22:2776 weakly suppresses 'can' or 'could' before 'be found/read'
- L25:752 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- possible
- possible
- Possible
- Possible
- _possible
- posible
- 可能
- possível
- possibile
- POSS
Suppresses
- ")==
- oleon
- eks
- zia
- 就被
- 一直都是
- =='
- 就好
- 就是这样
- "},⏎