'as' in 'seems as if' comparisons
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'as' in phrases like 'it seems as if' or 'looked as though', where someone is describing how something appears. When it was turned up, the model fell into repeating 'if' and 'which of the following', so the link to the pattern is unclear.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
his book:⏎The two entities that were supposed to write the regulations, the Pay Board and the Price Commission, wrangled and dithered. When it looked as though they were going to miss a crucial deadline
-
chairman Mahmoud Abbas is accusing Israel of “genocide,” and the PA’s newspaper is calling the war “Israel’s Holocaust.”⏎It seems as if every time Israel defends itself, somebody points an accusing finger and yells “
-
y⏎May 27, 2012⏎When the last American astronauts blasted off from the Moon in 1972, it seemed as if they were leaving behind monuments that would stand for all time. On a life
-
Frankenstein’s monster, consisting of two identical M1 Max chips bolted together using a silicon interface that serves as a bridge. This clever design makes it seem as if the conjoined chips are in fact just
-
(the form is at the bottom of the page).⏎Esther – Day 3⏎Xerxes wanted to show off his beautiful wife! But it seems as though he did not give her too much thought until he had drunk too much!
-
for she was lovely to look at.⏎As the story continues, pride creeps in.⏎Xerxes wanted to show off his beautiful wife! But it seems as though he didn’t give her too much thought until he had drunk too much!⏎
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the first time the movie was released, the main plot the first movie the movie was talking time the time the movie going going compared the time the movie going the time the movie talking The first movie the movie was talking time the time the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
in this world?⏎Close MATLAB with keyboard⏎Find the treasures in MATLAB Central and discover how the community can help you!⏎Choose a web site to get translated content where available and see local events and offers.
-
Interior Angle Sum⏎Bit to Gigabyte⏎Find the treasures in MATLAB Central and discover how the community can help you!⏎Choose a web site to get translated content where available and
-
well-being for individuals with mental health conditions. This publication provides a snapshot of existing instruments that measure various domains of wellness and well-being, as well as physical health where it intersects with these domains. This resource emphasizes non-proprietary, public-access
-
making an orthosis involves several steps:1⏎- An assessment of the patient’s medical condition and needs, including diagnosis, pressure mapping, and gait analysis where indicated.⏎- The creation of a positive cast or digital image of the foot,
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L19:1815 suppresses
- L19:1703 weakly excites
- L19:1790 weakly suppresses
- L16:180 weakly excites
- L19:1406 weakly suppresses
- L18:238 weakly suppresses
- L9:523 weakly suppresses
- L16:169 weakly excites
- L16:2532 weakly suppresses
- L5:2280 weakly excites
- L8:7 weakly excites
- L17:137 weakly excites
- L16:209 weakly excites
- L16:598 weakly excites
- L4:2904 weakly excites
- L14:196 weakly excites
- L7:2869 weakly excites
- L0:860 weakly excites chinese 的 particle before a noun
- L19:2531 weakly excites
- L17:56 weakly excites
- L19:16 weakly suppresses
- L0:1085 weakly excites
- L4:2975 weakly excites
- L18:739 weakly suppresses
Feeds later layers
- L25:2663 excites
- L24:148 excites
- L22:427 weakly excites
- L27:1084 weakly excites
- L27:338 weakly excites
- L25:1503 weakly excites
- L21:1746 weakly excites
- L23:449 weakly excites
- L21:1064 weakly excites
- L25:2548 weakly excites
- L24:422 weakly suppresses
- L26:466 weakly suppresses
- L23:688 weakly excites
- L21:793 weakly excites
- L24:557 weakly excites
- L22:160 weakly suppresses
- L23:1172 weakly excites
- L25:147 weakly excites
- L26:1021 weakly excites
- L21:1814 weakly suppresses
- L22:1720 weakly excites
- L21:110 weakly excites
- L24:100 weakly suppresses
- L21:1931 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ually
- though
- though
- erator
- although
- lessly
- iously
- 因为它
- edly
- енно
Suppresses
- applicable
- ob
- esper
- ver
- demonstrated
- apro
- доступ
- well
- asked
- available