"as" or "a" after "act" verbs
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 6 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "as" (or "like" or "a") after verbs such as "acts as" or "act as", where the text is about to name what something functions as. When it was turned up, the written text did not clearly follow this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
by means of brackets, which act as crash-boxes by taking the loads mainly in the axial direction.⏎Are car bump
-
captured by the Earth’s magnetic field and guided towards the geomagnetic polar regions. On their way down these particles are slowed down by Earth’s atmosphere, which acts as a shield. These charged particles collide with gas molecules in the atmosphere. The energy
-
the tibia on its outside. The joint acts like a hinge but with some rotation.⏎The anterior cruciate ligament, or ACL,
-
student population and are thus not shown: Ballou STAY<|endoftext|>What Is It?⏎A meniscus is a disk-shaped piece of cartilage that acts as a shock absorber inside a joint. Each knee has one lateral meniscus under
-
, called teichoic acids, that are equipped with phosphocholine groups and induce a characteristic choline architecture on the cell walls. The choline groups act as docking stations for a number of special proteins that are
-
these industries. Those costs are ultimately borne by American consumers and act as a tax on everyday goods made from steel, such as lawn mowers, washing
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: Go to the top This is a question I can answer with a specific date in the future. I need to solve it now. I am not sure about the answer. Let's try to solve it now. I am not sure about
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
standard English in favour of a local dialect or patois. On the other hand, scrupulous attention to the rules of prescriptive grammar might be the kind of branding with which you as an individual or your company or institution might want to be
-
on your own.⏎Make sure that your article is well-organized. The essay should flow well and your composition must come together well. If you’re the type of person that will only arrange things nicely once, you may want to appear into a
-
By logging in, you agree to our updated Terms and Policies.<|endoftext|>Drawing some wisdom from a great sage⏎Looking back, if I had made the right type of friends, I would have become
-
Jackson, Natchez, Miss., is an ideal stop. Situated on the banks of the Mississippi River at its most serene and picturesque, this is the kind of town that makes you feel like a<|endoftext|>History of crystallography⏎
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:683 excites
- L3:936 weakly suppresses
- L4:1365 weakly excites
- L4:2509 weakly suppresses
- L4:2639 weakly suppresses
- L0:2712 weakly excites
- L4:2689 weakly excites
- L2:49 weakly suppresses
- L5:2891 weakly excites
- L5:1083 weakly suppresses
- L5:1399 weakly excites
- L3:1443 weakly suppresses
- L5:1378 weakly excites
- L4:1730 weakly suppresses
- L4:1811 weakly excites
- L5:2512 weakly suppresses
- L1:2421 weakly suppresses
- L3:1486 weakly excites
- L3:2140 weakly suppresses
- L5:1009 weakly excites
- L3:2015 weakly suppresses
- L5:795 weakly excites
- L5:201 weakly excites
- L5:653 weakly suppresses
Feeds later layers
- L19:2738 excites
- L9:2030 excites
- L14:2680 excites
- L8:2764 excites
- L23:1635 excites
- L7:2323 suppresses
- L19:2767 weakly excites
- L24:713 weakly excites
- L18:2963 weakly excites
- L13:1878 weakly excites
- L13:2921 weakly excites
- L19:1902 weakly suppresses
- L18:2997 weakly suppresses
- L11:1274 weakly excites
- L21:2378 weakly excites
- L20:2501 weakly excites
- L16:2965 weakly suppresses
- L22:2051 weakly excites
- L10:1336 weakly suppresses
- L14:2449 weakly excites
- L12:2692 weakly excites
- L18:453 weakly suppresses
- L15:1109 weakly excites
- L17:1470 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- zar
- bridges
- utoff
- през
- .sun
- اصر
- salvation
- bridge
- ORS
- iv
Suppresses
- itsu
- edly
- japon
- 长大
- Qué
- elig
- uty
- fant
- Ange
- Justi