words that signal persistence (still, retains, continue to)
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 11 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on words that say something carries on or stays the same, like 'still', 'continue to', or 'retains its'. Turning it up made the model's text drift into unrelated, rambling sentences, so the steering results don't show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
ity, do ordain and establish this Constitution for the United States of America.⏎From the Articles of Confederacy:⏎Article II. Each state retains its sovereignty, freedom, and independence, and every Power, Jurisdiction, and right
-
automation had the potential to take some jobs it could also provide new employment opportunities. “You’re not going to be using machines to build new mines, people will still be doing that because that’s very non-routine,” he said.⏎
-
tests or grades or awards: curiosity is always a finer spur than rivalry. Nor do we diminish the students’ discoveries by reciting the famous names of those who had gone this way
-
useless, or just plain wrong.⏎It’s important to remember that if you win the lottery, your success does not automatically make you a better person. You will still face challenges and have to deal with the same problems as everyone else. However,
-
?⏎You can transfer the economic rights of a unique and original work. You can do it under a license or a protocol.⏎A license transfer⏎- You can still profit financially from your work.⏎- You transfer the rights for a period of time
-
. Mutations can enhance the moonlighting function without necessarily eliminating the ancestral function. This paper shows that even a very small protein is capable of moon
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: how to get the information from the current time, the current time, the current time, the current time, the current time, the current time, the current time, the current time, the current time, the current time, ... (
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
practice Conjugate Acids and Bases practice problems.⏎What professor is this problem relevant for?⏎Based on our data, we think this problem is relevant for Professor Finnegan's class at WSU.⏎What textbook is this problem found in?⏎
-
in the West.<|endoftext|>Two dimensional spatial coherence of skeletal muscle's natural vibrations during voluntary contractions.⏎Archer, Akibi A. A.⏎MetadataShow full item record⏎Low frequency mechanical vibrations (<100 Hz) are naturally generated by
-
Medical Association.⏎The study was supported by the National Institutes of Health<|endoftext|>The generalized second law of thermodynamics states that entropy always increases when all event horizons are attributed with an entropy proportional to their area. We test
-
digestion, our respiratory rate, immune function, the activity of the endocrine glands and more……⏎The autonomic nervous system functions in two states: Sympathetic mode or parasympathetic mode.⏎Our body is in constant calibration
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:2779 suppresses
- L7:1380 excites
- L8:2578 suppresses
- L10:1572 excites
- L10:1949 suppresses
- L10:2675 excites
- L10:2790 excites
- L9:2917 weakly excites
- L9:1022 weakly excites 'stem' in stem cell phrases
- L9:1545 weakly excites
- L8:1388 weakly excites
- L4:2661 weakly suppresses
- L10:2994 weakly suppresses
- L7:1079 weakly suppresses
- L7:491 weakly suppresses
- L7:1744 weakly suppresses
- L9:1699 weakly suppresses
- L7:1294 weakly excites
- L8:894 weakly suppresses
- L5:303 weakly suppresses
- L7:1995 weakly suppresses
- L9:477 weakly suppresses
- L5:2027 weakly suppresses
- L8:906 weakly suppresses
Feeds later layers
- L16:2123 excites
- L19:2487 excites
- L25:2237 excites
- L23:1638 excites
- L23:1258 excites
- L15:374 excites
- L12:480 excites
- L18:3044 excites
- L13:362 excites
- L12:2636 suppresses
- L16:1932 excites
- L13:406 excites
- L14:715 suppresses
- L13:2154 excites
- L15:1527 weakly excites
- L13:742 weakly excites
- L12:2005 weakly excites
- L22:1220 weakly excites
- L17:2904 weakly excites
- L14:2750 weakly excites
- L13:3069 weakly excites
- L14:599 weakly excites
- L12:509 weakly excites
- L14:2329 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 留在
- 保留
- reopen
- Preserve
- 留
- 轲
- 将继续
- 继续保持
- 仍将
- 保持
Suppresses
- elves
- ominated
- amped
- ghan
- opped
- ouched
- ween
- atted
- anmar
- ritten