"in" before "good" condition
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 25 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "in" when it is about to be followed by "good", as in "keep our bodies in good working order" or "in good repair". Turning it up made the writing repeat the word "good" again and again, which fits what it is tuned to predict.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
was disassembled. A great deal of the vessel’s wood had rotted significantly by that time, but much of the planking was in good condition despite having been under water all those years. Leaching from the ship
-
the most amazing diet (which is, of course, extremely important), but if our nervous system is out of balance, even the best diet won’t keep us in a healthy state.⏎Our autonomic nervous system plays a role in maintaining many functions
-
. Retrieved from https://digitalcommons.pvamu.edu/pvamu-theses/395<|endoftext|>The Top Reasons to Take Vitamins⏎Keep Our Bodies in Good Working Order⏎Vitamins work hard to keep our bodies functioning properly and
-
directly to the repositories.<|endoftext|>Energy Saving Tips⏎Your Home’s Energy Use⏎Tips to Reduce Energy Consumption and Lower Energy Bills⏎Keep your heating-cooling equipment in good repair. Equipment operating at peak efficiency can reduce fuel consumption.⏎- Insulate
-
laboratory, known as Wardenclyffe and envisioned by Tesla as a prototype for a stupendous world communications and wireless electric system, is still standing and in relatively good shape only yards from Route 25A, a major state highway.⏎
-
tuberculosis.⏎Health care cost reductions⏎“The best medicine is having to use no medicine” means that if you live an active and healthy life, then you will be in
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what does it mean to make a system in the community? In other words, how does community come in to play in making extended home/community communities? My first person point is that the community doesnxicxicxicxicxicxicxicxicxic
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
the significance of the life and music captured in the recordings. The article contains a wealth of information on Morton’s early life, his uneven career, his incisive and wide-ranging views on jazz and related musical forms, and his central
-
00 members, ostensibly for the state party organization's attacks on religion and repudiation of "immediate demands." Michigan Socialist Oakley C. Johnson was incensed, charging in the pages of The Proletarian that the NEC had "
-
was unmistakable – and not just in Atlanta, the most aviation-oriented city in the former Confederacy. Jim Crow Terminals, Anke Ortlepp’s incisive new history of the desegregation of American airports, demonstrates that almost
-
In the next few years we will see -mandated by legislation in 2007 -the elimination of the incandenscent light bulb as we know it. By the year 20
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L24:1668 suppresses
- L22:1093 suppresses
- L16:1860 suppresses
- L19:2406 excites
- L20:1574 excites
- L21:1160 weakly excites 'is' after a subject noun about likelihood
- L19:2685 weakly suppresses
- L23:2991 weakly excites
- L22:2526 weakly suppresses
- L20:1919 weakly excites
- L24:1843 weakly excites
- L0:98 weakly suppresses
- L22:151 weakly suppresses
- L22:554 weakly suppresses
- L17:812 weakly excites
- L20:669 weakly suppresses
- L23:143 weakly suppresses
- L18:2240 weakly suppresses
- L21:7 weakly excites mixed, weak code and reference hits
- L6:2346 weakly excites
- L2:588 weakly suppresses
- L24:80 weakly excites
- L23:2881 weakly excites
- L6:191 weakly excites
Feeds later layers
- L27:1897 excites
- L27:1650 excites
- L26:2816 weakly suppresses
- L26:2527 weakly excites
- L26:2582 weakly excites
- L27:1830 weakly suppresses
- L26:2308 weakly excites
- L26:1421 weakly suppresses
- L27:2629 weakly excites
- L26:792 weakly excites
- L26:1191 weakly suppresses
- L27:1398 weakly suppresses
- L27:1298 weakly suppresses
- L26:567 weakly excites
- L26:2317 weakly suppresses
- L26:3021 weakly suppresses
- L26:1492 weakly excites
- L27:1076 weakly excites
- L26:545 weakly excites
- L27:2205 weakly suppresses
- L27:2939 weakly excites
- L26:789 weakly excites
- L27:2910 weakly excites
- L26:453 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- good
- 好
- good
- Good
- Good
- bad
- GOOD
- 好的
- -good
- _good
Suppresses
- чки
- arence
- ifecycle
- isable
- icts
- hurst
- иков
- ises
- appen
- ới