"addition" in "In addition"
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to the word "addition" in the phrase "In addition", which starts a new point that adds to the last one. The steered replies did not show a clear link to this idea.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
plant stress maps match, and greatly extend into surrounding regions, the on-ground CO2 emission mapping done by the USGS in Menlo Park, California.⏎In addition, vegetation health mapping along with altered mineralization mapping at Mammoth Mountain does reveal
-
11-percent MTBE by volume. MTBE has been detected about 4 to 6 times more frequently in the high-use areas than elsewhere.⏎In addition to its studies of ambient ground water, USGS is<|endoftext|>
-
, and ponds. Emerging adults are fast, strong fliers. Keeping doors and window screens in good repair can help keep deer flies out of the house. In addition to using insect repellents, wearing long sleeve shirts, long pants,
-
development of nozzle technology, the water spray posture has changed a lot. With these materials, through professional art design, you can draw a beautiful aquatic landscape.⏎In addition, different creative fountain forms are suitable for different application scenarios. For example, music
-
(including mosquitoes, ticks and some flies) can spread a number of diseases. Use insect repellent.⏎• Shower with soap before and after you swim.⏎In addition, ODH officials report that Ohio’s continuing measles outbreak is the largest in the
-
’t prevent him from being lumped in with the incompetents that sailed on most coffin ships, and he was personally attacked in legal actions and the press.⏎In addition to the dangerous ocean crossing, emigrants faced
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: "The number 1 is a number, and the number 2 is a number. The number 3 is a number... and so on. So, I have been thinking about lately. So, I have been thinking about lately.
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
band for random values⏎Default Value: uniformNoise.y⏎Default Value: truncatedNormalNoise.y⏎|June 22, 2015||<|endoftext|>Sadie Hawkins poems are pieces of poetry written to commemorate Sadie Hawkins day or
-
Sign up today for free teaching ideas, lesson plans, online activities, tips for your classroom, and much more.⏎Choose your grade range:⏎See a sample ><|endoftext|>In any hospital, clinic
-
still and strong formula to keep the stuff together and you can also visit https://www.customconcretetampa.com/ to get more assistance.<|endoftext|>In this chapter we introduce the other dominant form of interconnection, called Internet Peering. Internet
-
grows much faster than hevea, but the latter still has certain advantages.⏎Hevea is less prone to cracking, and doesn't allow as much heat<|endoftext|>
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:1249 weakly excites
- L0:1301 weakly suppresses
- L0:149 weakly excites
- L0:2039 weakly excites
- L0:178 weakly suppresses
- L0:365 weakly excites
- L0:1224 weakly suppresses
- L0:1416 weakly excites
- L0:2403 weakly excites
- L0:454 weakly suppresses
- L0:523 weakly excites
- L0:259 weakly suppresses
- L0:1072 weakly excites
- L0:107 weakly suppresses newline starting a new block
- L0:1883 weakly suppresses
- L0:999 weakly excites
- L0:148 weakly suppresses
- L0:129 weakly suppresses
- L0:1687 weakly excites
- L0:927 weakly suppresses
- L0:1307 weakly excites
- L0:2849 weakly suppresses
- L0:2668 weakly excites
- L0:225 weakly excites
Feeds later layers
- L4:100 excites
- L7:260 weakly excites
- L6:487 weakly suppresses
- L22:599 weakly excites
- L10:181 weakly suppresses
- L6:866 weakly suppresses
- L15:180 weakly suppresses
- L13:2670 weakly suppresses
- L7:503 weakly excites
- L8:814 weakly excites
- L14:932 weakly excites
- L21:2438 weakly suppresses
- L17:933 weakly excites
- L10:490 weakly suppresses
- L12:1053 weakly suppresses
- L6:2744 weakly suppresses
- L13:699 weakly suppresses
- L9:727 weakly excites
- L3:376 weakly excites
- L18:341 weakly excites
- L5:571 weakly suppresses
- L17:1079 weakly suppresses
- L6:2819 weakly excites
- L19:2232 weakly excites end-of-document boundary token
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- rack
- PELL
- otics
- ampton
- 创造性
- iversal
- istry
- andscape
- visual
- tti
Suppresses
- />\
- 寥
- ac
- ờ
- 咨
- ";"
- ("<?
- ';'
- ;;
- arpa