end-of-text marker between documents
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the hidden end-of-document marker, the point where one web page or text stops and an unrelated one starts. It is nearly silent on ordinary words. Turning it up did not produce any clear change in the written text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
environmental variables, or logging properties⏎- Monitor Spark using the web UIs, metrics, and external instrumentation⏎- Understand performance tuning considerations⏎- This course is<|endoftext|>Class 1M have been learning the story of Snow White and the Seven D
-
for students to individualize the map with images, colors, background, and font. As Miles ‘23 noted, this<|endoftext|>The Bill states that the Constitution of India is dynamic in nature, with the ability
-
a writing folder as a<|endoftext|>This page provides information about the questions in Sundanese, also called the interrog
-
The most popular toolbars that are used for AutoCAD 2D drawings are the DRAW, MODIFY, and OBJECT PROPERTIES toolbars. Select these toolbars<|endoftext|>February 14, 2007 - Scientists Elucidate the
-
reorganize them so that the memory access runs, the R2 operation is held in an Instruction Pool pending completion of the first operation, and R5 and<|endoftext|>ATLANTA (AP) — A recent study shows one in four high school
-
D model. Custom-built software then<|endoftext|>August 20, 2012⏎- coddle (
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: how to both, as the students, to the rest, to the students, as the adults, the students, as the institution, as a how to, as, as... a / / / / / S / / / / T
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
up the data directory that the installed server uses, but also create a pristine “template” data directory named⏎dataunder the installation directory. After an installation has been performed using an MSI package, the template data directory can be copied to set up
-
WAS burning !! The relays look like this. Gas-fired models, on the other hand, have a burner at the base of the water heater. I have been using the oven for quite some time with just the broiler
-
Core State Standards for states in which they have been adopted. If a state does not appear in the drop-down, CCSS alignments are forthcoming.⏎This lesson has been aligned to standards in the following states
-
continue maintenance shots for three to five years.⏎How well do these shots actually work?⏎As with any treatment, effectiveness will vary from person to person. They have been shown to aid in the decrease of symptoms for many different types of allergies.⏎The
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:449 strongly suppresses
- L16:37 strongly suppresses
- L5:601 strongly excites
- L17:1554 suppresses
- L16:478 suppresses
- L14:348 suppresses
- L16:376 weakly suppresses 'or' joining alternatives
- L16:454 weakly excites
- L17:300 weakly excites
- L5:1896 weakly excites
- L3:1480 weakly suppresses
- L8:14 weakly excites
- L2:469 weakly suppresses
- L15:727 weakly excites
- L16:112 weakly excites
- L15:81 weakly suppresses line breaks inside running text
- L6:401 weakly suppresses
- L10:32 weakly excites
- L16:170 weakly suppresses
- L6:359 weakly excites
- L0:1746 weakly suppresses
- L13:747 weakly excites
- L2:1710 weakly suppresses
- L3:2484 weakly excites
Feeds later layers
- L21:1323 strongly suppresses just before a document ends
- L25:436 excites
- L27:1300 excites
- L22:230 excites
- L19:732 excites unclear: end of document token
- L24:130 excites line break at the end of a line
- L26:603 weakly excites
- L20:96 weakly suppresses
- L20:1260 weakly suppresses
- L19:2591 weakly suppresses
- L20:2858 weakly excites
- L22:2895 weakly suppresses
- L24:1577 weakly suppresses
- L20:1391 weakly excites
- L21:1767 weakly suppresses
- L27:2708 weakly excites
- L23:1946 weakly suppresses
- L26:145 weakly excites
- L22:2951 weakly excites
- L19:2811 weakly suppresses
- L24:1608 weakly suppresses
- L22:3013 weakly excites
- L22:133 weakly suppresses
- L24:2174 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- arga
- esto
- _world
- 帐
- казать
- 这才
- -contrib
- front
- deviation
- ESİ
Suppresses
- artner
- ạch
- burned
- dux
- éta
- .colorbar
- uitar
- ammen
- berger
- acades