document ends and list line breaks
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron mostly reacts to the invisible marker that signals the end of a web page or document, and to line breaks in lists. It seems to care about where one piece of text stops and another starts. Turning it down made the model get stuck writing endless blank lines.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
, each of which is shown in turn below:⏎The distance between any grid point and the rectangular border is one unit of measurement (equal to the length of the<|endoftext|>Shree Ganeshay Namah⏎How to write Anchoring Script in English
-
Resources⏎- Managerial Economics - Discussion⏎- Selected Reading⏎- UPSC IAS Exams Notes⏎- Developer's Best Practices⏎- Questions and Answers⏎- Effective Resume Writing⏎- HR Interview Questions⏎- Computer Glossary⏎-
-
become an integral part of the semiconductor industry. Lithography is widely used in the industry to make two-dimensional circuit boards, but a convenient method for creating three-dimensional<|endoftext|>Embedding a Racial Equity Perspective in the Positive Youth Development Approach⏎This brief
-
using everyday materials.⏎Unit blocks are an excellent STEAM tool because they address Science, Technology (how things work), Engineering (problem solving) Art , and Math<|endoftext|>What is the maximum amount that sea levels could rise by 2100
-
therefore, is a time for focusing on the heart, a time for asking questions about our spiritual health:⏎- What are my characteristic sins, and how can I<|endoftext|>An ion-chromatographic method for the direct determination of ammonium, potassium
-
is a path that starts and ends at the same node. Sometimes cycles are useful, but they often represent challenges in graph algorithms. Failing to detect a cycle<|endoftext|>For hundreds of years men of science and theoretical physics have been struggling to solve the
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately:
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
.NET is in the second position with only 20.3%. The statistics also shows that PHP is the sixth popular of all the programming language. (Source:⏎- Easier to learn and Implement⏎PHP is easier to learn than its competitors
-
of the University Community: (Students, faculty, employees,⏎and alumni.) The University of Miami Physics Department maintains an⏎Observatory for teaching
-
its story.⏎We've sent an email with your order details. Order ID #:⏎To access this title, visit your library in the app or on the desktop website
-
Clinical | Educational | Industrial | Professional items | World psychology |⏎Mindfulness-Based Cognitive Therapy (MBCT) is a method of therapy which blends features of two disciplines:⏎- Cognitive therapy aims to identify and alter cognitive distortions (warped or inaccurate
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:84 strongly suppresses
- L13:10 excites
- L1:1279 suppresses
- L0:37 excites
- L5:331 suppresses
- L3:98 excites
- L6:67 excites
- L10:259 excites
- L9:25 excites
- L2:204 excites
- L10:33 suppresses
- L5:238 excites
- L0:596 excites
- L1:1 excites
- L6:216 excites
- L8:88 excites line breaks inside wrapped sentences
- L8:32 excites
- L9:7 excites
- L13:1721 suppresses
- L12:5 excites
- L9:2729 suppresses
- L0:1224 suppresses
- L0:178 suppresses
- L0:1301 suppresses
Feeds later layers
- L15:81 strongly suppresses line breaks inside running text
- L17:829 strongly suppresses
- L18:429 strongly suppresses
- L16:313 strongly suppresses
- L17:205 strongly suppresses
- L20:346 strongly suppresses
- L16:359 strongly suppresses
- L18:5 strongly suppresses
- L17:1073 suppresses
- L16:190 suppresses end-of-document boundary token
- L19:187 suppresses
- L18:705 suppresses
- L18:3042 suppresses line breaks in wrapped text
- L21:130 suppresses
- L16:1421 suppresses
- L17:921 suppresses
- L20:467 suppresses
- L16:1579 suppresses
- L18:886 suppresses
- L17:432 suppresses
- L15:186 suppresses
- L22:506 suppresses
- L16:414 suppresses
- L17:554 suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- sexes
- ANDOM
- 下班
- '${
- '@/
- .sex
- verses
- urry
- ptic
- `;⏎⏎
Suppresses
- illos
- illo
- span
- s
- black
- think
- 展开
- lette
- spl
- ships