weak end-of-document signal, mostly noise
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds only weakly, mostly to the marker that ends one document and starts another, and it is pushed slightly down on some words inside sentences. Its strongest responses are small, so it is hard to read. Turning it up did not produce a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
of the medical staff at Phoenixville Hospital. His office is located at 824 Main St., Suite 206.<|endoftext|>MEDIA RELEASE - "CLIMATE IMPACTS DAY" BASED ON MISUNDER
-
general radiology that can be executed through the use of X-rays, mammography, ultrasound, fluoroscopy, angiography, CT scan, PET scan,<|endoftext|>Geophysical research in Thailand are relatively new due to the lack of fund to obtain
-
ifolds and functions of many complex variables. Application of transcendental methods to algebraic geometry falls in this category, together with more geometric chapters of complex analysis.<|endoftext|>By: Ann Gabriel| Foodfindsasia.com⏎As Filipinos, we
-
mutations arise over time⏎An NIH-supported team offers a possible answer to this question in a study published in the journal Science. Based on their analysis of duplicate gene<|endoftext|>The maternal mortality rate reported in Tibet (400/100,
-
the month.⏎VSTD9 Oscilloscope Operation & Signal Test Methods⏎Use our online self assessment tool to find the right course for you⏎Using our '<|endoftext|>Dividing by zero. Even on our own wiki, at one point.⏎Hand
-
this problem web Miner's has introduced several preprocessing methods to reduce the log data size and to eliminate incorrect records, which lead to improved quality, quantity and performance.<|endoftext|>Based on the acid rain and concurrent meteorological observational data during the past 1
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The question is, why do we think that the amount of time we spend on the topic is the same as the amount of time we spend on the topic, and then again again, the same amount of time, and again again, the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
After the Patagonia incident, many other brands underwent investigation and uncovered that their own down also came from similarly unethical sources.⏎According to PETA, plucking live birds causes “considerable pain and distress”. When birds are plucked, their
-
Europe from the 4th to 6th centuries AD, when the Western Roman Empire was in decline.”⏎Pictish communities…were part of powerful kingdoms in the early medieval period.Dr Gordon Noble, Senior Lecturer, University of Aberdeen
-
health effects of consuming GMOs/Roundup shown in animal feeding studies⏎There’s now overwhelming evidence that GMOs are so dangerous and high risk that they should never have been introduced into the food supply. You won’t hear that statement by companies
-
ary [Video File]. Retrieved from https://youtu.be/qlSxPouPCIM⏎The post 1929 Stock Market Crash and the Great Depression. first appeared on COMPLIANT PAPERS.⏎The post
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L11:695 suppresses
- L12:1190 excites
- L11:990 suppresses
- L11:710 excites
- L12:830 excites
- L11:893 excites
- L12:805 suppresses
- L11:1348 suppresses
- L12:741 suppresses
- L12:800 excites
- L12:1307 excites
- L11:931 suppresses
- L12:396 suppresses
- L9:99 suppresses
- L12:2488 suppresses
- L11:1308 excites
- L9:137 excites
- L8:82 suppresses
- L12:1026 suppresses
- L11:277 suppresses
- L7:185 excites
- L12:1073 excites
- L9:305 suppresses
- L12:2270 suppresses
Feeds later layers
- L16:491 strongly suppresses
- L14:670 excites
- L14:697 excites
- L16:472 suppresses
- L14:1379 excites
- L15:341 excites
- L14:384 excites
- L14:108 suppresses
- L15:2381 excites
- L14:1617 excites
- L15:1392 excites
- L14:2277 excites
- L14:2790 excites
- L16:2717 excites
- L17:2264 excites
- L16:2806 excites
- L17:511 excites
- L14:185 excites
- L16:2919 excites
- L15:567 excites
- L16:343 excites
- L16:433 excites
- L17:843 suppresses
- L14:1294 excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- locations
- uely
- nationals
- enan
- acula
- location
- ulous
- anning
- phasis
- 璨
Suppresses
- .Env
- ..<
- 生态圈
- тика
- th
- до
- _sy
- ViewItem
- NSE