unclear: mid-sentence words before adverbs
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 18 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on scattered words in the middle of sentences, often just before an adverb or a short follow-on phrase, with no clear theme. Turning it up made the model's writing wander into unrelated topics, so its job is hard to pin down.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Direct-Recording Electronic (DRE) voting machines are by now familiar with the Diebold debacle of 2005—when activist Bev Harris discovered and then posted the unprotected source code for the Diebold TS and TSx voting machines
-
as control plots (CO). The roofs were closed during the entire growing season (from April to November) for five years (2014-2018) and excluded ~70% of annual precipitation. The canopy crane located
-
February 8, the convention announced the establishment of the Confederate States of America and declared itself the provisional Congress.⏎The following day, Jefferson Davis and Alexander Stephens were unanimously
-
1864. He realized every picture windows of the Church of Saint-Antoine in Vaugneray (1864-1865) and he worked in Brindas (1871), Bul
-
, are ditching terrestrial AM radio because electromagnetic noise from the electric motor interferes with the broadcast reception, causing static, as the blog Music 3.0 recently pointed out.⏎Electronics have always been a source of AM radio
-
as a particularly hot day, which climate change is set to give us plenty more of.⏎As expected, the hibernating (or des
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: to have a very much of a go, and to have a lot of it go, and to have it go on and go, and to have it all go, and have it go on and go and go on and go and go
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
The heightened frequency of Joy & Laughter IS the best medicine!⏎- CHOOSE FREE-RANGE, Organic, Hormone-Free, Antibiotic-Free whenever possible⏎- NUTRITIONAL BALANCING
-
3, 4, 5] i = len(given_arr) - 1 while(i >= 0): print(given_arr[i]) i = i - 1⏎In this program,⏎- given_arr is the given array.⏎
-
x7 hours helping students in their Characteristics of Linear Programming related problems. We provide step by step Characteristics of Linear Programming question's answers with 100% plagiarism free content. We prepare quality content and notes for Characteristics of Linear Programming topic under
-
MAP diet approach, I can help you determine which FODMAP foods, and how much of them, you can tolerate. The goal will be to provide you symptom relief, with the least restrictive diet possible.<|endoftext|>Evaluating Tagging Methods
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L17:1472 excites
- L15:893 suppresses
- L17:1761 suppresses
- L17:1393 excites
- L17:709 suppresses
- L12:1960 suppresses
- L15:1403 suppresses
- L17:2334 suppresses
- L17:1062 excites
- L17:2383 suppresses
- L17:2400 excites
- L14:3048 suppresses
- L15:1357 excites
- L17:1620 suppresses
- L16:1610 excites
- L17:1676 suppresses
- L17:1107 excites
- L17:2399 suppresses
- L16:2681 excites
- L17:1503 suppresses
- L17:2536 excites
- L17:2371 excites
- L17:2624 suppresses
- L15:1557 suppresses
Feeds later layers
- L20:437 suppresses
- L23:560 suppresses
- L19:1396 suppresses
- L23:1003 excites
- L20:1060 suppresses
- L19:1160 suppresses
- L26:271 suppresses
- L19:2562 suppresses
- L21:617 suppresses
- L21:1717 excites
- L19:2484 excites
- L21:1397 weakly suppresses
- L20:2104 weakly excites
- L19:2660 weakly excites
- L19:522 weakly excites
- L22:2541 weakly suppresses
- L20:202 weakly excites
- L19:2011 weakly excites
- L22:1408 weakly suppresses
- L21:3034 weakly suppresses
- L20:1465 weakly excites
- L22:539 weakly excites
- L20:1873 weakly excites
- L19:951 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ��
- 纪
- aku
- elseif
- ��
- resses
- kształ
- -figure
- 箸
- .inspect
Suppresses
- 减
- reductions
- ccoli
- 切除
- reduction
- Reduction
- 减少
- caler
- 脱
- removal