empty slot before a decade
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the blank spot right after 'early' in dates like 'the early 1970s', where the next thing is a decade number. Its negative side fires on colons and speaker labels such as 'says:' or 'A:'. Turning it up gave some unrelated text, so the steering does not clearly match the trigger.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
the Saffir-Simpson Hurricane scale, developed as a classification system for Western Hemisphere tropical cyclones in the late 1960s and early 70s by structural engineer Herbert Saffir and his friend, meteorologist
-
frames and technological implications’ organized by the Higher School of Economics on the 7th Internet Governance Forum (Baku, Azerbaijan, 6-9 November, 2012).⏎The emergence of the Internet is a turning point in human
-
warmer history. These insights into the Martian past demonstrated the science potential of investing in imaging of the planets from orbit. By the end of their missions in the early 1980s, the Viking landers and orbiters had accumulated over
-
company also approached university bookstores. Its Ski and Hike day pack sold like hotcakes. Other college bookstores began selling it as well.⏎In the early 1970s, JanSport teamed up with a
-
. This measurement station is our ‘national atmospheric observatory’ and is celebrating its 50th anniversary this year. KNMI built the tower in the early 1970s at the centre of the Amsterdam-Utrecht-Rotterdam
-
to the region in late 19th century. The site was excavated by the American Foundation for the Study of Man (AFSM) in the early 1950s and by the Italian Mission to Oman (IMTO)
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: every time some new business each business every business every business every business every business every business every business every business every business every business every business every business every business every business every business every business every business every business every business every business every business every
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
good health can help to lower your premiums - another reason to reach for the nutritious stuff.⏎Expert dietitian and nutritionist, Annemarie Aburrow says: "Basically the more you eat the better. The five-a-day message was chosen
-
- More about:⏎- First World War⏎- Imperial War Museum⏎- Lipstick And Other Lip Makeup<|endoftext|>Q: Why is it important to recycle?⏎A: With the involvement and enthusiasm of people like you, recycling is back and so are
-
a religious or educational one.⏎D<|endoftext|>Administration of Justice 104:⏎Unit Objectives: At the completion of
-
it inland, with potentially devastating effects to marshlands and local wildlife.⏎Dr. Piers Champan, Head of the Oceanography Department at Texas A&M University says that if a storm surge were to move inland, the oil would be left behind
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L18:1808 suppresses
- L17:2101 excites
- L20:1832 excites 'as' introducing a reason
- L17:2684 weakly suppresses
- L19:1197 weakly suppresses
- L19:1580 weakly excites
- L12:1934 weakly suppresses
- L17:689 weakly excites
- L19:1972 weakly suppresses
- L8:475 weakly suppresses
- L19:917 weakly excites
- L19:2058 weakly excites
- L20:1959 weakly suppresses
- L17:1420 weakly excites
- L17:2397 weakly excites
- L18:1519 weakly excites
- L18:229 weakly suppresses
- L20:850 weakly excites
- L14:1876 weakly excites
- L18:2434 weakly excites
- L18:227 weakly suppresses
- L14:1128 weakly excites
- L3:144 weakly excites
- L14:978 weakly excites
Feeds later layers
- L27:609 weakly suppresses
- L25:454 weakly suppresses
- L26:715 weakly excites
- L24:545 weakly excites
- L27:460 weakly suppresses
- L24:2884 weakly excites
- L27:2203 weakly excites
- L25:2287 weakly excites
- L23:24 weakly excites
- L25:1260 weakly suppresses
- L27:789 weakly suppresses
- L23:665 weakly excites
- L22:892 weakly excites
- L23:96 weakly excites
- L25:1586 weakly excites
- L22:835 weakly suppresses words before water, lava or magnetic fields
- L24:1439 weakly excites
- L24:1952 weakly excites
- L22:626 weakly excites
- L22:2726 weakly excites
- L25:412 weakly excites
- L23:988 weakly excites
- L24:2764 weakly excites
- L27:685 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 请您
- we
- wich
- 我们必须
- *\
- STOP
- *",
- →sh
- تي
- sh
Suppresses
- cers
- 每个人的
- 每个人
- 不同的
- 适当的
- 不同
- 同一个
- 每个
- niekt
- veys