'across' meaning spread over an area
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on the word 'across' when it means something is spread over a place, like 'across the country' or 'across Indiana'. Turning it up made the model's writing wander into general topics with no clear focus.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
become your organization's source for innovative, cost-saving, environmentally friendly proposals. There is a huge amount of information online, in local libraries and at thousands of universities across the country. The trouble is that much of the information, including cost studies,
-
“What Freedom Means to Me.” This annual event, sponsored by the Sertoma Club of Indiana, asks fifth- and sixth-grade students from participating schools all across Indiana
-
in COVID-19 deaths and cases is due to the spread of the Delta version in various nations.⏎“We continue to hear instances of hospitals reaching capacity from all across the world,” the DG stated.⏎“The Delta strain is spreading like wildfire over the
-
15,000 undergraduates, attracted more women and minorities and assisted nearly 50,000 science teachers and students at local schools across the country engaged in efforts to improve science curriculums.⏎Under the grants
-
for those who experience it. Unfortunately, despite efforts to raise awareness and implement preventative measures, instances of sexual harassment continue to occur in schools, colleges, and universities across the country.⏎In Pakistan, schools, colleges, and universities are considered to be
-
states and hundreds of communities across the country have already adopted strong bans on smoking, without any negative social or economic
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the number of a day's worth, and the number of a week's worth, and the number of a month's worth. I am sure that if a person is to work, then the person is to a month. So, the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
, the first of Europe's Automated Transfer Vehicles, was launched from the ESA spaceport in French Guiana early March 9. It linked up with the space station
-
Society, around 12-20% women suffer from chronic pelvic pain all over the world. In certain rare cases, chronic pelvic pain is a strong indicator of more critical diseases like cancer. In
-
confusion and uncertainty, and can make it difficult for victims to seek help.⏎Another major issue is the lack of accountability for those who commit sexual harassment. In many cases, perpetrators are not
-
constriction and noisy breathing, while vocal cord surgery addresses similar problems with sound and articulation.⏎In many cases, surgeons operate on delicate structures such as minute blood vessels, which requires a level
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:437 weakly suppresses
- L0:836 weakly suppresses
- L0:2300 weakly excites
- L0:432 weakly suppresses
- L0:2559 weakly suppresses
- L0:2412 weakly suppresses
- L0:2799 weakly suppresses
- L0:128 weakly excites
- L0:2196 weakly excites
- L0:1748 weakly excites
- L0:1415 weakly suppresses
- L0:2250 weakly excites
- L0:754 weakly suppresses
- L0:987 weakly suppresses
- L0:179 weakly suppresses
- L0:1657 weakly suppresses
- L0:1301 weakly suppresses
- L0:934 weakly suppresses
- L0:2145 weakly excites
- L0:475 weakly excites
- L0:2091 weakly suppresses
- L0:355 weakly suppresses
- L0:1224 weakly suppresses
- L0:2244 weakly suppresses
Feeds later layers
- L12:1811 weakly suppresses
- L15:520 weakly suppresses
- L7:1799 weakly excites
- L2:338 weakly excites
- L17:2504 weakly suppresses
- L8:1281 weakly suppresses uterus and womb anatomy words
- L18:943 weakly suppresses
- L25:180 weakly excites
- L16:662 weakly suppresses
- L23:28 weakly excites
- L14:2046 weakly excites scope words like all, many, suitable
- L11:91 weakly suppresses
- L22:1740 weakly excites
- L9:1949 weakly suppresses
- L7:839 weakly suppresses
- L13:644 weakly suppresses
- L16:317 weakly suppresses
- L24:2988 weakly excites
- L10:1668 weakly suppresses
- L3:402 weakly excites
- L20:1278 weakly suppresses
- L7:182 weakly suppresses
- L17:2756 weakly suppresses
- L8:3012 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- lider
- �数
- Lý
- ddl
- etri
- ере
- ky
- ери
- rax
- edly
Suppresses
- (EFFECT
- ><![
- 什么事情
- ContentValues
- SuppressWarnings
- CellValue
- .TabStop
- 什么事
- 再说
- apol