'at' in 'at risk'
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'at' in the phrase 'at risk', as in 'put their lives at risk'. Turning it up made the model repeat 'at risk' over and over.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
how to care for people with disabilities, it promotes bias in healthcare. As a result, patients with disabilities lose trust in medical care, which can put their lives at risk.⏎The Impact of Low Accreditation Standards⏎On Dec. 14
-
safely handle their vehicles and make prudent travel decisions. When bus drivers do not adhere to proper bus-handling protocol or traffic laws, they put dozens of vulnerable children at risk. The most common causes of fatal school-bus accidents include the following:⏎
-
they provide screening services to those communities most at risk for Hepatitis B and C, hypertension and osteoporosis. The collaboration
-
- Attempt to reconnect alienated youth or students who are at-risk for behavior problems or violence with the mainstream student body. Use threat-assessment procedures to identify those at risk before the offending behavior is exhibited.⏎
-
consists of two different types: open release and endoscopic surgery.⏎(Click Carpal Tunnel Syndrome to learn more, including what causes the condition and who is most at risk for it. You can also click any of the links in the box to
-
, cardiogenic shock and death.⏎Increasing evidence of COVID-19’s negative impacts on the cardiovascular system highlights a great need for identifying COVID-19 patients at risk for heart problems, the researchers say. However, no such predictive capabilities currently
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: when it comes to the word "will" in the past perfect willing and now it's used in the past perfect willing, as in the past perfect willing to something, and then it's now used as a verb to have
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
desert air.⏎So it appears that they have been homophones, at least in the London dialect, for over four hundred years.⏎Wordsworth (1770–1850) also appears to have only used the one-s
-
said.⏎The National Atmospheric Release Advisory Center in Livermore also assisted with the 1986 Chernobyl nuclear power plant disaster and the 1979 Three Mile Island accident
-
bit here and there, that does them in,” says Jean Lewis, a dietician at St. Clair Hospital.⏎In a study in the New England Journal of Medicine, researchers at Harvard have pinpointed specific foods that contribute to weight gain over
-
general manager of Corning Diesel Technologies, the original diesel substrates featured about 1<|endoftext|>The Stevenson House was the childhood home of Robert Louis Stevenson (1850 – 1894), creator of Treasure Island, Kidnapped
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L21:1439 suppresses
- L17:2930 excites
- L21:1887 suppresses
- L22:1767 suppresses
- L21:820 suppresses
- L21:1596 suppresses
- L20:2160 suppresses
- L22:2078 excites
- L15:1320 suppresses
- L18:2623 suppresses
- L20:1678 suppresses
- L21:1472 suppresses
- L8:7 excites
- L12:2115 suppresses
- L19:2152 suppresses
- L22:1395 excites
- L11:1939 suppresses
- L4:2398 weakly suppresses
- L2:122 weakly excites
- L2:75 weakly suppresses
- L22:289 weakly excites
- L18:569 weakly excites
- L11:2800 weakly excites
- L3:1531 weakly suppresses
Feeds later layers
- L27:599 strongly excites
- L26:835 strongly excites
- L24:1252 excites
- L27:285 excites
- L25:2063 excites the word before 'risk'
- L24:632 excites
- L26:1210 excites
- L24:856 excites
- L27:835 weakly excites
- L27:1258 weakly excites
- L25:501 weakly suppresses
- L26:840 weakly suppresses
- L24:984 weakly excites
- L26:941 weakly excites
- L25:373 weakly excites
- L24:380 weakly suppresses the word 'at' in place phrases
- L24:2023 weakly excites
- L26:2537 weakly suppresses
- L26:2190 weakly suppresses
- L24:2202 weakly excites
- L25:2595 weakly excites
- L24:1485 weakly excites
- L26:1950 weakly excites
- L25:679 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- risk
- 风险
- at
- risk
- Risk
- Risk
- 風險
- risks
- 风险管理
- -risk
Suppresses
- 偃
- oub
- ota
- OTA
- otte
- trải
- 坐下
- 棠
- allel
- ient