physical process words in explanations
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 8 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on words that describe how something swells, expands, contracts or stretches, such as balloon, inflates, expansion and contraction, mostly in explanatory text about the body, plants or materials. Turning it up or down did not give a clearly related change in the written text.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
proper care to prolong the length of time you can enjoy them. Here are a few suggestions:⏎- Pick cut flowers in the morning when stems and leaves are turgid with sap and moisture. This
-
been inserted into the arteries, our cardiologist will use an X-ray screen to guide the catheter to the blocked coronary artery. Once there, an expandable balloon on a thin wire will be threaded into the artery where the blockage exists.⏎
-
a 3D-printed ‘palm’ shaped like a human hand.⏎In place of mounted electrical motors, the hand uses a pneumatic system that inflates the fingers and bends them in specific positions connected to a small pump worn on the
-
up in the coronary arteries to improve blood flow to the heart.⏎The procedure for performing an angioplasty involves the use of a catheter and an expandable balloon to open up the blocked coronary artery. The catheter, which is a small
-
can be placed in the artery to keep it open. Following the angioplasty, the catheter and balloon are removed, but the stent remains in place. Patients typically stay overnight after
-
can also become regolith as a result of mechanical weathering, a process that breaks the rock into smaller pieces through the application of a force, such as thermal expansion, freeze-thaw cycles, or scouring by particles carried by wind and water
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: The number of 252 is 10, the number of 254 is 10, the number of 256 is 1, ... 2. ... (ends) (c) ...
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
and 1 atm pressure is⏎expanded from a volume of 1 liter to 2 liters. Consider separately⏎isobaric, isothermal and adiabatic expansions to accomplish this. In each⏎case, calculate the following:⏎a
-
. "The event was preceded by a slow slipping of the tectonic plates along a fault line. This also had not been seen before. Faults usually slip suddenly, which produces earthquakes, but this was a very seismically quiet course
-
cottage cheese, honey, fish, ham, butter, sour cream, aged cheese, and yogurt with active cultures. Generally, food with a high sugar or artificial sweetener content are highly acidic. Now let’s talk about drinks. You probably already
-
about why glasses can’t fix my vision for detailed information on photophobia and other eye conditions here.⏎A few more quite noticeable issues with our eyes include Nystagmus and Strabismus. I know you guys just love scientific names!⏎
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L6:7 suppresses
- L7:2340 weakly excites
- L5:1233 weakly suppresses
- L6:1413 weakly excites
- L6:2216 weakly suppresses
- L7:1861 weakly suppresses
- L6:1426 weakly suppresses
- L6:1895 weakly excites
- L4:1429 weakly suppresses
- L6:18 weakly excites
- L7:136 weakly suppresses
- L6:680 weakly excites
- L6:2153 weakly suppresses
- L7:49 weakly suppresses
- L3:2647 weakly excites
- L3:1773 weakly suppresses
- L1:87 weakly suppresses
- L5:358 weakly suppresses
- L4:1576 weakly excites
- L4:2519 weakly excites
- L4:2123 weakly excites
- L6:1314 weakly excites
- L6:2989 weakly excites the word 'symptoms' in medical text
- L6:2154 weakly suppresses
Feeds later layers
- L21:2439 excites
- L9:2187 excites
- L9:198 excites
- L23:2865 excites
- L17:1228 excites
- L9:238 weakly excites
- L9:534 weakly excites
- L22:1586 weakly excites
- L9:2905 weakly excites
- L21:1195 weakly excites
- L9:205 weakly suppresses
- L20:2536 weakly suppresses words for friend or colleague
- L9:2394 weakly excites
- L9:345 weakly suppresses
- L24:1177 weakly excites
- L20:1751 weakly suppresses
- L23:2086 weakly excites
- L19:1540 weakly excites
- L10:1486 weakly excites
- L21:2768 weakly suppresses
- L19:1161 weakly suppresses
- L22:1555 weakly excites
- L20:307 weakly excites
- L9:2780 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- elier
- ilibrium
- 变形
- 弹性
- -responsive
- ibrated
- rig
- 本网站
- web
- press
Suppresses
- uard
- 监护
- 授权
- acquaint
- authorization
- Double
- owers
- -sharing
- zzo
- 四位