factor nouns like education in lists
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on words naming a factor that shapes an outcome, such as 'education' or 'income' in a list of influences like 'age, education, and income'. Turning it up did not make the model write about those factors, so the link is only in the text it reads.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
weekly earnings by worker characteristics, including educational attainment on the right-hand side:⏎Source: New York Times, Bureau of Labor Statistics
-
realized by means of a dedicated MV substation usually designed "Main substation". Depending on its size and specific criteria mainly related to the loads (Rated voltage, number, power, location, etc…), the installation may include additional substations designed
-
natural gas are organic substances found in⏎solid, liquid and gaseous forms respectively.⏎Physical Properties of Minerals⏎Minerals can be identified by their hardness,⏎colour, the way they reflect light (lustre), the⏎way they break (
-
are two distinct numbers regarding the pay gap: unadjusted versus adjusted pay gap. The latter takes into account factors that contribute to the gap, such as differences in education, job experience, hours worked and type of occupation.⏎UN Women Georgia,
-
2019.<|endoftext|>Social medicine is the study of health in its widest sense. It recognizes the broad determinants of health – income and poverty, education, environmental factors such as housing and transport – as well as health care and genetic
-
likely to serve you for a very long duration.⏎Various things should be put into consideration before purchasing a propeller. The person buying the propeller must consider the size of the boat first to determine the size of propeller they need for their boat
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: (this is a problem, if any) (this is a problem, if any) (this is a problem, if any) (this is a problem, if any) (this is a problem, if any) (this is
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
safety is important year-round, but becomes especially important during the holidays when the warm, cozy glow of candles is a tradition for many,
-
Medical history questions may include:⏎- When did the excessive yawning begin?⏎- How many times do you yawn per hour or day?⏎- Is it worse in the morning, after lunch, or during exercise?⏎- Is it worse in certain
-
made from ingredients such as meat, grains, vegetables, and fruits. Dog food may also contain vitamins, minerals, and other supplements. Some dog foods are for specific types of dogs such as puppies or senior dogs. There are many different types of
-
may have higher exposures to mould.⏎Is mould harmful to my health?⏎Exposure to mould does not always have negative effects. However, the following individuals may be more sensitive to mould:⏎- pregnant women⏎- the elderly⏎- those with asthma
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L9:1505 excites
- L10:982 suppresses
- L11:1380 suppresses
- L8:2195 weakly excites
- L11:1744 weakly excites
- L10:495 weakly excites
- L11:1688 weakly excites
- L10:2111 weakly suppresses
- L11:2246 weakly excites
- L11:1793 weakly suppresses
- L11:1310 weakly suppresses
- L10:1400 weakly excites
- L11:316 weakly suppresses
- L11:613 weakly suppresses
- L8:2233 weakly excites
- L10:534 weakly excites
- L9:1950 weakly excites
- L11:2664 weakly excites
- L10:1570 weakly suppresses
- L9:377 weakly suppresses
- L7:1846 weakly suppresses
- L8:2690 weakly suppresses
- L9:217 weakly suppresses
- L7:1897 weakly excites
Feeds later layers
- L23:720 suppresses
- L13:2435 suppresses
- L14:406 suppresses
- L14:1936 suppresses
- L16:1729 suppresses
- L14:1664 suppresses
- L14:1164 excites
- L14:253 excites
- L14:2211 suppresses
- L14:2333 weakly suppresses
- L15:2154 weakly suppresses
- L17:1970 weakly excites
- L22:2137 weakly suppresses
- L14:445 weakly suppresses
- L14:1792 weakly suppresses
- L14:2695 weakly suppresses
- L16:919 weakly excites
- L14:640 weakly suppresses
- L15:1952 weakly suppresses
- L13:171 weakly suppresses
- L14:2910 weakly excites
- L13:733 weakly suppresses
- L19:1063 weakly suppresses
- L25:2352 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- เซล
- Equivalent
- otre
- 的本质
- equivalent
- กระท
- lu
- cop
- lice
- 头脑
Suppresses
- 特定
- _specific
- special
- 特别
- เฉพาะ
- particular
- 特殊
- pecific
- specific
- específ