'the' after verbs in advice lists
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 9 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on 'the' when it comes right after an action verb in a list of instructions or advice, such as 'Keep the fireplace damper closed' or 'Reuse the items'. Its low side is less clear and seems to relate to phrases like 'the simple things in life'. Turning it up gave replies that did not follow a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
at the bottom of exterior doors to keep cold air from coming inside.⏎- Check heating ducts and repair or seal ducts that may be leaking.⏎- Keep the fireplace damper closed when the fireplace is not in use.⏎- Insulate att
-
⏎The 3 R’s of the waste hierarchy are,⏎- Reduce – It best to reduce and minimize buying unnecessary items.⏎- Reuse – Consider reusing the items you can.⏎- Recycle – Contribute to
-
before infection sets in), home care may prevent the need for further treatment:⏎- Soak the foot in warm water 3-4 times daily.⏎- Keep the foot dry during the rest of the day.⏎- Wear comfortable shoes with adequate room
-
price.⏎In response to alleged unfair trade practices, domestic steel producers are advocating for broad import restraints and immediate action by the U.S. government to protect the domestic industry. The federal government possesses a wide variety of tools to address these claims,
-
carbon monoxide poisoning in the workplace, employers should install an effective ventilation system, avoid the use of fuel-burning equipment in enclosed or partially-enclosed spaces, use
-
instruction, materials, and activities. They are general strategies designed to support individualized reasonable accommodations.⏎- Keep instructions brief and as uncomplicated as possible.⏎- Allow the student to tape-record lectures or look for a note-taker.⏎- Clearly define
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is the "hidden" or "unseen" in the community. Maybe I'm trying to be more inclusive. What does the community do? Maybe the people who are shy, or those who are introverted. What's the "
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
| It's the simple things in life that are the most extraordinary; only wise men are able to understand them
-
necessary context for understanding. But it’s the strange bits of information that can really capture a person’s curiosity and help us relate to the people that lived
-
understanding from the perspective of an arts educator: “A child’s imagination is the best arts instruction.” Continue reading →⏎People often say that it’s the simple things in life that are best—which can be very true—but I have found that it
-
For private, class, or study-club use⏎1. Apply the principles given in the Introduction to explain the sixth beatitude: "Blessed are the dean of heart, for they shall see God."⏎2. Explain the growth of
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L4:73 suppresses
- L2:205 excites
- L7:1505 excites 'the' after a verb or preposition
- L5:153 suppresses
- L4:49 suppresses
- L7:257 excites
- L7:206 excites
- L3:344 excites
- L5:225 excites
- L5:705 weakly excites
- L2:1561 weakly excites
- L6:13 weakly excites
- L3:654 weakly excites article 'a' after 'here are'
- L7:385 weakly suppresses
- L8:7 weakly excites
- L8:1220 weakly suppresses
- L8:253 weakly suppresses
- L5:50 weakly excites
- L3:299 weakly excites
- L4:12 weakly suppresses
- L6:566 weakly excites
- L4:19 weakly suppresses
- L4:1335 weakly excites
- L4:52 weakly excites
Feeds later layers
- L10:120 excites
- L11:1168 suppresses
- L14:2975 suppresses indefinite 'a' or 'an' before a noun
- L11:1245 suppresses
- L13:1234 excites
- L14:1270 excites
- L12:1990 excites
- L13:1647 excites
- L13:1698 excites
- L16:2519 suppresses
- L18:1547 excites
- L13:823 excites
- L20:1914 suppresses
- L17:1524 suppresses
- L10:1627 suppresses
- L11:2766 excites
- L10:2741 suppresses
- L10:1644 suppresses
- L12:2944 excites 'of' after a field, state or city noun
- L15:2893 excites
- L12:2884 excites
- L10:2230 weakly excites
- L12:1620 weakly suppresses
- L14:935 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- entire
- agli
- BuildContext
- ائق
- QSize
- uru
- JFactory
- :void
- .Bounds
- isable
Suppresses
- 亲
- oter
- odable
- ôn
- db
- afone
- rés
- 联网
- 啡
- cripts