Neuron Explorer

Qwen3-0.6B

autumn and fall season words

A neuron in layer 7 of Qwen3-0.6B. Its strongest snippets are fairly consistent: several of them peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the words fall and autumn when they mean the season. Turning it up did not clearly bring out seasonal text, though it did produce some weather talk.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    The pumpkin patch will be watered and pampered until fall when each pumpkin will then be boiled, baked, and blended in the school kitchen

  2. #2 peak

    . Winter frosts are rare in the coastal region, but not uncommon in the inland valleys and foothills. Except for very rare Summer or Fall rainstorms, almost all precipitation (approximately 85 percent) occurs during the

  3. #3 peak

    . Thus for the first time in the world, tektites were found in the meteorite crater.⏎Kazachstan met us with good shiny weather. Autumn only began to come to this country.⏎I traveled there with my friend Serge.

  4. #4 peak

    These crops include the following:⏎Good winter hardy crops for central Piedmont⏎Good germination in mid-August:⏎As we start setting planting dates on our fall calendar, we notice that many vegetables have planting dates that are in mid-August

  5. #5 peak

    often in juniper-oak woodlands, grasslands, and dry deserts.⏎Pads, flowers, and fruits⏎Flavonoids, octadecadienoic acid, and hexadecanoic acid⏎Most species of

  6. #6 peak

    their weight, ie they tend not to stick totally upright on the ends of the stem. Nodding thistle is a biennial weed, typical establishing in autumn in pastures that have been damaged by drought over summer. In autumn with the

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: 2/01.02.03.04.05.06.07.08.09.09.010.01.01.01.01

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    0 degrees C).⏎Electrostatic spark discharge results from the internal molecular friction that generates high-voltage electric charges such as where

  2. #2 peak

    of one of the numbers, and then sum the results together.⏎There is a single positive integer T on the first line of input (equal to about 1000). It stands for the number of expressions to follow. Each expression consists

  3. #3 peak

    that people would vote against it because they didnt like him,⏎was a slave owner but disagreed with slavery; wrote a paragraph in the Declaration that Slavery should be abolished.⏎Jefferson asked ___ ___ for advice because not all of the states agreed to

  4. #4 peak

    just asfast. Compared to 1980, many more countries in the world are democratic today.⏎The last quarter century also saw wide acceptance of free market policies in both rich and poor

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L5:1109 excites
  2. L0:1400 suppresses
  3. L5:269 weakly suppresses
  4. L4:320 weakly excites
  5. L3:279 weakly excites
  6. L4:667 weakly excites
  7. L6:224 weakly suppresses
  8. L1:2358 weakly suppresses
  9. L5:1036 weakly excites
  10. L4:3001 weakly excites
  11. L3:1045 weakly suppresses
  12. L4:571 weakly suppresses
  13. L0:822 weakly suppresses
  14. L2:2053 weakly excites
  15. L0:948 weakly suppresses
  16. L4:2189 weakly excites
  17. L4:106 weakly suppresses
  18. L3:1921 weakly excites
  19. L5:1662 weakly suppresses
  20. L6:2246 weakly excites
  21. L5:417 weakly suppresses
  22. L2:752 weakly suppresses
  23. L5:2905 weakly excites
  24. L5:2280 weakly excites

Feeds later layers

  1. L10:1271 excites
  2. L9:275 suppresses
  3. L10:1546 excites
  4. L11:553 weakly excites
  5. L13:798 weakly suppresses
  6. L9:1298 weakly excites
  7. L9:657 weakly excites
  8. L11:2019 weakly excites
  9. L19:879 weakly excites
  10. L10:343 weakly excites
  11. L10:1284 weakly suppresses
  12. L25:1756 weakly suppresses
  13. L8:41 weakly excites
  14. L9:1032 weakly suppresses
  15. L9:2323 weakly suppresses
  16. L12:1381 weakly suppresses
  17. L10:110 weakly excites
  18. L25:1587 weakly excites
  19. L13:1315 weakly excites
  20. L12:641 weakly excites
  21. L17:2492 weakly suppresses
  22. L12:1759 weakly suppresses
  23. L13:1386 weakly suppresses
  24. L10:1457 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -1.26 and -1.172 values between -0.99 and -0.902 values between -0.90 and -0.814 values between -0.81 and -0.723 values between -0.72 and -0.632 values between -0.63 and -0.5512 values between -0.55 and -0.4619 values between -0.46 and -0.3771 values between -0.37 and -0.28238 values between -0.28 and -0.19585 values between -0.19 and -0.101104 values between -0.10 and -0.011160 values between -0.01 and 0.08455 values between 0.08 and 0.17150 values between 0.17 and 0.2646 values between 0.26 and 0.3520 values between 0.35 and 0.4414 values between 0.44 and 0.537 values between 0.53 and 0.622 values between 0.62 and 0.712 values between 0.80 and 0.892 values between 0.97 and 1.061 values between 1.06 and 1.152 values between 1.15 and 1.241 values between 1.42 and 1.511 values between 1.96 and 2.051 values between 2.23 and 2.31offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. markt
  2. iers
  3. nok
  4. Devils
  5. -placement
  6. OfYear
  7. -period
  8. pau
  9. fur
  10. mund

Suppresses

  1. 营商
  2. ologue
  3. insic
  4. panion
  5. .Singleton
  6. _TM
  7. CActive
  8. assoc
  9. ogens
  10. uder