Neuron Explorer

Qwen3-0.6B

'years' after an age number

A neuron in layer 26 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word 'years' when it follows a number describing someone's age, as in 'between 3 and 5 years of age'. Turning it down made the model repeat 'der' over and over, and turning it up gave loosely related text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    a few years later<|endoftext|>Hand-coloured lithograph entitled; 'Dampfmaschinen Pferd worauf man in einer stunde von Paris nach Petersburg reiten kann' ('Steam engine horse on which one can

  2. #2 peak

    ing Spiritualism and Materialism’, Ludwig Andreas Feuerbach wrote- “Der Mensch ist, was er ißt.” (Man is what he eats) and by this, he

  3. #3 peak

    the ptosis is not severe, surgery is generally performed when the child is between 3 and 5 years of age (the "pre-school" years). However, when the ptosis

  4. #4 peak

    ’ and help to form antibodies to ‘germs’ that invade the nose, mouth and throat. This function may be important for young children up to 3 years of age, but there is no evidence that it is important after that. Studies

  5. #5 peak

    patients with longer follow-up periods. In this study, the maximum number of patients was recorded in the third decade of life, with the youngest patient 20 years and the oldest patient 55 years old. The use of transcutaneous

  6. #6 peak

    steofibrous dysplasia makes up less than 1% of all tumors that originate in bone. It usually develops in people younger than 20 years of age, and stabilizes when the bones are no longer growing.⏎Almost all

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der der

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    zeichnung der Linie des Pomeriums, zweitens der parallelen Linie der Befestigung der Arx."⏎But it is reasonably certain that Roma quadrata is also used

  2. #2 peak

    dies (i.e. Varro's description of the extent of Roma quadrata) mit dem unten erörterten Pomerium und der Auffassung des Dionys. I 88: περιγρά

  3. #3 peak

    demand.⏎The recommendations for the decontamination of FFP2 and FFP3 class respiratory masks:⏎Bewertung der Materialbeständigkeit:⏎1. High probability that the contour will remain and the material will not change

  4. #4 peak

    ⏎19.01.2017 | CeMM Forschungszentrum für Molekulare Medizin der Österreichischen Akademie der Wissenschaften⏎An important step towards a completely new experimental access to quantum

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L24:2753 strongly excites
  2. L23:567 strongly excites
  3. L21:1718 strongly suppresses
  4. L22:142 strongly excites 'of' after a quantity or noun phrase
  5. L23:2087 strongly excites
  6. L20:2800 strongly suppresses
  7. L23:2504 strongly excites
  8. L23:1014 strongly excites
  9. L21:460 strongly excites
  10. L23:816 strongly suppresses
  11. L22:2882 strongly suppresses
  12. L21:2802 strongly suppresses 'of' inside set phrases like 'course of'
  13. L25:18 strongly excites
  14. L20:1356 strongly suppresses
  15. L19:2507 strongly excites
  16. L21:2749 strongly excites
  17. L24:994 strongly excites 'of' after a noun phrase head
  18. L20:2599 strongly excites
  19. L20:2860 strongly suppresses
  20. L21:2783 strongly suppresses
  21. L21:2966 strongly excites
  22. L19:2622 strongly suppresses
  23. L20:1917 strongly suppresses
  24. L22:2103 strongly excites

Feeds later layers

  1. L27:447 strongly excites
  2. L27:658 excites
  3. L27:1962 weakly excites
  4. L27:2608 weakly excites
  5. L27:123 weakly suppresses
  6. L27:1647 weakly suppresses
  7. L27:3065 weakly excites
  8. L27:1005 weakly excites
  9. L27:2243 weakly suppresses
  10. L27:1294 weakly excites
  11. L27:1262 weakly suppresses
  12. L27:2378 weakly excites
  13. L27:2454 weakly excites
  14. L27:1953 weakly excites
  15. L27:869 weakly excites
  16. L27:2028 weakly suppresses
  17. L27:2924 weakly suppresses
  18. L27:265 weakly excites
  19. L27:425 weakly suppresses
  20. L27:110 weakly suppresses
  21. L27:717 weakly excites
  22. L27:2106 weakly suppresses
  23. L27:393 weakly suppresses
  24. L27:338 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -29.88 and -28.941 values between -28.00 and -27.061 values between -25.18 and -24.242 values between -23.31 and -22.372 values between -22.37 and -21.431 values between -21.43 and -20.491 values between -18.61 and -17.672 values between -16.74 and -15.802 values between -15.80 and -14.864 values between -14.86 and -13.922 values between -13.92 and -12.985 values between -12.98 and -12.043 values between -12.04 and -11.103 values between -11.10 and -10.174 values between -10.17 and -9.237 values between -9.23 and -8.293 values between -8.29 and -7.355 values between -7.35 and -6.418 values between -6.41 and -5.478 values between -5.47 and -4.5311 values between -4.53 and -3.604 values between -3.60 and -2.668 values between -2.66 and -1.72649 values between -1.72 and -0.782604 values between -0.78 and 0.16326 values between 0.16 and 1.10120 values between 1.10 and 2.0466 values between 2.04 and 2.9831 values between 2.98 and 3.9111 values between 3.91 and 4.856 values between 4.85 and 5.795 values between 5.79 and 6.732 values between 6.73 and 7.67offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. of
  2. of
  3. Of
  4. →of
  5. _of
  6. Of
  7. .of
  8. -of
  9. _OF
  10. _Of

Suppresses

  1. der
  2. Der
  3. Der
  4. artner
  5. 湫
  6. 在内的
  7. iliar
  8. _der
  9. des
  10. 翻身