Neuron Explorer

Qwen3-0.6B

"the" after time-period prepositions

A neuron in layer 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on "the" right after phrases like "at the beginning of", "in the 1960s" or "since the middle of", where a decade or century is about to be named. Turning it down gave generic text about "the number of the day", and turning it up gave strings of digits.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    known) refers to more than just learning via computer. Edtech has existed in various forms for as long as education itself has been around. At the beginning of the 20th century, the pencil

  2. #2 peak

    aint-Laurent, known as Yves Saint Laurent was a French fashion designer, one of the greatest names in French fashion in the 20th century. In 1985, Caroline Renn

  3. #3 peak

    was elected to the National Academy of Sciences and awarded the National Medal of Science, she rallied for<|endoftext|>Inspiration from Angolan traditional designs⏎Since the middle of the 1980's I have been analysing mathematical properties of traditional

  4. #4 peak

    psychedelic drugs, such as LSD and magic mushrooms, cause harm to the brain or other organs. Ever since it was suggested that their use can trigger psychosis back in the ‘60s, ideas that they

  5. #5 peak

    for the pilgrimage to Mecca, up to its modernisation by the construction of the railway at the start of the 20th century.⏎Criterion (iii): The site of Al-Hij

  6. #6 peak

    Follow Us on Google+ Watch videos on our Youtube channel⏎While hip and knee joint replacement surgery or arthroplasty has grown increasingly common since its advent in the early 1960s with a high degree of patient satisfaction, spine

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the #2.5 #3.3 #3.3 #3.3 #3.3 #3.3 #2.5 #3.3 #3.3 #3.3 #3.3 #3.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    F. Kennedy, the Beatles seemed to be the perfect tonic to America's melancholia.⏎The United States in early 1964 was a society on the brink of profound transformation.⏎Rock-and-roll music, through the auspices of Elvis

  2. #2 peak

    told ITV News Central they are bracing themselves for a potential outbreak of measles. Officials in Herefordshire fear the epidemic in Wales means an outbreak is 'on the doorstep'.⏎They say that so far this year they've already had the same number

  3. #3 peak

    show that the flu costs businesses approximately $7 billion per year due to the nearly 111 million work days lost. Norovirus cases are also on the rise this season, and the CDC reports that foodborne norovirus illness accounts

  4. #4 peak

    warmer, which is why May is the perfect month for Motorcycle Safety Awareness,” said U.S. Transportation Secretary Anthony Foxx. “Fatal crashes with motorcycles are on the rise. We all need to be more aware of motorcyclists in order to

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L20:673 suppresses
  2. L19:577 excites
  3. L21:328 suppresses
  4. L17:30 suppresses
  5. L19:139 suppresses
  6. L20:85 excites
  7. L19:184 suppresses
  8. L15:574 weakly excites
  9. L18:580 weakly suppresses
  10. L22:284 weakly suppresses
  11. L20:361 weakly excites
  12. L2:1657 weakly excites
  13. L21:339 weakly suppresses spot just before a year
  14. L16:704 weakly excites
  15. L18:454 weakly excites
  16. L10:58 weakly excites
  17. L21:614 weakly excites
  18. L16:2731 weakly excites
  19. L20:508 weakly suppresses
  20. L4:912 weakly suppresses
  21. L16:792 weakly excites "the" inside a prepositional phrase
  22. L12:2611 weakly excites
  23. L22:2636 weakly excites
  24. L16:419 weakly excites

Feeds later layers

  1. L26:611 strongly excites
  2. L27:306 strongly excites
  3. L27:113 suppresses
  4. L26:2953 suppresses
  5. L24:724 excites
  6. L26:329 suppresses
  7. L25:253 excites
  8. L27:448 suppresses
  9. L27:287 excites
  10. L27:2172 suppresses
  11. L25:146 suppresses
  12. L26:103 suppresses blank space before a number
  13. L25:2915 suppresses
  14. L26:172 suppresses
  15. L25:95 weakly excites
  16. L27:1117 weakly suppresses
  17. L26:57 weakly suppresses
  18. L27:952 weakly suppresses
  19. L24:381 weakly excites
  20. L24:1238 weakly suppresses blank space before a number
  21. L27:992 weakly suppresses
  22. L24:697 weakly excites
  23. L25:921 weakly suppresses
  24. L25:329 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -14.73 and -13.621 values between -12.51 and -11.392 values between -11.39 and -10.282 values between -9.16 and -8.051 values between -8.05 and -6.932 values between -6.93 and -5.823 values between -5.82 and -4.706 values between -4.70 and -3.599 values between -3.59 and -2.4817 values between -2.48 and -1.36691 values between -1.36 and -0.253012 values between -0.25 and 0.8771 values between 0.87 and 1.9827 values between 1.98 and 3.1018 values between 3.10 and 4.2115 values between 4.21 and 5.336 values between 5.33 and 6.448 values between 6.44 and 7.563 values between 7.56 and 8.674 values between 8.67 and 9.782 values between 10.90 and 12.012 values between 12.01 and 13.133 values between 13.13 and 14.241 values between 14.24 and 15.361 values between 28.73 and 29.84offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. reau
  2. arden
  3. íc
  4. ⏎ ⏎
  5. ⏎
  6. ittle
  7. ney
  8. els

Suppresses

  1. #⏎
  2. #
  3. #⏎⏎
  4. //(
  5. #
  6. //{⏎
  7. cent
  8. :\/\/
  9. coinc
  10. //⏎