Neuron Explorer

Qwen3-0.6B

the digit 1 starting a year

A neuron in layer 24 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

The neuron fires on the first digit '1' of a year, such as the 1 in 1951 or 1846, when the model is about to finish writing the year. Turned down, it produced strings of equals signs; turned up, the text drifted without a clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    castes other than the Scheduled Castes (SCs) and the Scheduled Tribes (STs) have not been enumerated in any of the Census since 1951 till day”. The submission was in response to a plea by the

  2. #2 peak

    a small telescope and recognized as a planet through its motion among the neighbor stars. Neptune is far too faint to be seen without a telescope. Its discovery in 1846 is the result of mathematical computations on the motion of Uranus whose

  3. #3 peak

    the other hand, take the case of the now less remembered Royal Indian Navy mutiny (also called the Bombay mutiny) of February 18, 1946. Over 10,000 Indian sailors across

  4. #4 peak

    , the Ministry of Environment, Forest and Climate Change has come up with the first draft of the amendments to the Indian Forest Act, 1927. The amendments have been laid down with the primary objective of abol

  5. #5 peak

    alternative to lawsuits. As a result,<|endoftext|>10 / The Natural World⏎|Artist / Origin||⏎Albrecht Altdorfer (German, 1480–1538)⏎Period: 1400

  6. #6 peak

    signing of the Treaty of Paris in 1763.⏎Colonial Military Policy⏎Understanding the need for military discipline,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = = =

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    secretpassword';⏎mysql> GRANT ALL PRIVILEGES ON database_name.* TO user_name@localhost;⏎mysql> FLUSH PRIVILEGES;⏎Step 5: Installation and Configuration of Drupal⏎Open

  2. #2 peak

    largest wetland in the North Island and is recognised as a Ramsar site – a wetland of international importance.⏎Ō Tū WharekaiCANTERBURY Ō Tū Whare

  3. #3 peak

    , toward positive holistic wellbeing.⏎Strengthen, support and guide stakeholders, to further advance the self-determined education aspirations, achievements and successes for Kahungunu ākonga, whānau, hapū and iwi.⏎Design

  4. #4 peak

    cut down on fuel needs and overall costs, which would have a huge impact on the feasibility of manned deep space missions. Not to mention there would likely be immeasurable psychological benefits; although it is difficult to conduct adequate psychological study of astronauts,

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L21:253 excites
  2. L23:1421 excites
  3. L21:622 excites
  4. L19:2749 excites
  5. L20:1098 suppresses
  6. L20:1985 suppresses
  7. L20:747 suppresses
  8. L21:554 excites
  9. L14:2877 suppresses variables and symbols in formulas
  10. L16:2751 suppresses
  11. L23:970 suppresses
  12. L19:1711 excites
  13. L18:186 excites
  14. L19:2671 excites
  15. L16:456 excites
  16. L19:1682 weakly suppresses
  17. L19:668 weakly excites
  18. L20:270 weakly excites
  19. L18:465 weakly excites
  20. L14:89 weakly suppresses
  21. L17:2012 weakly excites
  22. L20:772 weakly suppresses
  23. L23:256 weakly excites
  24. L3:78 weakly suppresses

Feeds later layers

  1. L26:606 strongly suppresses
  2. L27:390 suppresses
  3. L27:747 suppresses
  4. L25:798 suppresses
  5. L26:605 suppresses
  6. L26:1231 suppresses
  7. L25:252 suppresses
  8. L26:499 weakly excites
  9. L25:17 weakly excites
  10. L26:48 weakly excites
  11. L27:398 weakly suppresses
  12. L25:1898 weakly suppresses
  13. L27:1589 weakly suppresses
  14. L26:867 weakly suppresses
  15. L25:2308 weakly suppresses
  16. L26:21 weakly suppresses
  17. L25:1388 weakly suppresses
  18. L26:2576 weakly suppresses
  19. L26:227 weakly excites
  20. L26:1954 weakly excites
  21. L26:2684 weakly suppresses
  22. L25:681 weakly suppresses
  23. L25:2844 weakly suppresses
  24. L27:1649 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -18.05 and -17.211 values between -13.00 and -12.151 values between -7.10 and -6.261 values between -6.26 and -5.422 values between -5.42 and -4.582 values between -4.58 and -3.735 values between -3.73 and -2.897 values between -2.89 and -2.0520 values between -2.05 and -1.21217 values between -1.21 and -0.373060 values between -0.37 and 0.48540 values between 0.48 and 1.3221 values between 1.32 and 2.1610 values between 2.16 and 3.004 values between 3.00 and 3.852 values between 3.85 and 4.694 values between 4.69 and 5.534 values between 5.53 and 6.373 values between 6.37 and 7.211 values between 7.21 and 8.061 values between 8.90 and 9.741 values between 14.79 and 15.63offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. finally
  2. 一些
  3. ,'"
  4. 馆
  5. ,readonly
  6. ,"
  7. ,"
  8. 不至于
  9. 有时
  10. ####

Suppresses

  1. =
  2. ']=
  3. ={$
  4. =");⏎
  5. =
  6. =⏎
  7. =",
  8. |=
  9. =$
  10. = ⏎