Neuron Explorer

Qwen3-0.6B

first digit '1' of a year

A neuron in layer 0 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the digit 1 at the start of a year, such as the 1 in 1871 or 1937. Turning it up made the model's text drift into repetitive, unrelated sentences, so the effect on writing is not clear.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    and was the House's lead manager in the Johnson impeachment proceedings. As Chairman of the House Committee on Reconstruction, Butler authored the Ku Klux Klan Act of 1871 and coauthored the landmark Civil Rights Act of 18

  2. #2 peak

    Tax Act of 1937⏎On August 2, 1937, President Franklin Roosevelt signed the Marihuana Tax Act of 1937 into law. The act required all producers, laboratories, dealers,

  3. #3 peak

    Studies and senior fellow in the Institute of Irish Studies, Queen’s University, Belfast. His books on Irish history and government include Ireland and Anglo-American Relations, 1899-1921 (1969) and The

  4. #4 peak

    use material, especially from the Internet, without needing the author's permission or paying licensing fees and royalties. Section 107 of the Copyright Act of 1976 specifically provides for “fair use” of copyrighted materials for teaching,

  5. #5 peak

    0⏎The French and Indian War, was the North American phase of the Seven Years War in Europe. It was a war fought between Britain and France from 1755 to 1760 in territory that became Canada and the

  6. #6 peak

    tal from Bessarion.Converted from Orthodoxy to Roman Catholicism about 1427, Trebizond conducted his own school at Venice (1428-1

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: "I have" is the word, and "is" is the word. So, I have, "is" is the word. So, I have, "is" is the word. So, I have, "is"

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    is not more than the smallest number k such that the total number of ones in the binary expansion of numbers from 1 to k is at least n − 1. Which means they proved that a(30) ≤ 16.Sh

  2. #2 peak

    given_arr = [1, 2, 3, 4, 5] i = len(given_arr) - 1 while(i >= 0): print(given_arr[i]) i = i - 1⏎In this

  3. #3 peak

    3, 42]⏎-- Without library⏎f :: Bool -> [Int]⏎f b = if b then xs else ⏎-- With library⏎g :: Bool -> [Int]⏎g = mwhen xs⏎See? It’s an amazing

  4. #4 peak

    to abcteach⏎Free Account (Settings)⏎An 8 page study unit for Ron

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

None: this is the first layer.

Feeds later layers

  1. L18:1257 weakly suppresses
  2. L1:268 weakly suppresses
  3. L3:2504 weakly excites
  4. L15:3038 weakly suppresses
  5. L22:1424 weakly excites
  6. L24:2565 weakly excites
  7. L11:2359 weakly suppresses
  8. L12:2064 weakly suppresses
  9. L19:2754 weakly suppresses
  10. L8:1529 weakly suppresses
  11. L26:337 weakly suppresses
  12. L5:2070 weakly suppresses
  13. L12:2314 weakly suppresses
  14. L21:2920 weakly suppresses
  15. L6:91 weakly suppresses
  16. L10:959 weakly suppresses
  17. L25:1769 weakly excites
  18. L27:809 weakly suppresses
  19. L12:1613 weakly suppresses
  20. L1:1241 weakly excites
  21. L9:2532 weakly suppresses
  22. L20:947 weakly excites
  23. L20:567 weakly excites
  24. L2:279 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -0.41 and -0.361 values between -0.36 and -0.321 values between -0.32 and -0.2811 values between -0.28 and -0.2359 values between -0.23 and -0.19178 values between -0.19 and -0.14358 values between -0.14 and -0.10644 values between -0.10 and -0.06925 values between -0.06 and -0.01990 values between -0.01 and 0.03338 values between 0.03 and 0.08154 values between 0.08 and 0.1275 values between 0.12 and 0.1757 values between 0.17 and 0.2124 values between 0.21 and 0.2515 values between 0.25 and 0.308 values between 0.30 and 0.345 values between 0.34 and 0.397 values between 0.39 and 0.437 values between 0.43 and 0.473 values between 0.47 and 0.527 values between 0.52 and 0.562 values between 0.56 and 0.618 values between 0.61 and 0.654 values between 0.65 and 0.703 values between 0.70 and 0.742 values between 0.74 and 0.781 values between 0.78 and 0.835 values between 0.83 and 0.875 values between 0.87 and 0.923 values between 1.00 and 1.053 values between 1.05 and 1.091 values between 1.18 and 1.221 values between 1.27 and 1.312 values between 1.31 and 1.36offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. jerne
  2. анны
  3. ActionController
  4. (fc
  5. лиз
  6. ethe
  7. cing
  8. же
  9. 带上
  10. aintenance

Suppresses

  1. scene
  2. ssa
  3. paces
  4. exus
  5. adres
  6. riet
  7. stant
  8. spots
  9. unct
  10. pend