Neuron Explorer

Qwen3-0.6B

spot just before a year

A neuron in layer 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the empty spot right before a year or a date is written, such as 'the 60s' or 'in 1974'. When it was turned up, the model wrote long runs of digits, which fits its interest in numbers.

Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    hit with their song “Hey Schoolgirl”. The duo’s real names were Paul Simon and Art Garfunkel. Their music and lyrics are synonymous with the 60’s. From “The Sound of Silence” to “Bridge Over Trou

  2. #2 peak

    3/74 that ended the "economic miracle" once and for all. By the time Herbert Grünewald succeeded Kurt Hansen as Management Board Chairman following the 1974 Annual Stockholders' Meeting, the global economy was undergoing a

  3. #3 peak

    There is no doubt that England is far more ethnically and racially diverse than it was 20 years ago. The population identifying with an ethnic group other than White grew

  4. #4 peak

    segregationists, whatever one thought of Rosa Parks, her sit-down in 1955 in Montgomery, Alabama, was the ultimate moment of truth in a 350-year-long crisis and everybody knew it. What she did demanded a

  5. #5 peak

    , Canadian extreme weather expert and former Environment Canada research scientist. “Extreme events in the past few years are occurring with about the same frequency as they did during the 1945-1977 period when the Earth was generally cooling

  6. #6 peak

    to be prohibitively expensive and time-consuming due to self-erasing code and the fact that code can be several hundred thousand lines in length, according to the 2008 ACCURATE Report (A Center for Correct, Usable

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: . . . . . . . . . . . . . . .

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    Bubbling fluidized bed boilers; Circulating fluidized bed boilers⏎- Front<|endoftext|>CNY - 中國元,人民幣⏎最常用 CNY 交叉匯率⏎為什麼您

  2. #2 peak

    UNSPSC Code 30260000 See more.Customers who bought this item also bought.Page 1 of 1 Start over Page 1 of 1 .Previous page.1/4 x 6 x

  3. #3 peak

    �� : sleep 不 : not 觉 : to feel, wake up 晓 : dawn⏎Meaning for Lien 2 处 : place 闻 : hear 啼 : cry 茑 : bird⏎Meaning for

  4. #4 peak

    to make it accessible to us. But when the salt is removed it also removes all of the minerals in the water, creating pure water; just H 2 0. This is called distilling. But I wondered if distilled water could sustain

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L19:581 strongly suppresses blank slot before a number
  2. L18:377 excites number right after 'about' or 'less than'
  3. L17:402 suppresses
  4. L19:26 suppresses
  5. L4:53 excites blank slot before a number
  6. L20:265 excites
  7. L18:122 excites
  8. L20:749 excites
  9. L19:165 excites
  10. L17:285 suppresses
  11. L20:629 excites
  12. L18:375 suppresses
  13. L15:307 suppresses
  14. L16:471 suppresses blank spot before a year
  15. L16:975 excites
  16. L15:12 excites
  17. L19:737 suppresses
  18. L5:104 excites
  19. L13:923 suppresses word right before a number or year
  20. L17:620 suppresses
  21. L16:363 suppresses
  22. L16:406 weakly excites
  23. L8:111 weakly suppresses the space before a year in dates
  24. L17:773 weakly excites

Feeds later layers

  1. L26:103 strongly excites blank space before a number
  2. L27:283 strongly excites the spot right before a number
  3. L26:15 suppresses
  4. L23:77 excites the space right before a number
  5. L25:33 excites spot where a number is due
  6. L27:170 excites unclear: spaces in mixed-language text
  7. L25:146 excites
  8. L25:182 excites
  9. L26:611 suppresses
  10. L26:216 excites blank slot before a year or number
  11. L26:121 excites
  12. L27:113 excites
  13. L26:172 excites
  14. L27:238 excites
  15. L22:372 excites empty spot before a number or "3D"
  16. L22:824 excites blank before an expected number
  17. L27:306 suppresses
  18. L24:197 excites
  19. L22:16 suppresses comma in dates and birth lines
  20. L27:48 suppresses
  21. L25:253 suppresses
  22. L27:33 excites
  23. L27:2172 excites
  24. L27:241 suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2198 values between -2.89 and -0.571676 values between -0.57 and 1.744 values between 1.74 and 4.061 values between 4.06 and 6.371 values between 6.37 and 8.691 values between 15.63 and 17.941 values between 17.94 and 20.264 values between 22.57 and 24.892 values between 24.89 and 27.202 values between 29.52 and 31.831 values between 31.83 and 34.141 values between 36.46 and 38.774 values between 38.77 and 41.091 values between 50.34 and 52.661 values between 57.29 and 59.604 values between 61.92 and 64.231 values between 64.23 and 66.541 values between 66.54 and 68.863 values between 71.17 and 73.491 values between 87.37 and 89.69offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ước
  2. ionic
  3. istringstream
  4. ropa
  5. allback
  6. ills
  7. ération
  8. 的概念
  9. uling
  10. 设计理念

Suppresses

  1. covery
  2. wave
  3. out
  4. →
  5. O
  6. ten