Neuron Explorer

Qwen3-0.6B

colon in clock times

A neuron in layer 23 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the colon in times of day, like the colon in '10:00' or '6:37'. Turning it up made the model write in a loose, repetitive way, with no clear topic.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    Moon will be full on Tuesday night, April 7, 2020, appearing opposite the Sun (in Earth-based longitude) at 10:

  2. #2 peak

    local wind shear was having its effect on the storm, and Hurricane Humberto’s winds had begun to diminish. By 1500 UTC (11:00 a.m), Humberto had weakened to tropical storm status, with maximum

  3. #3 peak

    before making an official announcement.⏎That announcement has just come. Gravitational waves were observed on 14 September 2015, at 5:51am ET by both of the LIGO detectors, located in Livingston,

  4. #4 peak

    mission," ESA Director-General Jean-Jacques Dordain declared at the International Astronautical Congress in Glasgow, Scotland.⏎The end came at around 9:30 a.m. ET, when controllers back at Europe's mission control in

  5. #5 peak

    the Pacific theater of WWII when she attacked and sank a midget submarine, perhaps the same one, at 06:37. Five midget submarines had been assigned to torpedo U.S. ships

  6. #6 peak

    dream up the basic elements of the classroom of the future using design thinking. Great example of a school-business partnership.⏎- Design & Thinking Official Trailer (02:28)⏎Design & Thinking is a documentary released this year about design thinking.

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: can we can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can can

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    information about how to correct material in RePEc.⏎For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Michael McNulty)⏎If references are entirely missing, you can

  2. #2 peak

    dates and are celebrated in all Afghanistan.⏎- Juma (Friday):⏎The week ends on Friday (Juma) which is the day of rest.⏎- Jeshen (Independence day): 28th Asad = 19

  3. #3 peak

    ːa]) was one of the Three Kingdoms of Korea, and one of the world's longest sustained dynasties. Although it was founded by King Park Hyeokgeose, the dynasty was ruled by the Gyeongju Kim

  4. #4 peak

    • Encyclopedia of Alternative Energy • Contact<|endoftext|>Map of Liberia, West Africa⏎In 1815, the African-American Quaker and maritime entrepreneur Paul Cuffee financed and captained a voyage to Sierra Leone, where he helped a small

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L20:1691 suppresses
  2. L21:1045 weakly suppresses
  3. L7:92 weakly excites
  4. L19:2465 weakly excites
  5. L20:261 weakly suppresses
  6. L3:828 weakly suppresses
  7. L20:1732 weakly suppresses
  8. L9:2831 weakly excites
  9. L19:945 weakly suppresses
  10. L17:1493 weakly suppresses
  11. L19:2180 weakly suppresses
  12. L11:1603 weakly suppresses
  13. L18:2382 weakly excites
  14. L18:1187 weakly excites
  15. L16:2849 weakly suppresses
  16. L13:722 weakly excites
  17. L19:984 weakly excites
  18. L18:714 weakly suppresses
  19. L13:1455 weakly suppresses
  20. L4:42 weakly suppresses
  21. L19:1648 weakly excites
  22. L0:1914 weakly suppresses
  23. L19:730 weakly excites
  24. L9:2232 weakly excites

Feeds later layers

  1. L27:774 strongly suppresses
  2. L24:766 suppresses
  3. L24:789 suppresses
  4. L27:1815 suppresses
  5. L24:800 excites colon in clock times
  6. L26:2879 weakly excites
  7. L27:2857 weakly suppresses
  8. L24:1298 weakly excites
  9. L27:2782 weakly suppresses
  10. L24:1324 weakly excites
  11. L24:1814 weakly excites
  12. L24:797 weakly excites
  13. L26:1401 weakly suppresses
  14. L27:1592 weakly excites
  15. L27:1699 weakly suppresses
  16. L25:1952 weakly suppresses
  17. L25:2844 weakly excites
  18. L24:1183 weakly excites
  19. L27:2378 weakly excites
  20. L24:2964 weakly excites
  21. L24:2367 weakly excites
  22. L27:2960 weakly excites
  23. L24:2804 weakly excites
  24. L24:1740 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -7.34 and -6.481 values between -4.75 and -3.894 values between -3.89 and -3.035 values between -3.03 and -2.1712 values between -2.17 and -1.31371 values between -1.31 and -0.443291 values between -0.44 and 0.42198 values between 0.42 and 1.2814 values between 1.28 and 2.142 values between 2.14 and 3.003 values between 3.87 and 4.731 values between 4.73 and 5.591 values between 5.59 and 6.451 values between 6.45 and 7.312 values between 8.18 and 9.041 values between 26.28 and 27.14offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. }}},⏎
  2. ugh
  3. 他会
  4. oundation
  5. acet
  6. ッド
  7. 管局
  8. enen
  9. ugar
  10. 打法

Suppresses

  1. 可
  2. 可以
  3. 可在
  4. can
  5. 可以在
  6. can
  7. 可以从
  8. Can
  9. _can
  10. Can