Neuron Explorer

Qwen3-0.6B

unclear: token just before a k sound

A neuron in layer 27 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featured, so it has steering outputs.

What this neuron does

The neuron is hard to pin down. Its strongest moments come just before a k sound, such as the word before a k in a formula or the start of a word like karmas. Turning it down made the model repeat the letter k over and over.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    (9/10)k-2, where k is the number of digits of 2n. The number of digits can

  2. #2 peak

    to “zero out” the data blocks. To do so, do one of the following:⏎Use the metainit command with the -k option. The -k option recreates the RAID 5 volume without initializing it, and sets the

  3. #3 peak

    V and generally applied up to and including 52 kV . For technical and economic reasons, the service voltage of medium voltage distribution networks rarely exceeds 35 kV.⏎In this chapter, networks which operate at 1000

  4. #4 peak

    alternatives are:⏎- Does one karma produce one birth?⏎- Does one karma cause several births?⏎- Do several karmas result in several births?⏎- Do several karmas give rise to only one birth?⏎There are many karmas

  5. #5 peak

    How Many Teeth Do Koi Have?⏎The exact number of teeth which a koi carp has depends on its sub-species as well as on the age of the fish. Therefore, it is impossible to answer this

  6. #6 peak

    ) where they proved that a(n) is not more than the smallest number k such that the total number of ones in the binary expansion of numbers from 1 to k is at least n − 1. Which means they proved that a(

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k k

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    grandchildren of the ones stayed behind. The interesting story of The First Turks in America will be immortalized at a museum to be established in Turkey.⏎THE FIRST TURKS IN AMERICA⏎1893, the 400th

  2. #2 peak

    so loud and aggressive anyway?⏎Why are geese so loud?⏎Most people are familiar with the honk of the Canadian goose. Sometimes, it seems like they honk non-stop. Geese make so much noise for several reasons:⏎● To

  3. #3 peak

    bodies buried underneath earthquake rubble, or to land a spacecraft on low-gravity asteroids, or - as the Army suggests - to sneak inside buildings where enemy combatants lurk," notes the SFGate.⏎Stanford robotics engineer Mark Cutkosky

  4. #4 peak

    the internet. Either they can’t afford a connection, or none exists where they live. Of all the efforts to bring those people online, Google’s “Project Loon” sounds the most far-fetched.⏎When the search company announced in June

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L25:496 strongly excites
  2. L26:425 strongly suppresses
  3. L23:1921 strongly excites
  4. L26:2092 strongly suppresses
  5. L22:1091 strongly excites
  6. L25:2346 strongly excites
  7. L21:1687 excites
  8. L23:2502 suppresses
  9. L26:2146 suppresses
  10. L24:1152 suppresses
  11. L23:1724 suppresses
  12. L26:1564 excites
  13. L26:2282 suppresses
  14. L22:918 suppresses
  15. L21:145 excites
  16. L24:2191 excites
  17. L24:1479 excites
  18. L24:548 suppresses
  19. L22:991 suppresses
  20. L16:619 suppresses
  21. L22:2136 suppresses
  22. L22:742 suppresses
  23. L18:569 excites
  24. L22:978 weakly excites

Feeds later layers

None: this is the last layer.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -15.93 and -15.431 values between -12.91 and -12.411 values between -7.89 and -7.381 values between -7.38 and -6.882 values between -6.88 and -6.381 values between -6.38 and -5.882 values between -5.37 and -4.872 values between -4.87 and -4.372 values between -4.37 and -3.863 values between -3.86 and -3.362 values between -3.36 and -2.862 values between -2.86 and -2.364 values between -2.36 and -1.855 values between -1.85 and -1.3548 values between -1.35 and -0.8521 values between -0.85 and -0.35500 values between -0.35 and 0.161869 values between 0.16 and 0.661110 values between 0.66 and 1.16256 values between 1.16 and 1.6755 values between 1.67 and 2.1717 values between 2.17 and 2.671 values between 2.67 and 3.171 values between 3.17 and 3.681 values between 3.68 and 4.18offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. änn
  2. 彤
  3. Tac
  4. 封
  5. apur
  6. entr
  7. 指尖
  8. TextLabel
  9. enas
  10. 嵴

Suppresses

  1. k
  2. k
  3. *k
  4. (k
  5. _k
  6. $k
  7. =k
  8. <k
  9. K
  10. K