Neuron Explorer

Qwen3-0.6B

line breaks inside wrapped sentences

A neuron in layer 5 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

The neuron fires on the invisible line break that a text has partway through a sentence, where the line was wrapped by a page or column rather than ending a thought. Turning it up did not make the writing look or read differently in any clear way.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    -splicing and in some cases can act⏎as an enzyme. A wide variety of rRNA molecules and some mRNA molecules (chloroplast and mitochondrial) can splice⏎themselves. These molecules are called ribozymes (RNA enzymes; Figure

  2. #2 peak

    areas mark⏎seismically active regions in the channel between Fogo and Brava (seismic crisis 1994) and at Cadamosto⏎seamount (Heleno et al 1999; Grev

  3. #3 peak

    the double⏎helix is said to "melt" into its two component molecules, and will⏎reassociate upon slow cooling under appropriate salt conditions. So,⏎the issue is not decomposition so much as disassociation upon exposure⏎to too high

  4. #4 peak

    to specify, visualise,⏎construct and document the artifacts of an object-oriented software-intensive⏎system under development. The UML represents a compilation of "best engineering⏎practices" which have proven successful in modelling large, complex systems.⏎UML

  5. #5 peak

    race for a cure holds a promise for many struggling with the disease.⏎Eight million people die from cancer worldwide every year, out of which four million people die prematurely⏎(aged 30 to 69 years). Leading cancer risk factors include

  6. #6 peak

    works. Normally when you try and cd⏎into a directory, it will only try and change to the path specified from the current directory. If you spend a⏎lot of time working in specific folders, it might be useful to assume that your

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: "I know, I'm not going to be there, I'm just going to be there, I'm just going to be there...". So, the "T" problem, and the "T" problem... It's been a

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    that the foe, or their progenitors,⏎had been citizens of Colordo in the far West. And that,⏎having conquered all before them, they sought another⏎World to conquer here.⏎When we do trace out nature's laws,⏎And view

  2. #2 peak

    bars,⏎When, oh! the welcome news then came,⏎To get abound the cars.⏎They marched us through their nasty streets,⏎That all the crowd might see,⏎The “hiding Yankees” from the North,⏎That in than land run free

  3. #3 peak

    two or more servers do not interfere⏎with each other. Usually NFS file locking is handled by the⏎lockd daemon, but at the moment there is no⏎platform that performs locking 100% reliably in every situation.⏎With this

  4. #4 peak

    ) Tetragonal System :⏎Three axes make right⏎angles with each other. The two horizontal⏎axes, a and b, are of equal length but the⏎third, c axis, is of different length, e.g⏎(iii)

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L4:863 suppresses
  2. L4:351 suppresses
  3. L3:42 excites
  4. L3:428 excites
  5. L3:1592 suppresses
  6. L4:114 excites
  7. L4:1230 weakly suppresses
  8. L4:19 weakly suppresses
  9. L4:71 weakly suppresses
  10. L0:1235 weakly suppresses
  11. L2:2692 weakly excites
  12. L1:243 weakly suppresses
  13. L4:3027 weakly excites
  14. L3:1597 weakly excites
  15. L2:2740 weakly suppresses 'on' before time or track
  16. L2:477 weakly excites line break in the middle of a sentence
  17. L1:2612 weakly excites
  18. L3:1355 weakly suppresses
  19. L1:1298 weakly suppresses
  20. L3:421 weakly suppresses
  21. L1:557 weakly excites
  22. L2:44 weakly excites
  23. L4:198 weakly suppresses
  24. L3:1752 weakly excites

Feeds later layers

  1. L6:754 excites
  2. L7:1240 suppresses
  3. L7:239 excites
  4. L6:710 suppresses
  5. L9:234 weakly excites line break inside hard-wrapped text
  6. L19:771 weakly suppresses
  7. L13:2286 weakly suppresses
  8. L11:1272 weakly suppresses unclear: sentence ends in factual prose
  9. L22:2535 weakly suppresses
  10. L14:3000 weakly suppresses
  11. L24:574 weakly excites
  12. L6:574 weakly excites
  13. L6:1060 weakly excites
  14. L11:423 weakly suppresses
  15. L14:2237 weakly suppresses
  16. L7:1539 weakly excites
  17. L20:564 weakly excites
  18. L16:2235 weakly excites
  19. L8:2501 weakly suppresses 'iv' inside herbivores, energy fuel words
  20. L23:825 weakly excites
  21. L22:2576 weakly excites
  22. L7:1360 weakly excites
  23. L21:1557 weakly suppresses
  24. L21:2827 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -4.17 and -4.051 values between -2.18 and -2.061 values between -0.77 and -0.652 values between -0.65 and -0.541 values between -0.54 and -0.429 values between -0.42 and -0.30105 values between -0.30 and -0.18589 values between -0.18 and -0.071601 values between -0.07 and 0.051179 values between 0.05 and 0.17357 values between 0.17 and 0.2857 values between 0.28 and 0.405 values between 0.40 and 0.52offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ź
  2. مخ
  3. vido
  4. 集聚
  5. bage
  6. ķ
  7. ţi
  8. owi
  9. ORIES
  10. -package

Suppresses

  1. endforeach
  2. essed
  3. iii
  4. /environment
  5. III
  6. .Arguments
  7. 格林
  8. .cloudflare
  9. ellas
  10. iii