Neuron Explorer

Qwen3-0.6B

'sp' in split words

A neuron in layer 27 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron responds to the letters 'sp' when they start the second part of a word, such as 'spindles', 'spores' or 'splicing'. Turning it up made the model produce strings like 'lelelele', and turning it down made it repeat 'note' or 'novel'.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    windows with large, sharp corners. Other variations include the passionate style, Neoclassicism as well as the Baroque style. Gothic architecture usually includes columns and spindles as well as the main characteristic of the Gothic style is the use of

  2. #2 peak

    the substrate from the environment. If the substrate is exposed to the corrosive environment, the substrate will become the anode and corrosion will be dramatically accelerated resulting in spalling of the coating. Sealing or impregnation the coating is recommended.

  3. #3 peak

    by the inverter is the analog spindle, and the spindle driven by the servo motor is the servo spindle. Both can meet the control requirements of CNC machine tool spindles.⏎With the development of technology in the field of

  4. #4 peak

    Tick Paralysis⏎|Spinose Ear Tick⏎|Peanut-shaped and covered with small spines⏎||Causes intense irritation, rubbing, and hair loss⏎|T

  5. #5 peak

    hide. So, as the eel glides along, it emits a doublet or triplet. If there is a fish hiding nearby, then its body will spasm and the spasm will generate pressure waves in the water. Although the electric

  6. #6 peak

    of exons, has been found to occur⏎in the primary transcripts of at least 40 different genes. By altering the pattern of exons that are spliced⏎together different proteins can arise<|endoftext|>Ratio Forum is back on June

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note note

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    ⏎For over 30 years now, TNO has been gratefully taking advantage of this unique research platform to measure greenhouse gases and aerosols, such as particulate matter,⏎as well as to verify Dutch and European emissions. It is therefore

  2. #2 peak

    in the body by sun exposure.⏎Nitric oxide is one of your body’s most important molecules for blood pressure health.⏎It relaxes the inner muscles of the circulatory system allowing blood to course smoothly.⏎And

  3. #3 peak

    Computing and ICT teacher originally from the North East of England and working in East London.⏎Download or subscribe to this show at https://twit.tv/shows/triangulation.⏎Thanks to Cachefly for the bandwidth for this show.<|endoftext|>

  4. #4 peak

    converters (incorporating ceramic substrates), which reduce nitrogen oxides (NOx), and DPFs, which reduce particulate matter (soot).⏎Of course, Corning's substrate and filter technologies

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L18:853 suppresses
  2. L4:216 excites
  3. L20:468 suppresses
  4. L25:561 excites
  5. L2:761 suppresses
  6. L16:3 suppresses
  7. L20:61 suppresses
  8. L10:1035 suppresses
  9. L20:1454 excites
  10. L18:931 excites
  11. L19:1059 suppresses
  12. L4:345 excites
  13. L21:2411 weakly suppresses
  14. L21:1115 weakly suppresses
  15. L21:237 weakly suppresses
  16. L20:2688 weakly excites
  17. L0:2215 weakly suppresses
  18. L26:495 weakly suppresses
  19. L22:1305 weakly excites
  20. L26:631 weakly excites
  21. L18:402 weakly suppresses
  22. L1:259 weakly suppresses
  23. L24:8 weakly suppresses
  24. L2:1091 weakly suppresses

Feeds later layers

None: this is the last layer.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -44.41 and -42.321 values between -42.32 and -40.231 values between -29.81 and -27.721 values between -25.63 and -23.552 values between -19.38 and -17.292 values between -17.29 and -15.202 values between -15.20 and -13.126 values between -13.12 and -11.035 values between -11.03 and -8.953 values between -8.95 and -6.866 values between -6.86 and -4.779 values between -4.77 and -2.6979 values between -2.69 and -0.603739 values between -0.60 and 1.4818 values between 1.48 and 3.579 values between 3.57 and 5.662 values between 5.66 and 7.744 values between 7.74 and 9.832 values between 9.83 and 11.913 values between 11.91 and 14.003 values between 14.00 and 16.091 values between 16.09 and 18.171 values between 18.17 and 20.261 values between 20.26 and 22.341 values between 22.34 and 24.432 values between 24.43 and 26.521 values between 26.52 and 28.602 values between 30.69 and 32.771 values between 36.95 and 39.03offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. le
  2. ular
  3. et
  4. lei
  5. lek
  6. leh
  7. LE
  8. 怎么回事
  9. lez
  10. delegate

Suppresses

  1. note
  2. nov
  3. 醒
  4. ote
  5. terior
  6. ่น
  7. Tod
  8. icina
  9. orado
  10. начен