Neuron Explorer

Qwen3-0.6B

word pieces inside all-caps headlines

A neuron in layer 16 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on pieces of words written in capital letters, such as the middle of a headline word in all-caps news titles. Turning it down made the model capitalise words in odd Title Case, and turning it up gave unrelated text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens an email to the maker with the neuron already filled in).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    you.⏎Reviewed by Lucy Boomer, People & Organisational Development Manager<|endoftext|>Priests and People (UK). 6 pp.⏎IT IS A FEW NIGHTS BEFORE Christmas, 1994. A small group of us are

  2. #2 peak

    0s. Dr. Anderson chalked up the benefits to oats’ soluble fibre, which lowers cholesterol. But there<|endoftext|>QUASAR’S BELCH SOLVES LONGSTANDING MYSTERY⏎February 23, 2011

  3. #3 peak

    flavoring.⏎What Else Can I Try?⏎Try changing how<|endoftext|>by Joe Shea⏎April 12, 2012⏎TWO WHITE GUYS IN SUITS? NOT FOR THIS AMERICA⏎DUMMERSTON,

  4. #4 peak

    professional medical advice. CALL YOUR HEALTHCARE PROVIDER IMMEDIATELY IF YOU THINK YOU MAY HAVE A MEDICAL EMER

  5. #5 peak

    responsible for 17 percent of the protein we consume<|endoftext|>The first non-stop trans-Atlantic flight⏎THE VERY FIRST NON-STOP TRANS-ATLANTIC FLIGHT⏎Note: The U.S

  6. #6 peak

    lights, laminar flow cabinets, and other biological safety cabinet components protect.⏎Read More @ https://cmibloginsight.blogspot.com/2023/05/biological-safety-cabinets-ensuring.html<|endoftext|>World

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: Thesethesethetale,thetogot,Wherethere,wherethereis. Thetogot,wherethere,wherethereis. I’m,too,Whereth

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    ircuit Topology And Laws Applied Electricity⏎Solved Use Kirchhoff S Rules To Analyze The Circuit Diagram Chegg Com⏎Solved Problem 5 Consider The Circuit Diagram Shown Above

  2. #2 peak

    ОТА ПО АНГЛИЙСКОМУ ЯЗЫКУ⏎КОНТРОЛЬНАЯ РАБОТА ПО АНГЛИЙСКОМУ ЯЗЫКУ⏎1

  3. #3 peak

    So That They Can Master Writing The Alphabet Please Share Our Worksheets Thank You Free Writing Worksheets Alphabet Handwriting Practice⏎Kindergarten Writing Worksheets Word Lists And Activities⏎In This Writing Worksheet Your Kids Get Practice Writing Their Name Age And Address And Drawing A Self

  4. #4 peak

    . Agreement :- Mediation confirms and clarifies the terms of settlement and reduces the settlement into a clear, complete, concise and concrete agreement.⏎(4) WHAT DOES A MEDIATION DO- • Mediation is impartial and neutral. • Man

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L11:631 strongly excites
  2. L15:288 strongly suppresses
  3. L7:128 suppresses
  4. L13:1951 excites
  5. L13:2408 excites
  6. L4:533 suppresses
  7. L14:218 suppresses
  8. L4:887 suppresses
  9. L13:1433 suppresses
  10. L12:2654 excites
  11. L9:2524 suppresses
  12. L2:381 suppresses
  13. L14:1575 excites
  14. L15:2836 excites
  15. L10:214 suppresses
  16. L13:1125 excites
  17. L2:1371 excites
  18. L14:951 excites
  19. L3:627 suppresses
  20. L5:35 suppresses
  21. L15:2539 excites
  22. L15:257 suppresses
  23. L14:479 suppresses
  24. L2:2243 suppresses

Feeds later layers

  1. L18:2038 suppresses
  2. L19:1240 suppresses
  3. L18:1496 suppresses
  4. L19:901 suppresses
  5. L17:1993 suppresses
  6. L17:2214 suppresses
  7. L18:2217 suppresses
  8. L17:2414 excites
  9. L19:96 excites
  10. L18:599 suppresses
  11. L17:659 excites
  12. L17:1612 suppresses
  13. L25:198 suppresses
  14. L23:242 weakly suppresses
  15. L22:3045 weakly suppresses
  16. L18:882 weakly excites
  17. L17:513 weakly suppresses
  18. L26:277 weakly suppresses
  19. L25:352 weakly suppresses
  20. L20:296 weakly suppresses
  21. L19:1455 weakly suppresses
  22. L18:946 weakly suppresses
  23. L19:903 weakly excites
  24. L19:2077 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -9.73 and -9.301 values between -8.01 and -7.571 values between -7.14 and -6.711 values between -6.71 and -6.281 values between -6.28 and -5.843 values between -5.84 and -5.412 values between -5.41 and -4.982 values between -4.98 and -4.552 values between -4.55 and -4.113 values between -4.11 and -3.682 values between -3.68 and -3.253 values between -3.25 and -2.821 values between -2.82 and -2.393 values between -2.39 and -1.955 values between -1.95 and -1.5218 values between -1.52 and -1.0930 values between -1.09 and -0.6657 values between -0.66 and -0.22585 values between -0.22 and 0.212290 values between 0.21 and 0.64861 values between 0.64 and 1.0732 values between 1.07 and 1.511 values between 1.51 and 1.942 values between 2.37 and 2.801 values between 7.13 and 7.56offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. Aires
  2. , ⏎
  3. (Arg
  4. uppe
  5. swamp
  6. 经纪
  7. ufen
  8. 二级
  9. vfs
  10. 复工

Suppresses

  1. nga
  2. gresql
  3. jection
  4. atile
  5. hetto
  6. �
  7. gment
  8. OMIT
  9. ">//
  10. HasBeen