Neuron Explorer

Qwen3-0.6B

hyphen inside compound words

A neuron in layer 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the dash in words that are joined by a hyphen, such as 'high-yield' or 'RNA-Seq'. When it was turned up, the model's output turned into a jumble of word fragments with no clear meaning.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    wigeon and scaup, teal and shovelers, buffleheads and a few mottled ducks.’⏎- ‘The sea ducks - common golden-eyes and buffleheads - are up in central Alaska.’⏎- ‘The

  2. #2 peak

    counterpart–something that’s key to the preservation of ecosystems and their biodiversity.⏎By comparing the impact of wheat, rice, beef, and dairy production in both high- and low-yield farming systems globally, the authors found that in some cases high

  3. #3 peak

    15393 (393 Red).⏎Fedorets saw McConnell.⏎Captain Fedorets had just shot down F-86A-5-NA 49-1297, flown by 2nd Lieutenant

  4. #4 peak

    , zinc, flavonoids, B vitamins, and fiber. It is also low in calories.⏎Nutritional Value and Health Effects⏎A 100-gram (3.5 oz) serving of oca provides almost 40

  5. #5 peak

    to create a highly-competitive economy.⏎Even if we were to accept participation in the economy as the highest

  6. #6 peak

    outputs are high, resulting in a wired-AND function of the outputs. The product-term line is low when any of the

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I want to make a small but very important part of a project in the following way as a way to keep the overall project as a more __ ( fill the blank with the appropriate word in the sentence to complete the sentence in the sentence.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    9/10 grade band of the Minnesota Language Arts standards are addressed.⏎Credit: 1.0 (Semester A = 0.5 credit, Semester B = 0.5 credit.)⏎Honors Opportunity: Yes⏎Pr

  2. #2 peak

    1921 as Ireland was in the midst of the ‘War<|endoftext|>According to a recent study from the Journal of the American Medical Association (JAMA. 2010;303(18):184

  3. #3 peak

    10, with 96% of cases reported in three districts. There are numerous policy challenges to providing an effective public health response system in a fragile state<|endoftext|>Overview of atrial flutter⏎- Robert Phang, MD, FACC,

  4. #4 peak

    Sort: Correlations⏎Your teacher will give you a set of cards. Match each scatter plot with a pair of variables. Be prepared to explain your reasoning.<|endoftext|>The Saturday Evening Post turns 200 this year, so we are bringing

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L15:59 excites
  2. L16:170 suppresses
  3. L14:348 suppresses
  4. L9:7 excites
  5. L15:241 excites
  6. L14:51 excites colon that introduces a statement
  7. L17:620 excites
  8. L14:422 excites periods after initials and abbreviations
  9. L17:2829 excites
  10. L15:286 excites
  11. L17:382 suppresses closing bracket after a fact in parentheses
  12. L10:33 suppresses
  13. L16:337 weakly excites
  14. L15:152 weakly suppresses
  15. L7:92 weakly suppresses
  16. L16:258 weakly excites 'of' after 'all' in phrases
  17. L12:2736 weakly suppresses
  18. L5:5 weakly suppresses digit after a label like paper or type
  19. L5:238 weakly suppresses
  20. L13:1046 weakly suppresses 'in' or 'on' ending a phrase
  21. L16:955 weakly excites
  22. L17:773 weakly suppresses
  23. L16:314 weakly excites
  24. L6:18 weakly excites

Feeds later layers

  1. L20:59 strongly excites
  2. L26:21 strongly suppresses
  3. L22:14 strongly excites
  4. L22:16 strongly suppresses comma in dates and birth lines
  5. L25:30 strongly excites
  6. L20:489 strongly excites
  7. L25:17 strongly excites
  8. L24:51 excites
  9. L21:70 excites
  10. L25:109 suppresses
  11. L23:80 excites blank slot before a year or number
  12. L27:33 excites
  13. L20:193 suppresses
  14. L26:48 excites
  15. L27:11 suppresses unclear: mixed fragments in lists and pronunciations
  16. L19:509 excites
  17. L21:214 excites
  18. L27:97 excites
  19. L21:118 excites
  20. L27:85 excites
  21. L24:39 excites
  22. L21:418 excites
  23. L21:29 excites
  24. L21:230 excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -10.53 and -9.801 values between -8.32 and -7.591 values between -7.59 and -6.852 values between -6.85 and -6.123 values between -6.12 and -5.386 values between -5.38 and -4.647 values between -4.64 and -3.9115 values between -3.91 and -3.1724 values between -3.17 and -2.4428 values between -2.44 and -1.7046 values between -1.70 and -0.96822 values between -0.96 and -0.232877 values between -0.23 and 0.5160 values between 0.51 and 1.244 values between 1.24 and 1.984 values between 1.98 and 2.721 values between 3.45 and 4.192 values between 4.19 and 4.921 values between 6.40 and 7.131 values between 9.34 and 10.081 values between 11.55 and 12.281 values between 18.17 and 18.91offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. -sama
  2. وبة
  3. ísticas
  4. kHz
  5. =params
  6. 瓠
  7. %;"
  8. usan
  9. 焦点
  10. 桌

Suppresses

  1. e
  2. me
  3. rate
  4. One
  5. Re
  6. re
  7. one
  8. ?
  9. None
  10. even