Neuron Explorer

Qwen3-0.6B

first word of a proper name

A neuron in layer 13 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the first word of a name that is about to be completed, such as 'Civil' in 'Civil War', 'Occupational' in 'Occupational Safety' or 'Storm' in 'Storm Water Credit'. Turning it up did not produce a clear theme, so this is only a guess from the examples.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    used in the production of fuel cells. A very simplistic description of the technology is that a fuel, typically hydrogen, is oxidized in the first segment of the fuel cell to create positively charged ions and

  2. #2 peak

    and vocabulary. All the spellings on this worksheet end in 'ag'. Students learn the spellings and then answer the questions. This worksheet was created by www.primaryleap.co.uk⏎(there is an issue with the thumbnail, showing the

  3. #3 peak

    plan, the city's Sustainability Advisory Board identified a need to focus on education and outreach on shoreline restoration, and to encourage private property owners to use incentives like the Storm Water Credit Program, said Elizabeth Williams, associate planner for the city.⏎RELATED:

  4. #4 peak

    materials may expose workers to health risks. Developed countries regulate manufacturing activity with labor laws and environmental laws. In the U.S, manufacturers are subject to regulations by the Occupational Safety and Health Administration and the United States Environmental Protection Agency. In Europe, pollution

  5. #5 peak

    this piece of legislation threatened the very existence of the Society as it was feared that the entire organisation, including its funds and lands, would be taken over by the Poor Law Commissioners. However, this never occurred as the Society was a voluntary organisation which

  6. #6 peak

    Philosophy recognized this void and secured the support of the College of Humanities and Social Science to begin developing the Center. After nearly a year of planning and designing, the Civil War Center became a functioning unit within the college. Thus, the mission and purpose

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: need to do this also add to the list of this also add... so do this also add... this also add... so do this also add... so do this also add... this also add... so do this also add... so do

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    battles.⏎An effort to improve the Luftwaffe support<|endoftext|>Extra 10% off sitewide + Free shipping over $150 with code: STOCKUP Details⏎Happy Homeschool Month! The whole month of January we will have

  2. #2 peak

    2008, mostly through birth or breastfeeding from an HIV-infected mother. Many regions of the world are gaining increased access to complex antiretroviral drug regimens for preventing HIV transmission from a mother to her child. However,

  3. #3 peak

    ⏎4 | 59⏎5 | 01⏎6 | 3⏎9 | 4⏎The way the app generates the stem-and-leaf plot for your dataset may be different.⏎The stem-and-leaf plot allows us

  4. #4 peak

    .4 cigarettes a day – the lowest daily cigarette consumption since the series began, the peak being in 1976 at

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L6:157 suppresses "of" after process or action nouns
  2. L8:928 excites
  3. L12:1345 suppresses
  4. L10:1317 excites
  5. L12:2753 excites
  6. L12:2056 excites
  7. L5:2594 suppresses
  8. L8:2768 excites
  9. L12:2663 excites
  10. L11:2163 suppresses
  11. L9:171 suppresses
  12. L9:194 suppresses
  13. L8:1213 excites
  14. L10:235 suppresses
  15. L9:277 suppresses
  16. L10:579 suppresses
  17. L12:940 suppresses
  18. L12:573 excites
  19. L12:996 suppresses
  20. L12:1853 excites
  21. L12:973 suppresses 'the' in 'hit in the body part' idioms
  22. L12:1974 excites
  23. L11:2467 suppresses
  24. L7:2257 weakly suppresses

Feeds later layers

  1. L14:304 excites
  2. L16:1508 excites
  3. L16:189 excites
  4. L14:1422 suppresses
  5. L16:322 excites
  6. L15:168 excites
  7. L15:2239 suppresses
  8. L17:641 excites
  9. L15:227 excites
  10. L14:23 excites
  11. L16:458 excites
  12. L15:2 weakly excites
  13. L19:76 weakly excites
  14. L15:6 weakly excites
  15. L14:211 weakly excites
  16. L16:41 weakly excites
  17. L15:613 weakly excites
  18. L15:9 weakly excites
  19. L14:752 weakly excites
  20. L14:2312 weakly suppresses
  21. L15:42 weakly excites
  22. L15:466 weakly excites
  23. L17:562 weakly excites
  24. L14:25 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

3 values between -2.20 and -2.032 values between -2.03 and -1.862 values between -1.86 and -1.691 values between -1.69 and -1.525 values between -1.52 and -1.349 values between -1.34 and -1.1714 values between -1.17 and -1.0024 values between -1.00 and -0.8346 values between -0.83 and -0.6684 values between -0.66 and -0.49134 values between -0.49 and -0.32264 values between -0.32 and -0.151360 values between -0.15 and 0.021267 values between 0.02 and 0.19436 values between 0.19 and 0.36106 values between 0.36 and 0.5331 values between 0.53 and 0.7026 values between 0.70 and 0.8820 values between 0.88 and 1.055 values between 1.05 and 1.2213 values between 1.22 and 1.397 values between 1.39 and 1.5610 values between 1.56 and 1.731 values between 1.73 and 1.904 values between 1.90 and 2.072 values between 2.07 and 2.243 values between 2.24 and 2.417 values between 2.41 and 2.582 values between 2.58 and 2.751 values between 2.75 and 2.922 values between 2.92 and 3.092 values between 3.09 and 3.264 values between 3.26 and 3.434 values between 3.43 and 3.614 values between 3.78 and 3.951 values between 3.95 and 4.121 values between 4.12 and 4.291 values between 4.46 and 4.63offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 一览
  2. _bal
  3. rophic
  4. доволь
  5. 所致
  6. iffs
  7. .only
  8. quals
  9. сет
  10. thankful

Suppresses

  1. yah
  2. lend
  3. lander
  4. estre
  5. LOTS
  6. endor
  7. terra
  8. atter
  9. oble
  10. TEX