Neuron Explorer

Qwen3-0.6B

number right after 'age of' or 'ages'

A neuron in layer 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the number that comes right after words like 'ages', 'age of', or 'established in', such as the 14 in 'between the ages of 14 and 24'. Its negative side is on digits in the middle of measurements, like the 2 in 27.2°C. Turning it up gave rambling, unrelated text.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    Statistics software.⏎The software version addressed is SAS LASR Analytics Server 2.5.⏎SAS In-Memory Statistics Overview<|endoftext|>Thomas Edison Pitch Contest

  2. #2 peak

    professor in integrative physiology—used electroencephalograms, or EEGs, to measure the brain activity of eight sleeping children multiple times at the ages of 2, 3 and 5 years.⏎"Interestingly, during a night of

  3. #3 peak

    and violator programs.⏎This highly interactive four-hour program encourages young drivers between the ages of 14 and 24 to take responsibility for their driving behavior. Skill practices

  4. #4 peak

    to those of white-nosed coati (9.05%), being this difference significant in summer 2012 (P < 0.00001), summer (P =

  5. #5 peak

    (the previous two occurred in 1993-4 and 2001-2), this project surveyed Great Lakes residents over the age of 18 to learn their fish-eating habits, awareness and influence of federal and

  6. #6 peak

    advertising data and viewership ratings for e-cigarette commercial occurrences by quarter, year and sponsor across US cable networks and programs. Researchers calculated ad exposure for youth ages 12 to 17 years of age and young adults 18 to

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I know that, as I know that, as I know that, as I know that, as I know that, as I know that, as I know that, as I know that, as I know that, as I know that

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    .0°F (22.8°C). The warmest month, on average, is November with an average temperature of 81.0°F (27.2°C). The coolest month on average is June, with an average

  2. #2 peak

    Cape Verde Islands and carried maximum sustained winds of 75 mph (120 km/h).⏎Humberto’s winds peaked at 85 mph (137 km/h) later that same day, and continued at that strength through

  3. #3 peak

    ika 316 U.S. 584 (1942) and 319 U.S. 103 (1943), which were sandwiched between Minersville School District v. G

  4. #4 peak

    abscess, mastoiditis, and rheumatic fever in children: time trend analysis. BMJ. August 6, 2005;331:328–9.⏎Used with permission from

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L10:2461 strongly excites
  2. L13:1372 strongly excites number before an age or week count
  3. L14:471 excites
  4. L10:220 suppresses hyphen inside compound words
  5. L13:1083 excites
  6. L14:542 excites
  7. L4:53 excites blank slot before a number
  8. L4:973 suppresses
  9. L10:868 suppresses
  10. L12:2528 suppresses digits inside numbers
  11. L15:2051 suppresses
  12. L6:371 suppresses
  13. L8:111 suppresses the space before a year in dates
  14. L13:923 suppresses word right before a number or year
  15. L6:1469 excites
  16. L11:2532 excites
  17. L12:752 excites
  18. L13:2143 suppresses
  19. L14:2494 suppresses
  20. L14:616 suppresses
  21. L11:717 suppresses
  22. L8:2933 suppresses
  23. L15:2091 excites
  24. L14:1700 excites

Feeds later layers

  1. L17:868 excites
  2. L19:58 suppresses
  3. L17:170 excites
  4. L25:182 excites
  5. L19:964 excites
  6. L24:197 excites
  7. L20:4 excites
  8. L19:26 suppresses
  9. L17:126 excites
  10. L17:161 excites blank spot where a number goes
  11. L21:38 excites
  12. L24:8 excites
  13. L19:731 excites
  14. L17:222 excites
  15. L18:1904 excites
  16. L18:2542 excites
  17. L18:991 excites
  18. L18:400 excites
  19. L26:121 excites
  20. L19:665 excites
  21. L17:1096 excites
  22. L18:377 excites number right after 'about' or 'less than'
  23. L17:262 suppresses
  24. L24:7 excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -2.19 and -1.6810 values between -1.68 and -1.17850 values between -1.17 and -0.672739 values between -0.67 and -0.16140 values between -0.16 and 0.3523 values between 0.35 and 0.8614 values between 0.86 and 1.368 values between 1.36 and 1.877 values between 1.87 and 2.389 values between 2.38 and 2.887 values between 2.88 and 3.398 values between 3.39 and 3.903 values between 3.90 and 4.404 values between 4.40 and 4.918 values between 4.91 and 5.425 values between 5.42 and 5.934 values between 5.93 and 6.433 values between 6.43 and 6.947 values between 6.94 and 7.457 values between 7.45 and 7.954 values between 7.95 and 8.462 values between 8.46 and 8.974 values between 8.97 and 9.476 values between 9.47 and 9.983 values between 9.98 and 10.491 values between 10.49 and 11.004 values between 11.00 and 11.504 values between 11.50 and 12.015 values between 12.01 and 12.524 values between 12.52 and 13.024 values between 13.02 and 13.533 values between 13.53 and 14.042 values between 14.04 and 14.551 values between 14.55 and 15.051 values between 15.56 and 16.071 values between 16.07 and 16.571 values between 17.08 and 17.591 values between 17.59 and 18.09offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 说不出
  2. odash
  3. ieves
  4. égorie
  5. ersive
  6. fois
  7. erable
  8. 万元以上
  9. 型企业
  10. udios

Suppresses

  1. ign
  2. htm
  3. gn
  4. het
  5. alm
  6. .Manifest
  7. jm
  8. amate
  9. .IM
  10. ain