Neuron Explorer

Qwen3-0.6B

digits inside number ranges

A neuron in layer 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron reacts to numbers, especially a single digit inside a range or a measurement, such as the '1' in '9 to 12 miles' or the '5' in '9-5'. It goes strongly negative on digits in dates and timestamps. The steered text did not show a clear number theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    integral part of the Pallava kingdom in the eighth century(C 731-796). Poet Sekkizhar (992-1042) describes the town as "vanga malik kadar kara

  2. #2 peak

    E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | 0-9⏎

  3. #3 peak

    of the Democratic candidate. At the time of writing, he was leading in our virtual electoral college by a thumping 9,120 votes to 16

  4. #4 peak

    Address to more contemporary ones. In this Government instructional activity, students compare and contrast historical Presidential speeches to the ones they hear today. High...⏎9th - 12th Social Studies & History⏎Anticipating the State of the Union,

  5. #5 peak

    . Another 352 words(25 lines of text) covering the years 1456, 1498, 1583, 1631, 1680, 1

  6. #6 peak

    5-10 meters (15-30 feet) in diameter exploding in the air between 15 and 20 km (nine to 12 miles) above sea level. Nobody was injured as a result of the explosion

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the best, for me, if I can, if I can, if I can, if I have, if I have, if I have, if I have, if... if, if, if, if... if, if,

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    , 8 Jan 2009, 14:01:08 EST⏎- MIT moves toward greener chemistryFri, 3 Sep 2010, 12:51:40 EDT

  2. #2 peak

    The skin 40 Eczema⏎The senses 46 Glaucoma⏎Agerelated macular degeneration⏎Neurological system 59 Craniotomy⏎Gastrointestinal system 6

  3. #3 peak

    21/2009] If you are interested in setting up an ad hoc network with encryption, please see this post.⏎[Update: 8/17/2010] Please see my latest post about setting an

  4. #4 peak

    round ships," which means that they were propelled primarily or entirely by sail. The length of the round ships ranged from 26 to 48 feet (8 to 14.7 meters), and they were between 8 and

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L11:1633 strongly suppresses
  2. L11:1659 strongly suppresses
  3. L10:715 suppresses
  4. L11:1896 suppresses
  5. L10:1417 suppresses
  6. L10:1271 excites
  7. L11:689 suppresses
  8. L10:848 suppresses
  9. L7:520 excites
  10. L10:722 suppresses
  11. L3:59 suppresses
  12. L10:2296 weakly suppresses
  13. L10:2404 weakly suppresses
  14. L10:405 weakly suppresses
  15. L8:125 weakly suppresses
  16. L7:2819 weakly suppresses
  17. L4:133 weakly suppresses
  18. L3:1189 weakly excites
  19. L8:2753 weakly suppresses
  20. L10:532 weakly excites
  21. L5:1527 weakly excites
  22. L1:614 weakly excites
  23. L9:1244 weakly excites
  24. L1:2070 weakly excites

Feeds later layers

  1. L14:2141 strongly suppresses
  2. L13:1771 strongly suppresses
  3. L13:2215 strongly excites
  4. L13:1113 strongly excites
  5. L13:2036 strongly suppresses
  6. L13:2948 strongly excites
  7. L14:1752 strongly excites
  8. L14:1210 excites
  9. L13:1139 suppresses
  10. L14:2807 excites
  11. L14:1247 excites
  12. L13:1364 excites
  13. L13:353 excites
  14. L13:2606 suppresses
  15. L15:3050 suppresses
  16. L14:1089 excites
  17. L13:15 excites
  18. L16:1427 suppresses
  19. L13:967 excites
  20. L14:2736 suppresses
  21. L15:2901 suppresses
  22. L13:815 excites
  23. L15:1444 weakly excites
  24. L15:2364 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -3.47 and -3.291 values between -3.12 and -2.941 values between -2.94 and -2.771 values between -2.77 and -2.592 values between -2.59 and -2.421 values between -2.42 and -2.252 values between -2.25 and -2.072 values between -2.07 and -1.904 values between -1.90 and -1.723 values between -1.72 and -1.557 values between -1.55 and -1.3712 values between -1.37 and -1.2016 values between -1.20 and -1.0234 values between -1.02 and -0.8561 values between -0.85 and -0.67112 values between -0.67 and -0.50222 values between -0.50 and -0.33475 values between -0.33 and -0.15846 values between -0.15 and 0.02857 values between 0.02 and 0.20618 values between 0.20 and 0.37320 values between 0.37 and 0.55166 values between 0.55 and 0.7276 values between 0.72 and 0.9032 values between 0.90 and 1.0718 values between 1.07 and 1.2510 values between 1.25 and 1.422 values between 1.42 and 1.602 values between 1.60 and 1.772 values between 1.77 and 1.951 values between 2.47 and 2.641 values between 3.34 and 3.52offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. (library
  2. "~
  3. 经开
  4. EMU
  5. igte
  6. acciones
  7. cco
  8. -MM
  9. {(
  10. принима

Suppresses

  1. ikipedia
  2. ience
  3. .LatLng
  4. rita
  5. 랙
  6. ington
  7. .COLOR
  8. kins
  9. ín
  10. burg