Neuron Explorer

Qwen3-0.6B

'of' in 'As of' dates

A neuron in layer 1 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron reacts to the word 'of' in the phrase 'As of', which is usually followed by a year or a census figure. Turning it up did not produce any clear change in the model's writing that relates to this.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    state of Utah. As of the 2010 census, the population was 231,

  2. #2 peak

    m²)⏎|Time zone||Central: UTC-6/-5|⏎Cherokee County is a county located in the U.S. state of Texas. As of the 2010 census, its population was 50,8

  3. #3 peak

    50 percent of electricians made between $37,570 and $65,260 a year.⏎Salary by Employment Sector⏎As of 2011, the highest-paid electricians were those who taught at

  4. #4 peak

    a high school diploma, but all electricians must undergo an apprenticeship of up to four years before they can become licensed.⏎Average and Median Earnings⏎As of 2011, electricians earned an average of $52,

  5. #5 peak

    Alberta generated $21.3 billion in revenue.⏎- Alberta has the third largest food and beverage manufacturing sector in the country after Ontario and Quebec.⏎- As of 2020, there were over 82,000

  6. #6 peak

    following a public health order, enforcement will rely on education and individual responsibility for the good of the community as a whole.⏎“There have been reports<|endoftext|>Note: As of the 2022-2023 program year, the Cyber

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the way I was supposed to be. I am a bit of a student. I need to know this. I need to learn. I am a bit of a student. I need to know this. I am a bit of a student

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    as possible. For the 2012 hurricane season, the industry continues to build

  2. #2 peak

    liberated city, should we turn the page as soon as possible to erase the devastation wrought by ISIS? Rebuild no matter the cost, with

  3. #3 peak

    capacity to move water from affected areas as quickly as possible out to tide, to the Water Conservation Areas or into Lake Okeechob

  4. #4 peak

    a result of government policy.⏎The goal is "to narrow as soon as possible the gap in economic development between Tibet and other areas of the nation" (White

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L0:1301 suppresses
  2. L0:1224 suppresses
  3. L0:178 suppresses
  4. L0:1075 excites
  5. L0:1355 weakly excites
  6. L0:1 weakly suppresses
  7. L0:2420 weakly suppresses
  8. L0:793 weakly excites
  9. L0:2042 weakly suppresses
  10. L0:2726 weakly excites
  11. L0:852 weakly excites
  12. L0:1579 weakly suppresses
  13. L0:761 weakly suppresses
  14. L0:633 weakly excites
  15. L0:93 weakly suppresses
  16. L0:563 weakly suppresses 'www' in web addresses
  17. L0:1232 weakly excites
  18. L0:2819 weakly suppresses
  19. L0:2684 weakly suppresses
  20. L0:2389 weakly suppresses
  21. L0:191 weakly suppresses
  22. L0:2201 weakly suppresses
  23. L0:2068 weakly excites
  24. L0:2320 weakly suppresses

Feeds later layers

  1. L8:495 weakly excites
  2. L13:2158 weakly excites
  3. L9:440 weakly excites
  4. L4:522 weakly excites
  5. L14:2132 weakly suppresses
  6. L4:724 weakly excites
  7. L23:1378 weakly suppresses
  8. L6:182 weakly suppresses
  9. L4:1060 weakly excites
  10. L19:1399 weakly suppresses
  11. L14:633 weakly excites
  12. L12:295 weakly suppresses
  13. L5:20 weakly excites
  14. L6:1455 weakly excites
  15. L11:1189 weakly excites
  16. L24:851 weakly excites
  17. L3:343 weakly excites
  18. L4:117 weakly suppresses
  19. L21:1049 weakly excites
  20. L2:215 weakly suppresses
  21. L17:451 weakly suppresses
  22. L24:1085 weakly suppresses
  23. L17:2537 weakly suppresses
  24. L22:2136 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -2.03 and -1.931 values between -0.77 and -0.671 values between -0.57 and -0.484 values between -0.48 and -0.3832 values between -0.38 and -0.2881 values between -0.28 and -0.19416 values between -0.19 and -0.092449 values between -0.09 and 0.01810 values between 0.01 and 0.1190 values between 0.11 and 0.2012 values between 0.20 and 0.304 values between 0.30 and 0.401 values between 0.40 and 0.491 values between 0.49 and 0.591 values between 0.59 and 0.691 values between 0.69 and 0.781 values between 1.27 and 1.372 values between 1.76 and 1.85offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 他们是
  2. rops
  3. heck
  4. hk
  5. heimer
  6. 他们在
  7. ental
  8. ichten
  9. 他们的
  10. sess

Suppresses

  1. рид
  2. elman
  3. olta
  4. 酚
  5. Ref
  6. Kind
  7. lef
  8. Geoff
  9. insulated
  10. 主动