Neuron Explorer

Qwen3-0.6B

"of" after "people" or "women"

A neuron in layer 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word "of" when it follows a group noun such as "people of all ages", "people of color" or "women of childbearing age". It turns negative on "the" in phrases like "a number of the". Turning it down made the model repeat "form of the form", which does not clearly match the trigger, so the outputs are not much help.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    asylum seekers, refugees and people of African and South Asian descent were particularly vulnerable to racism in the country.⏎In a

  2. #2 peak

    theater and visual arts), foreign languages, health and physical education<|endoftext|>'Gay' is the word used to describe the physical and emotional attraction of a person to people of the same sex. It is often used to describe men or boys who are sexually

  3. #3 peak

    ed for a week there among the Native Americans.⏎The area’s first permanent settler was a Scottish trader, James McQueen, who ended up marrying a woman of high status from the Coushatta tribe in 17

  4. #4 peak

    include the following:⏎Race and Ethnicity⏎Individuals are protected from discrimination based on their race, ethnic background, citizenship status or national origin. This includes people of all races and ethnicities.⏎California law prohibits discrimination based on an individual’s gender

  5. #5 peak

    George Floyd at the hands of the Minneapolis police and the subsequent national protests calling attention to the long history of violence and systematic racism faced by African Americans and other people of color are an indictment of America’s present and past inequalities.⏎The

  6. #6 peak

    .⏎Tonsillectomies for Adults⏎Though tonsillectomies are performed more on children, adults can also benefit from the surgical procedure. People of all ages can develop tonsillitis but it is more common for people ages

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the form of the form of the form of the form of the form of the form of the form of the form of the form of the form of the form of the form of the form of the form of the form of the form of

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    by itself. Therefore, a number of the more popular study questions include (but are not limited to) whether there are connections

  2. #2 peak

    ?<|endoftext|>& Tornado Alley⏎Jan Mikusinski developed an operational calculus which is relevant for solving differential equations. His operational calculus is based upon an algebra of the convolution of functions with respect to the Fourier transform. From the convolution product he goes

  3. #3 peak

    something of the frightful extent of this scourge, when we remember that it claimed as victims

  4. #4 peak

    same slope, m = 2, and we know that,⏎Lines with the same slope are parallel.⏎Hence, the given lines are parallel.⏎Let's

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L17:2467 suppresses
  2. L19:226 excites
  3. L8:1090 weakly suppresses
  4. L8:16 weakly suppresses
  5. L6:1658 weakly suppresses
  6. L17:317 weakly excites 'of' after a noun phrase
  7. L0:2265 weakly excites
  8. L18:1659 weakly suppresses
  9. L12:125 weakly excites
  10. L3:189 weakly excites
  11. L12:826 weakly suppresses 'study' in science news
  12. L5:86 weakly suppresses
  13. L14:2810 weakly excites
  14. L4:1315 weakly suppresses
  15. L6:17 weakly suppresses
  16. L19:715 weakly excites
  17. L15:2431 weakly excites
  18. L8:1309 weakly suppresses
  19. L6:956 weakly excites
  20. L0:37 weakly suppresses
  21. L0:189 weakly suppresses
  22. L19:1869 weakly suppresses
  23. L12:1106 weakly excites
  24. L7:2705 weakly suppresses

Feeds later layers

  1. L23:1278 strongly suppresses
  2. L24:3005 strongly suppresses
  3. L24:611 suppresses
  4. L27:966 suppresses
  5. L22:1873 suppresses
  6. L27:688 suppresses
  7. L26:711 suppresses 'years' after an age number
  8. L23:567 suppresses
  9. L27:447 suppresses
  10. L25:1400 suppresses
  11. L21:2062 weakly suppresses
  12. L22:142 weakly excites 'of' after a quantity or noun phrase
  13. L23:867 weakly suppresses
  14. L24:2753 weakly suppresses
  15. L21:2461 weakly suppresses
  16. L23:365 weakly excites
  17. L21:2342 weakly suppresses
  18. L23:2174 weakly suppresses
  19. L22:288 weakly suppresses
  20. L23:1402 weakly excites
  21. L27:602 weakly suppresses
  22. L26:920 weakly suppresses
  23. L27:2151 weakly suppresses
  24. L24:2791 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -4.49 and -4.011 values between -3.04 and -2.562 values between -2.07 and -1.597 values between -1.59 and -1.1140 values between -1.11 and -0.62958 values between -0.62 and -0.142836 values between -0.14 and 0.3446 values between 0.34 and 0.832 values between 0.83 and 1.312 values between 1.31 and 1.801 values between 1.80 and 2.281 values between 2.28 and 2.762 values between 2.76 and 3.251 values between 3.73 and 4.211 values between 4.21 and 4.701 values between 4.70 and 5.181 values between 5.66 and 6.151 values between 6.15 and 6.631 values between 10.50 and 10.981 values between 12.43 and 12.921 values between 13.40 and 13.881 values between 14.37 and 14.85offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ambique
  2. ITOR
  3. 可靠
  4. ес
  5. ethoven
  6. inyin
  7. |_|
  8. slightest
  9. imensional
  10. 鞅

Suppresses

  1. form
  2. 形式
  3. Form
  4. 的形式
  5. forme
  6. type
  7. _form
  8. form
  9. forma
  10. →form