Neuron Explorer

Qwen3-0.6B

'in' after 'high' or 'dressed'

A neuron in layer 8 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word "in" when it follows words like "high" or "dressed", as in "high in vitamin A" or "dressed in white". The same word "in" in other places, such as "floats freely in space", pushes the neuron the other way. Turning it up did not give a clear theme in the model's writing.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    act as a natural sleep aid.⏎Pumpkin is high in vitamin A and carotenoids – beta carotene, lutein,

  2. #2 peak

    Europe and the Middle East and Central Asia for longer than many people realize.⏎If you walked behind the owner of this skull when he was alive and he was dressed in a modern outfit, you would think that he was just another human being until you

  3. #3 peak

    as Lucia described:⏎When Our Lady disappeared in the immense distance of the sky, next to the sun we saw Saint Joseph holding the Child Jesus and Our Lady dressed in white with a blue mantle. Saint Joseph and the Child seemed to be blessing the

  4. #4 peak

    V.⏎This<|endoftext|>Warning: Use of undefined constant user_level - assumed 'user_level' (this will throw an Error in a future version of PHP) in /home/commons/public_html/wp-content/plugins/ultimate-google-analytics/ultimate_ga.php

  5. #5 peak

    of cancer, including lung, stomach, prostate, cervical and breast cancer.⏎2. Supports your Heart Health⏎Because these nuts are high in monounsaturated fats, they are able to reduce the bad cholesterol, and also

  6. #6 peak

    of linoleic acid and 0.432 g of Linolenic acid.⏎Nutritional facts Per 100 Grams⏎Helps in improving vision⏎Beta-carotene is very much important for improving vision. Many

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I am not a place where I have been for a long time. I am going to be a place where I am for the long term. I am a place that is meant to be a position that is a certain way. The way

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    1.4 million light-years away from Earth, so far away that it floats freely in space, unperturbed by the Milky Way.⏎Unlike the other hobbit galaxies

  2. #2 peak

    Currents⏎Generation of Alternating Voltages and Currents⏎An alternating voltage may be generated⏎(1) by rotating a coil at constant angular velocity in a uniform magnetic field as shown in Fig. (a).⏎(2) by rotating

  3. #3 peak

    an athlete jumped 2 feet high and left the ground at an angle of 20 degrees with respect to the horizontal, how fast was the athlete going in the forward (positive horizontal) and upward (positive vertical) directions immediately after takeoff

  4. #4 peak

    tightly constructed plot.⏎Carol Milford Kennicott, a graduate of "sanctimonious" Blodgett College, with a year of additional study in a Chicago library school, works as a librarian in St. Paul

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L4:289 excites
  2. L5:490 excites
  3. L3:493 suppresses
  4. L7:2824 suppresses
  5. L4:1966 suppresses
  6. L2:2307 weakly excites
  7. L0:781 weakly suppresses
  8. L6:2937 weakly suppresses 'by' after a title or author credit
  9. L4:430 weakly excites
  10. L3:3065 weakly excites
  11. L3:1583 weakly excites
  12. L5:910 weakly suppresses
  13. L2:963 weakly excites
  14. L4:2389 weakly suppresses
  15. L1:1895 weakly excites
  16. L4:2642 weakly excites
  17. L2:2824 weakly excites
  18. L1:3004 weakly excites
  19. L3:1200 weakly suppresses
  20. L4:1226 weakly excites
  21. L4:1834 weakly excites unclear: time spans and 'once you've'
  22. L1:2621 weakly excites
  23. L3:1489 weakly suppresses
  24. L4:1639 weakly excites

Feeds later layers

  1. L16:1028 suppresses "in" after a superlative or ordinal
  2. L19:649 suppresses
  3. L21:1935 suppresses
  4. L16:1557 suppresses 'in' meaning 'in this case' or 'in between'
  5. L23:1366 suppresses
  6. L25:1865 suppresses 'in' in 'keep in mind'
  7. L19:1345 suppresses
  8. L17:165 suppresses
  9. L19:704 suppresses
  10. L17:2609 suppresses
  11. L23:967 suppresses
  12. L18:1588 suppresses
  13. L17:2126 suppresses
  14. L15:871 suppresses
  15. L17:706 suppresses
  16. L16:2892 suppresses
  17. L25:2957 suppresses 'in' starting a word fragment
  18. L23:2136 suppresses 'in' after a noun phrase
  19. L16:1807 suppresses 'in' after a motion verb
  20. L12:1066 excites
  21. L24:2155 suppresses
  22. L9:3031 suppresses
  23. L16:2480 suppresses
  24. L11:1187 suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -5.22 and -5.062 values between -4.58 and -4.421 values between -4.42 and -4.263 values between -4.26 and -4.111 values between -4.11 and -3.951 values between -3.95 and -3.791 values between -3.63 and -3.471 values between -3.47 and -3.312 values between -3.31 and -3.151 values between -3.15 and -3.002 values between -3.00 and -2.842 values between -2.84 and -2.686 values between -2.68 and -2.523 values between -2.52 and -2.367 values between -2.36 and -2.203 values between -2.20 and -2.044 values between -2.04 and -1.882 values between -1.88 and -1.734 values between -1.73 and -1.579 values between -1.57 and -1.416 values between -1.41 and -1.257 values between -1.25 and -1.0914 values between -1.09 and -0.933 values between -0.93 and -0.7717 values between -0.77 and -0.6217 values between -0.62 and -0.4627 values between -0.46 and -0.30145 values between -0.30 and -0.141170 values between -0.14 and 0.021615 values between 0.02 and 0.18682 values between 0.18 and 0.34136 values between 0.34 and 0.5010 values between 0.50 and 0.651 values between 0.65 and 0.812 values between 0.97 and 1.13offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 自动生成
  2. рядом
  3. Ire
  4. addChild
  5. onView
  6. ро
  7. icularly
  8. requests
  9. requestData
  10. addChild

Suppresses

  1. context
  2. contexts
  3. areas
  4. jur
  5. case
  6. terms
  7. dont
  8. direction
  9. environments
  10. land