Neuron Explorer

Qwen3-0.6B

'in' after high or low

A neuron in layer 2 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word 'in' when it follows 'high' or 'low', as in 'high in fiber' or 'low in fat'. It tends to go quiet on question words like 'when' followed by a verb. Turning it up did not produce any clear change in topic.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    eat celery! Celery contains a lot of vitamins and is high in fiber, therefore it is safe for consumption and can benefit your cat. Celery

  2. #2 peak

    broth, ginger ale, and saltine crackers, also soothe the stomach.⏎- Avoid eating foods that are high in fat and salt.⏎- Try to eat before you get hungry and before nausea occurs

  3. #3 peak

    blood pressure [*].⏎Focus on foods high in potassium too. Potassium is an electrolyte needed to balance out too much sodium

  4. #4 peak

    fiber to create the proper stool consistency. If your stools are too hard, add fluid; if too loose, add fiber.⏎There are many foods that are high in fiber per serving, such as beets, beans, peas, sweet potatoes,

  5. #5 peak

    but because you can never collect too many.<|endoftext|>Scientists have discovered that a diet which is high in salt, can have major effects on the brain and in mice, can lead to

  6. #6 peak

    of plant protein and risk of death (from any cause) - the more plant protein in the diet, the lower the risk of death.⏎What foods are high in plant protein? Legumes (beans,lentils,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: "I have been thinking about this for a long time" (so long) as many times: (so many times: so long: so long: so long: so long: so long: so long: so long: so long

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    trends. Second, discuss how this data may be used by hospital systems, medical practitioners, and government agencies.<|endoftext|>Cyberspace Computers and Cyberspace When does reality end and cyberspace begin? Can crimes committed in cyberspace be

  2. #2 peak

    What is your name?: saha wasta na anjeun?|⏎|Where do you live?: timana anjeun kantun?⏎|When can we meet?: timana tiasa anjeuna sadaya papangg

  3. #3 peak

    celebrations responds to the first questions⏎posed by the faithful regarding this subject:⏎- Who celebrates the liturgy?⏎- How is the liturgy celebrated?⏎- When is the liturgy celebrated?⏎- Where is the liturgy celebrated?<|endoftext|>A particle

  4. #4 peak

    ?⏎(b) In what quantity?⏎(c) At what price?⏎(d) When do they want (it)?⏎(e) What kind of advertisement do they like?⏎(f

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L1:148 suppresses
  2. L1:1695 weakly suppresses
  3. L0:2301 weakly excites
  4. L0:960 weakly suppresses
  5. L1:2063 weakly excites
  6. L1:1388 weakly excites
  7. L1:505 weakly suppresses
  8. L1:170 weakly excites
  9. L1:1919 weakly suppresses
  10. L0:2406 weakly excites
  11. L1:2128 weakly suppresses
  12. L1:1941 weakly excites
  13. L1:2689 weakly excites
  14. L1:92 weakly excites
  15. L1:1108 weakly excites
  16. L1:1756 weakly excites
  17. L1:1371 weakly suppresses
  18. L1:347 weakly suppresses
  19. L0:781 weakly suppresses
  20. L0:2625 weakly excites
  21. L1:2660 weakly excites
  22. L0:1879 weakly suppresses
  23. L0:1566 weakly suppresses
  24. L1:2533 weakly excites

Feeds later layers

  1. L16:583 suppresses
  2. L5:55 suppresses
  3. L20:1387 suppresses
  4. L17:923 suppresses
  5. L21:1557 suppresses
  6. L4:2725 suppresses
  7. L19:1929 suppresses timestamps and dates in text
  8. L17:1662 suppresses
  9. L18:1505 suppresses
  10. L4:1834 suppresses unclear: time spans and 'once you've'
  11. L7:451 suppresses
  12. L19:2799 suppresses
  13. L9:619 suppresses
  14. L16:1504 suppresses
  15. L6:213 suppresses
  16. L18:2750 suppresses
  17. L10:1212 suppresses
  18. L4:2784 suppresses
  19. L18:1933 weakly suppresses
  20. L10:591 weakly suppresses
  21. L9:383 weakly suppresses
  22. L8:1749 weakly suppresses
  23. L8:1916 weakly suppresses
  24. L4:1093 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -1.18 and -1.092 values between -1.09 and -1.011 values between -1.01 and -0.924 values between -0.92 and -0.833 values between -0.83 and -0.743 values between -0.74 and -0.665 values between -0.66 and -0.5713 values between -0.57 and -0.486 values between -0.48 and -0.4016 values between -0.40 and -0.3139 values between -0.31 and -0.22139 values between -0.22 and -0.13568 values between -0.13 and -0.052189 values between -0.05 and 0.04620 values between 0.04 and 0.13193 values between 0.13 and 0.2165 values between 0.21 and 0.3022 values between 0.30 and 0.396 values between 0.39 and 0.483 values between 0.48 and 0.563 values between 0.56 and 0.651 values between 0.65 and 0.741 values between 0.74 and 0.823 values between 1.00 and 1.091 values between 1.35 and 1.431 values between 2.22 and 2.31offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. erve
  2. tá
  3. itori
  4. position
  5. степ
  6. strncmp
  7. 夷
  8. 阶级
  9. Sizer
  10. EFI

Suppresses

  1. icals
  2. repetition
  3. uin
  4. /action
  5. ,ID
  6. owo
  7. ewis
  8. ;p
  9. <IEnumerable
  10. curring