Neuron Explorer

Qwen3-0.6B

'that' after 'the good news is'

A neuron in layer 3 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word "that" when it introduces a full statement after phrases like "the good news is that" or "keep in mind that". Turning it up made the model write repetitive, circular sentences.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    as well as eggs. Along with beta-carotene and vitamin A, They protect your eyes from ultraviolet rays.⏎Keep in mind that your body needs a bit of healthy fat to best absorb these eye-benefitting

  2. #2 peak

    Shalgi, PhD, a professor at Technion Israel Institute of Technology and the study’s principal investigator, said in a press release.⏎“The good news is that since the ability is there, we hope future treatments can be developed to activate it

  3. #3 peak

    THMs). . Chloroform is an example of these TTHM’s. Some of these are either known or believed carcinogens.⏎The good news is that removing chlorine/chloramine also reduces TTHM’s, insecticides, pesticides

  4. #4 peak

    research interest in healthy ageing, I find that I am always being asked for tips on lifestyle steps to stay well for as long as possible. The good news is that it is never too late to take make changes to improve wellbeing. As our bodies

  5. #5 peak

    is generally agreed to be responsible for up to 85% of the visible signs of skin aging! The good news is that, in comparison to intrinsic skin aging, it is thought to be the more prevent

  6. #6 peak

    an underactive or absent thyroid gland. If the condition is not found and treated, children can have mental retardation and growth failure. But the good news is that early diagnosis and proper treatment can prevent these problems. In most cases,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I have been working on this issue, and I have been working on this issue. So, I have been working on this issue, and I have been working on this issue. I have been working on this issue. So, I have

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    speed.⏎So Howard bought two steamersa Stanley and a Doble. He had both shipped to California. He also owned a Cadillac, but he left that in Houston.⏎Like some of today's ecologists, Howard in 19

  2. #2 peak

    apply knowledge, think critically, imagine, be creative, be confident about being lifelong learners. It’s not simply about memorising facts and being able to recite that which one has memorised; it’s about knowing how to learn and knowing how

  3. #3 peak

    and try developing my own black and white film again. I don’t think people realize how easy it is, and how little equipment is needed. I’m not that smart; if I can do it, so can you!⏎To be clear,

  4. #4 peak

    DataTable name exists that matches the case of the search string, it is returned. Otherwise a case-insensitive search is performed, and if a DataTable name is found that matches this search, it is returned.⏎Use the Contains method to determine whether a

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L1:1427 excites 'that' after reporting verbs
  2. L1:1644 suppresses
  3. L2:1370 excites
  4. L1:1496 weakly excites
  5. L1:633 weakly excites 'that' after 'fact' or 'considering'
  6. L2:505 weakly excites
  7. L1:373 weakly suppresses
  8. L1:598 weakly excites
  9. L2:1259 weakly suppresses
  10. L0:1024 weakly suppresses
  11. L2:277 weakly excites
  12. L1:1130 weakly excites
  13. L1:2256 weakly suppresses
  14. L1:246 weakly excites comma after an introductory time phrase
  15. L1:1460 weakly excites
  16. L0:310 weakly suppresses
  17. L1:939 weakly suppresses
  18. L1:1620 weakly excites
  19. L2:2600 weakly excites
  20. L1:1332 weakly suppresses
  21. L2:1710 weakly suppresses
  22. L1:376 weakly excites
  23. L2:2171 weakly excites
  24. L1:1342 weakly suppresses

Feeds later layers

  1. L7:93 excites
  2. L4:2919 suppresses
  3. L4:223 weakly excites
  4. L8:2050 weakly suppresses
  5. L14:2381 weakly suppresses
  6. L17:2684 weakly excites
  7. L7:18 weakly excites
  8. L6:937 weakly excites
  9. L11:222 weakly suppresses
  10. L14:1434 weakly excites
  11. L6:206 weakly suppresses
  12. L10:137 weakly suppresses 'the' before a noun after 'of'
  13. L7:43 weakly excites
  14. L8:444 weakly excites
  15. L21:2663 weakly excites
  16. L20:2750 weakly suppresses
  17. L21:2303 weakly suppresses
  18. L12:1733 weakly suppresses
  19. L18:1063 weakly suppresses
  20. L5:95 weakly excites
  21. L14:1887 weakly suppresses
  22. L18:2604 weakly suppresses
  23. L4:227 weakly excites
  24. L10:583 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

4 values between -1.11 and -0.941 values between -0.94 and -0.784 values between -0.78 and -0.6119 values between -0.61 and -0.44105 values between -0.44 and -0.28697 values between -0.28 and -0.111914 values between -0.11 and 0.05977 values between 0.05 and 0.22133 values between 0.22 and 0.3915 values between 0.39 and 0.5510 values between 0.55 and 0.722 values between 0.72 and 0.884 values between 0.88 and 1.052 values between 1.05 and 1.223 values between 1.22 and 1.382 values between 1.38 and 1.553 values between 1.55 and 1.711 values between 1.71 and 1.881 values between 1.88 and 2.053 values between 2.05 and 2.211 values between 2.21 and 2.381 values between 2.38 and 2.542 values between 2.54 and 2.711 values between 2.88 and 3.041 values between 3.21 and 3.371 values between 4.70 and 4.871 values between 5.37 and 5.53offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. äre
  2. gren
  3. kü
  4. comb
  5. chie
  6. orm
  7. oby
  8. -sp
  9. die
  10. (skip

Suppresses

  1. うちに
  2. 疝
  3. FileChooser
  4. ráf
  5. JSX
  6. ixo
  7. GLFW
  8. 칙
  9. cvs
  10. ozilla