Neuron Explorer

Qwen3-0.6B

"the" inside a prepositional phrase

A neuron in layer 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron lights up on the word "the" when it sits inside a phrase like "of the week," "at the same time" or "in the end," where a noun is about to follow. When it was turned up, the model fell into loops of "the" and "of the."

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    may be on call one day of the week or all week. Surgeons may work late-night or early-morning<|endoftext|>

  2. #2 peak

    of water (8 oz/240 mL).⏎Take Ampicillin on a regular schedule to get the most benefit from it. Taking Ampicillin at the same time each day will help you remember to take it.⏎To clear up your

  3. #3 peak

    (Session I)⏎Please note that presentation times are approximate. If you are interested in attending sessions with multiple presentations, please be in the room at the start of the session.<|endoftext|>Healthy Food on a Shoestring Budget

  4. #4 peak

    . This may lead to a difficulty in controlling your metabolism and a general slowing of the metabolism. The latter of these typically makes it much harder to lose weight in the end. Yoyo dieting may also put other strains on different parts of your

  5. #5 peak

    most common factors that cause a receding hairline and male pattern baldness are:⏎1. Genetically Caused – Sometimes hair loss occurs because it runs in the family. Yes, hair loss and baldness can be genetic. It was thought

  6. #6 peak

    adults focus on the value of being in the class and helping the class become a successful place of learning.⏎The instructor presented a

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: of all (or any) any of my such of the my kind of any of... of (I, or any of such, of the and... of the of (some) of the... of the of... of all of the

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    Numeral 1 in Roman Numerals converter tool is available here. This tool can prove to be very handy in the conversion of Arabic to Roman numerals. The tool basically works on a very simple concept of format conversion. In other words you

  2. #2 peak

    ⏎When it comes to supplementing methionine in swine diets, the two primary sources are HMTBa (2-hydroxy-4-methyl

  3. #3 peak

    |⏎|Numbers||Mm in m||M in mm|⏎Some another meter to mm converter examples⏎The meters to millimeters converter is a great tool. The converter has a wide range of applications, both for individual and scientific applications. Often

  4. #4 peak

    13.5 out of 15 as a percent, you’d enter a 13.5 out of 15 into a calculator. The calculator will do the rest, including converting the decimal to a percentage.⏎To find

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L9:24 strongly excites "the" before a named organisation or title
  2. L4:52 strongly excites
  3. L3:291 excites
  4. L0:26 suppresses
  5. L6:61 suppresses
  6. L1:59 excites 'the' after a verb or preposition
  7. L12:435 suppresses
  8. L10:120 suppresses
  9. L10:1377 suppresses
  10. L9:662 suppresses
  11. L1:2597 suppresses
  12. L14:169 suppresses
  13. L0:39 excites 'the' right after 'On' in 'On the other hand'
  14. L14:254 excites
  15. L0:774 suppresses
  16. L5:1172 excites
  17. L2:73 suppresses
  18. L15:78 excites
  19. L5:558 excites
  20. L11:1168 excites
  21. L6:13 excites
  22. L15:82 suppresses
  23. L15:136 suppresses
  24. L9:1811 weakly excites

Feeds later layers

  1. L17:30 strongly excites
  2. L18:641 strongly excites
  3. L20:361 strongly excites
  4. L17:2190 strongly excites 'the' starting an object phrase
  5. L26:1941 strongly excites
  6. L21:614 excites
  7. L18:2380 excites "the" after certain verbs and prepositions
  8. L19:427 excites
  9. L17:1481 excites 'the' after 'some of' or 'most of'
  10. L19:3016 excites
  11. L18:799 excites
  12. L18:3000 excites
  13. L19:1376 excites
  14. L18:1547 excites
  15. L22:182 excites
  16. L18:355 suppresses
  17. L17:1652 suppresses
  18. L17:1056 suppresses
  19. L17:2135 excites 'the' after 'of' and similar words
  20. L20:1246 excites
  21. L17:2970 excites
  22. L18:602 excites
  23. L19:2492 excites "one of" before a group
  24. L27:148 excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

29 values between -2.22 and -1.52617 values between -1.52 and -0.822829 values between -0.82 and -0.12248 values between -0.12 and 0.5912 values between 0.59 and 1.296 values between 1.29 and 1.995 values between 1.99 and 2.695 values between 2.69 and 3.407 values between 3.40 and 4.105 values between 4.10 and 4.805 values between 4.80 and 5.505 values between 5.50 and 6.216 values between 6.21 and 6.916 values between 6.91 and 7.616 values between 7.61 and 8.314 values between 8.31 and 9.027 values between 9.02 and 9.729 values between 9.72 and 10.429 values between 10.42 and 11.124 values between 11.12 and 11.8311 values between 11.83 and 12.5315 values between 12.53 and 13.239 values between 13.23 and 13.934 values between 13.93 and 14.647 values between 14.64 and 15.346 values between 15.34 and 16.048 values between 16.04 and 16.742 values between 16.74 and 17.454 values between 17.45 and 18.156 values between 18.15 and 18.853 values between 18.85 and 19.553 values between 19.55 and 20.261 values between 20.26 and 20.961 values between 21.66 and 22.363 values between 22.36 and 23.071 values between 25.17 and 25.88offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. oretical
  2. same
  3. latter
  4. ories
  5. same
  6. slightest
  7. resulting
  8. entire
  9. rest
  10. following

Suppresses

  1. mate
  2. themselves
  3. classmates
  4. 姹
  5. osterone
  6. 同事
  7. ende
  8. the
  9. 时段
  10. @author