Neuron Explorer

Qwen3-0.6B

'of' in 'end of' and 'middle of' phrases

A neuron in layer 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

The neuron lights up on the word 'of' in time phrases like 'by the end of', 'middle of' or 'as of', where a period of time is about to be named. It was quiet or pushed the other way on phrases about 'times' and 'cases' or situations. Turning it up did not produce a clear theme in the model's replies.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    hundreds of elementary students across the toronto district school board have been Children who attend preschool enter kindergarten with improved skills but that advantage is nearly halved by the end of the year quot ensuring that young children enter kindergarten

  2. #2 peak

    ways she could, including hosting musical soirées that included guests such as Wolfgang Amadeus Mozart.⏎Her music, though largely considered out of fashion by the end of her life, took many

  3. #3 peak

    of Know-how discovered that college students reported a 42% improve in stress and nervousness and a 38.7% improve in depression throughout the 90 days following lively shooter drills, in contrast with the 90 days

  4. #4 peak

    ekenen en vergelijken" on the citizen science platform MijnTuinlab (My Garden lab).⏎The project was enthusiastically received, as by the end of September the perimeters of more than 10,000 gardens had

  5. #5 peak

    who owned small firearms were encouraged to register them, while new requests for licences to carry firearms were suspended for a year. At the end of 2012, a draft arms control law was before Congress.Top of

  6. #6 peak

    of academic failure.⏎Over 30,000 students in DC Public Schools (DCPS) and public charter schools are considered at-risk. As of the

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I am not the case where I have to be. I am not the case where I have to be. I am not the case where I have to be. I am not the case where I have to be. So, what is

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    long as the allergy exists. Food challenge tests for safe re-introduction are performed under the supervision of a registered clinical expert, such as a diet<|endoftext|>There are times in history when prudent decisions have allowed France to maintain

  2. #2 peak

    vision very dark and fuzzy. When used in this way, a vignette will generally not be consciously detectable by the untrained eye. However, there are times when a more dramatic vignette is a useful effect, such as in a black

  3. #3 peak

    the lender will be assessing the borrower's ability to repay the loan based on a worst-case scenario interest rate. The calculation for individuals with irregular income may be different from those

  4. #4 peak

    cases, small samples of tissue are taken for further analysis. It may also be necessary to retain entire organs for a more detailed examination. This is strictly limited to cases where such retention<|endoftext|>Published August 30, 2004⏎

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L10:456 suppresses
  2. L10:262 suppresses
  3. L10:2346 suppresses
  4. L8:1760 weakly excites
  5. L8:1522 weakly excites
  6. L6:2090 weakly suppresses
  7. L4:779 weakly excites
  8. L8:2424 weakly excites
  9. L10:753 weakly excites
  10. L11:1893 weakly excites
  11. L9:2124 weakly excites
  12. L9:2819 weakly excites
  13. L7:3049 weakly suppresses
  14. L11:949 weakly excites
  15. L7:160 weakly suppresses
  16. L6:2362 weakly excites
  17. L7:2461 weakly excites
  18. L9:2425 weakly excites
  19. L10:2644 weakly suppresses
  20. L5:783 weakly suppresses
  21. L8:2520 weakly excites
  22. L1:3044 weakly excites
  23. L1:2550 weakly suppresses
  24. L4:219 weakly suppresses

Feeds later layers

  1. L16:1538 suppresses
  2. L13:2282 suppresses
  3. L23:1157 suppresses
  4. L20:2078 suppresses
  5. L17:1625 suppresses
  6. L18:2172 suppresses
  7. L23:1612 suppresses
  8. L22:2667 suppresses
  9. L27:2569 suppresses
  10. L14:2514 suppresses
  11. L16:2929 suppresses
  12. L13:368 weakly suppresses
  13. L25:2688 weakly suppresses
  14. L18:483 weakly excites
  15. L13:2122 weakly suppresses
  16. L20:924 weakly suppresses
  17. L22:2430 weakly suppresses
  18. L25:2200 weakly suppresses
  19. L21:1309 weakly suppresses
  20. L14:770 weakly suppresses
  21. L20:1355 weakly suppresses
  22. L14:2564 weakly excites unclear: word before a technical term
  23. L19:2680 weakly excites
  24. L16:2593 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -2.76 and -2.651 values between -2.43 and -2.321 values between -2.32 and -2.212 values between -1.99 and -1.881 values between -1.88 and -1.771 values between -1.66 and -1.552 values between -1.55 and -1.441 values between -1.44 and -1.331 values between -1.33 and -1.221 values between -1.22 and -1.112 values between -1.11 and -1.003 values between -1.00 and -0.893 values between -0.89 and -0.781 values between -0.78 and -0.676 values between -0.67 and -0.567 values between -0.56 and -0.4526 values between -0.45 and -0.34108 values between -0.34 and -0.23402 values between -0.23 and -0.121234 values between -0.12 and -0.011606 values between -0.01 and 0.10363 values between 0.10 and 0.2192 values between 0.21 and 0.3215 values between 0.32 and 0.4312 values between 0.43 and 0.544 values between 0.54 and 0.657 values between 0.65 and 0.761 values between 0.76 and 0.871 values between 0.98 and 1.091 values between 1.09 and 1.201 values between 1.42 and 1.531 values between 1.53 and 1.64offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. 敛
  2. iers
  3. mites
  4. ister
  5. lian
  6. Calder
  7. son
  8. calor
  9. kov
  10. rimon

Suppresses

  1. 情形
  2. 等情况
  3. 的情况
  4. situations
  5. 的情形
  6. cases
  7. 情况
  8. 情况下
  9. cases
  10. ситуации