Neuron Explorer

Qwen3-0.6B

'in' after a past participle

A neuron in layer 20 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron reacts to the word 'in' when it follows a verb or noun and introduces a place or time, like 'built in 1245' or 'found in their hundreds'. The snippets are fairly consistent, but turning the neuron up or down did not make the writing change in a recognisable way.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    8-year veteran of Louisiana coastal surveys, and Steve Gill, senior scientist at the agency’s Center for Operational Oceanographic Products and Services, spelled out the grim reality in interviews with The Lens. When new data on the rate of coastal subsidence is

  2. #2 peak

    -speed winds buffeted them about.⏎“Absolutely impossible,” declared Per Lindstrand, a Swedish aeronautical engineer and perhaps the world’s best-known balloonist, in an early Wired article about the project. “Just talk to anybody in the scientific

  3. #3 peak

    a millennium, but because in addition to the weapons and the precious gold jewelry, the raw materials for making bronze (tin and copper ingots) were also found in their hundreds. According to researchers from Oxford University, the implications of this is that

  4. #4 peak

    the first recorded use of the term occurred in 1712. The abbey’s best wines were set aside to be stored in a special cellar built in 1245, and it was later

  5. #5 peak

    views. You can make each one a block then place them one after the other down the page. Consider a shop.⏎A shop might list the top selling product in each category with a view sorted by category. The marketing manager then asks for the

  6. #6 peak

    larger opening to maximize light at night.⏎Schmitz and Motani measured the inner and outer dimensions of this ring, plus the size of the eye socket, in 33 fossils of dinosaurs, ancestral birds and pterosaurs. They also

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: *This is a lot of life, a lot of work, and a lot of ***life* *** *life is a lot of life, a lot of work, a lot of ***life* *** *life *

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    One student can change the chemistry of whole class. How do you bring balance to the Force in your class?⏎Here’s my response:⏎A sad truism about classroom dynamics is that it is far easier for one negative

  2. #2 peak

    dont have all the answers. Young children, in particular, seem to expect parents to be all knowing - even about death. But death, the one certainty in all life, if lifes greatest uncertainty. Coming to terms with death can be a lifelong

  3. #3 peak

    world from that different angle at an early age so that they want to explore and engage with a variety of topics and ideas.⏎There are three simple things we do in our home to inspire creativity

  4. #4 peak

    2021 enumeration.⏎Though the Government of India had decided on the policy of official discouragement of caste, no one can deny that caste is a reality in India. In order to compensate the birth based discriminations and the centuries ridden social

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L17:706 excites
  2. L16:1807 suppresses 'in' after a motion verb
  3. L14:2458 suppresses
  4. L19:1986 excites 'into' after a verb or 'well'
  5. L18:2266 suppresses
  6. L19:2731 weakly suppresses
  7. L19:1881 weakly suppresses
  8. L12:1169 weakly excites
  9. L15:2361 weakly excites
  10. L4:4 weakly suppresses
  11. L11:2497 weakly suppresses
  12. L0:2759 weakly excites
  13. L18:1588 weakly excites
  14. L19:2371 weakly excites
  15. L13:1320 weakly suppresses
  16. L16:2155 weakly suppresses
  17. L18:2321 weakly suppresses
  18. L8:3068 weakly suppresses
  19. L12:1904 weakly suppresses
  20. L6:131 weakly suppresses
  21. L16:1557 weakly excites 'in' meaning 'in this case' or 'in between'
  22. L17:2954 weakly excites
  23. L14:1857 weakly excites
  24. L16:2180 weakly excites

Feeds later layers

  1. L21:1169 excites
  2. L21:2397 weakly suppresses
  3. L22:1672 weakly suppresses
  4. L21:2944 weakly suppresses
  5. L23:1389 weakly suppresses
  6. L25:125 weakly suppresses
  7. L26:2919 weakly excites
  8. L21:942 weakly suppresses
  9. L23:1273 weakly excites
  10. L22:2433 weakly suppresses
  11. L24:691 weakly suppresses
  12. L27:1087 weakly excites
  13. L27:524 weakly excites
  14. L23:353 weakly suppresses
  15. L27:3017 weakly excites
  16. L22:1706 weakly suppresses
  17. L27:1779 weakly excites
  18. L21:1574 weakly suppresses
  19. L24:1174 weakly suppresses
  20. L26:2442 weakly excites
  21. L26:717 weakly excites
  22. L26:927 weakly suppresses
  23. L27:536 weakly suppresses
  24. L24:690 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

2 values between -9.41 and -8.654 values between -7.88 and -7.125 values between -7.12 and -6.364 values between -6.36 and -5.6017 values between -5.60 and -4.8421 values between -4.84 and -4.0730 values between -4.07 and -3.3157 values between -3.31 and -2.55108 values between -2.55 and -1.79179 values between -1.79 and -1.03514 values between -1.03 and -0.272347 values between -0.27 and 0.50314 values between 0.50 and 1.26124 values between 1.26 and 2.0258 values between 2.02 and 2.7837 values between 2.78 and 3.5429 values between 3.54 and 4.319 values between 4.31 and 5.0713 values between 5.07 and 5.837 values between 5.83 and 6.595 values between 6.59 and 7.355 values between 7.35 and 8.113 values between 8.11 and 8.884 values between 8.88 and 9.644 values between 9.64 and 10.402 values between 11.92 and 12.681 values between 12.68 and 13.451 values between 13.45 and 14.211 values between 14.97 and 15.731 values between 15.73 and 16.491 values between 18.02 and 18.781 values between 20.30 and 21.06offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. pite
  2. parted
  3. ecome
  4. ILINE
  5. CALE
  6. 在哪里
  7. LIABLE
  8. result
  9. 魂
  10. (raw

Suppresses

  1. medicine
  2. *d
  3. 澍
  4. ーション
  5. 书面
  6. иж
  7. 企
  8. _pointer
  9. Croatia
  10. writing