Neuron Explorer

Qwen3-0.6B

the word 'this' after a preposition

A neuron in layer 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron responds to the word 'this' when it follows a preposition, as in 'using this form', 'see this article' or 'buy this book'. It is pushed the other way by words like 'That', 'This' or 'These' that start a new sentence. Turning it up or down did not give steered text that clearly relates to this word.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    27.5 West). 38 meter/pixel resolution.⏎Note: this THEMIS visual image has not been radiometrically nor geometrically calibrated for this preliminary release. An empirical correction has been performed to remove instrumental effects. A linear

  2. #2 peak

    Android mobile device you will need the Adobe Digital Editions app, or BlueFire Reader or Txtr app. These are free, too. For more details see this article.⏎|Size: ||359 KB|⏎|Date published: ||

  3. #3 peak

    What professor is this problem relevant for?⏎Based on our data, we think this problem is relevant for Professor Finnegan's class at WSU.⏎What textbook is this problem found in?⏎Our data indicates that this problem or a close variation was asked

  4. #4 peak

    10th - 12th English Language Arts⏎Lesson Plan: The State of the Union⏎Learners explore the state of the union. In this U.S. government lesson, students analyze the 1998 State of

  5. #5 peak

    Android mobile device you will need the Adobe Digital Editions app, or BlueFire Reader or Txtr app. These are free, too. For more details see this article.⏎|Size: ||4.4 MB|⏎|Publisher: ||CRC

  6. #6 peak

    , Butler, Clark, Clermont, Delaware, Franklin, Greene, Hamilton, Montgomery and Warren.⏎Dead birds should be reported to the Ohio Division of Wildlife using this form.⏎"Kentucky Fish and Wildlife has received 2,300

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: this is that "something that which that that that that" that that that that that that that that that that that that that that that that that that that that that that that that that that that that that that that that that that that that

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    in each of our cells that holds the architectural plan of our body and physical functions. Over the generations, DNA changes at a presumably steady rate. For birds, that's about 2% change (for mitochondrial DNA) in a million years --

  2. #2 peak

    are many reasons to switch to solar mobile power sources. The first reason is that solar energy is a renewable resource. This means that it will never run out and we can rely on it for our energy

  3. #3 peak

    blood vessels become narrow, blood flow tends to slow down and form clots. These clots may get dislodged and block other blood vessels. Depending on the

  4. #4 peak

    success for domestic rubbish. This is because the biomass in domestic rubbish can only be gasified at low temperatures, but this in turn creates tars and waxes that stifle the process.⏎However,

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L4:968 excites
  2. L10:965 suppresses the word 'that' introducing a clause
  3. L4:468 excites "that" after "than" or "like"
  4. L12:521 excites
  5. L9:82 suppresses
  6. L0:1035 excites
  7. L10:167 suppresses
  8. L11:199 excites
  9. L6:1080 excites "that" as a pointing word
  10. L6:1218 suppresses
  11. L13:112 suppresses
  12. L1:1318 excites
  13. L4:270 suppresses
  14. L14:2364 weakly suppresses
  15. L8:10 weakly excites
  16. L14:1807 weakly suppresses
  17. L14:332 weakly excites
  18. L3:1004 weakly excites
  19. L5:125 weakly excites "of" after all three, both, ten
  20. L12:51 weakly suppresses
  21. L12:336 weakly excites
  22. L12:431 weakly excites
  23. L1:2290 weakly suppresses
  24. L3:1068 weakly excites "that" pointing back to a noun

Feeds later layers

  1. L17:2011 strongly suppresses
  2. L16:2466 strongly suppresses
  3. L17:221 strongly suppresses
  4. L16:2861 suppresses
  5. L19:1737 suppresses
  6. L17:1816 suppresses
  7. L19:2547 suppresses
  8. L20:1175 suppresses
  9. L17:390 suppresses
  10. L18:1422 suppresses
  11. L19:1341 suppresses "this" after a time phrase
  12. L18:305 suppresses
  13. L16:815 suppresses 'the' before a noun mid-sentence
  14. L18:1944 suppresses
  15. L16:266 excites
  16. L19:1543 suppresses
  17. L25:926 suppresses
  18. L17:1022 suppresses
  19. L22:2625 suppresses
  20. L20:1601 suppresses
  21. L16:2660 suppresses
  22. L19:2958 suppresses
  23. L17:510 suppresses
  24. L20:866 suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -16.50 and -16.043 values between -15.12 and -14.661 values between -14.66 and -14.204 values between -14.20 and -13.741 values between -13.74 and -13.282 values between -13.28 and -12.821 values between -12.82 and -12.362 values between -12.36 and -11.901 values between -11.90 and -11.441 values between -11.44 and -10.984 values between -10.98 and -10.521 values between -10.52 and -10.062 values between -10.06 and -9.612 values between -9.61 and -9.152 values between -8.23 and -7.773 values between -7.77 and -7.311 values between -7.31 and -6.853 values between -6.39 and -5.932 values between -4.55 and -4.092 values between -4.09 and -3.632 values between -3.63 and -3.171 values between -3.17 and -2.711 values between -2.25 and -1.793 values between -1.79 and -1.339 values between -1.33 and -0.878 values between -0.87 and -0.41471 values between -0.41 and 0.052770 values between 0.05 and 0.51576 values between 0.51 and 0.9727 values between 0.97 and 1.431 values between 1.43 and 1.89offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ivals
  2. ourage
  3. nees
  4. 역
  5. -thumb
  6. >?
  7. 椰
  8. arger
  9. Reflex
  10. coc

Suppresses

  1. section
  2. 过程
  3. kind
  4. process
  5. 方面的
  6. enta
  7. happening
  8. 家伙
  9. tering
  10. ഹ