Neuron Explorer

Qwen3-0.6B

'the' after a verb or preposition

A neuron in layer 16 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word 'the' when it comes right after a verb or preposition and leads into an abstract idea, as in 'beyond the limits', 'grappled with the significance' or 'belief in the dignity'. It is pushed the other way inside lists and tables. Steering had no clear visible effect, and the outputs went in different directions.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    will flow to diverse industries and areas of need—from environmental protection to homeland security to biotechnology.⏎Superlatively Stable Environment⏎Scientists and engineers working to push beyond the limits of today’s advanced technology crave stability. Even tiny variations in environmental conditions—a

  2. #2 peak

    in view of powerful symbolism. It is a fitting home for this museum, invoking the indelible threads that connect African American stories to the American tapestry," said Wayne Clough

  3. #3 peak

    inals, Anke Ortlepp’s incisive new history of the desegregation of American airports, demonstrates that almost every southern city grappled with the cultural and political significance of air travel during a time when racial segregation and black disfr

  4. #4 peak

    – Rio de Janerio, July 2013⏎Catholic Social Services⏎Catholicism and Christianity have as their foundations an inherent belief in the dignity of the human person.⏎The principles of Catholic Social Teaching suggest that our responsibilities

  5. #5 peak

    , as well as the entrepreneurial opportunities that arise from the emergence and evolution of 3D printing.⏎Not long ago, it was thought that space travel was beyond the scope of human capacity, yet astonishingly, technological advances allowed a human to walk

  6. #6 peak

    corporate and governmental anti-racism efforts?⏎Prior to the emergence of Critical Race Theory in the late 1980s, our culture labored under the notion that the problems of racism were getting better, and fast. After all,

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: one of the way to to be a way to be to be... (for the way I think of the way I think of the way I think of the way I think of the way of the way I think of the way I think

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    ulocytic Anaplasmosis (Ehrlichiosis)⏎|Deer (or Black-Legged) Tick⏎||Tear drop-shaped; the size of a poppy seed as adults⏎||Lyme disease, Equine

  2. #2 peak

    Moisture: Provide ample water during establishment. Once established, irises need little care. Hardiness: USDA Zones 4-10. Propagation: The creeping underground stems (rhizomes) spread rapidly and German iris soon forms a

  3. #3 peak

    breast cancer, representing only one percent of all breast cancer cases. Men have a one in 1,000 lifetime risk of contracting the disease, with the average age of detection being between 60 and 70 years.⏎“

  4. #4 peak

    to facilitate the shedding of the uterine lining. Uterine polyps can vary in size, with the smallest being only a few millimeters wide. The growths mostly occur in women

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L10:1377 strongly suppresses
  2. L10:120 strongly suppresses
  3. L9:662 strongly suppresses
  4. L11:1168 excites
  5. L9:24 excites "the" before a named organisation or title
  6. L2:205 excites
  7. L9:2198 excites
  8. L4:73 suppresses
  9. L15:888 excites
  10. L10:1644 excites
  11. L3:344 excites
  12. L13:1234 suppresses
  13. L4:52 excites
  14. L15:1848 suppresses
  15. L3:291 excites
  16. L10:1162 excites
  17. L8:636 suppresses
  18. L12:435 suppresses
  19. L13:824 suppresses
  20. L15:1611 suppresses
  21. L14:169 suppresses
  22. L1:59 excites 'the' after a verb or preposition
  23. L11:875 suppresses
  24. L6:61 suppresses

Feeds later layers

  1. L19:2911 weakly excites
  2. L17:1002 weakly excites
  3. L21:708 weakly excites
  4. L25:2409 weakly excites
  5. L20:469 weakly excites
  6. L20:755 weakly excites
  7. L17:2651 weakly suppresses
  8. L20:324 weakly suppresses
  9. L18:254 weakly suppresses
  10. L20:1340 weakly excites
  11. L17:528 weakly suppresses
  12. L24:1427 weakly suppresses
  13. L24:1215 weakly suppresses
  14. L17:1490 weakly excites
  15. L18:2323 weakly suppresses
  16. L23:1555 weakly excites
  17. L23:1468 weakly suppresses
  18. L25:2262 weakly excites
  19. L21:2913 weakly suppresses
  20. L18:2011 weakly excites
  21. L22:932 weakly suppresses
  22. L21:1787 weakly suppresses
  23. L23:290 weakly excites
  24. L17:1076 weakly excites

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

4 values between -4.73 and -4.413 values between -3.78 and -3.472 values between -3.47 and -3.151 values between -3.15 and -2.845 values between -2.84 and -2.528 values between -2.52 and -2.2112 values between -2.21 and -1.8916 values between -1.89 and -1.5813 values between -1.58 and -1.2628 values between -1.26 and -0.9544 values between -0.95 and -0.63315 values between -0.63 and -0.321839 values between -0.32 and 0.001329 values between 0.00 and 0.32130 values between 0.32 and 0.6346 values between 0.63 and 0.9523 values between 0.95 and 1.2616 values between 1.26 and 1.5811 values between 1.58 and 1.8912 values between 1.89 and 2.2113 values between 2.21 and 2.526 values between 2.52 and 2.847 values between 2.84 and 3.153 values between 3.15 and 3.473 values between 3.47 and 3.787 values between 3.78 and 4.101 values between 4.10 and 4.417 values between 4.41 and 4.731 values between 4.73 and 5.041 values between 6.93 and 7.252 values between 7.56 and 7.88offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ową
  2. ocoa
  3. ocations
  4. iffe
  5. iale
  6. onto
  7. ows
  8. assen
  9. rossover
  10. ourcem

Suppresses

  1. expensive
  2. Illustrated
  3. particular
  4. statistic
  5. Interesting
  6. précis
  7. hang
  8. able
  9. explanation
  10. rooting