Neuron Explorer

Qwen3-0.6B

'the' after 'is' or 'was' before a role

A neuron in layer 18 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word 'the' right after a verb like 'is' or 'was' when it introduces someone's role or title, as in 'he was the first'. Turned up, the model got stuck repeating 'the result of the', which fits its focus on the word 'the'.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    1236⏎|Died||1301 (aged 64–65)⏎Violant was born in Zaragoza, the daughter of King James I of Aragon (1213–12

  2. #2 peak

    - FRONT OF HOUSE⏎- AFTERWORD / THE PERFORMERS⏎Robert Sutherland-Cohen is the Associate Professor of Stage Management and Production Manager at Brooklyn College. He has been production

  3. #3 peak

    the rate of the global average.1⏎Gayle Tzemach Lemmon, a senior fellow at the Council on Foreign Relations as well as a journalist and the best-selling author of The Dressmaker of Khair Khana, believes that full

  4. #4 peak

    City & Regional Planning and Historic Preservation at the University of Pennsylvania Stuart Weitzman School of Design. A social and cultural historian of the built environment, she is the author of Bulldozer: Demolition and Clearance of the Postwar Landscape

  5. #5 peak

    of the Leopold Leadership Program at Stanford University. He is also the director of the Tree Biosafety and Genomics Research Cooperative at OSU that conducts

  6. #6 peak

    help measure brown fat deposits that aid in non-shivering thermogenesis.<|endoftext|>Gruoch of Scotland⏎Gruoch (* 1015) was the daughter of Bodhe, Prince of Scotland, and granddaughter of Kenneth III .. At

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: the most powerful ....................................................................................................................................

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    , this function is only declared as:⏎void * memchr ( const void *, int, size_t );⏎instead of the two overloaded versions provided in C++.⏎/* memchr example */⏎int main ()⏎char * pch;⏎char str = "

  2. #2 peak

    00) ⇒ #<marker at 100 in markers.texi>⏎;; Now insert one character at the beginning of the buffer: (goto-char (point

  3. #3 peak

    the problem of a two way lookup comes up quite often. In this article we explore 4 methods of how to conduct 2D lookups in Excel.⏎+++NEW+++NEW+++NEW+++ 2D XLOOKUP +++NEW+++NEW

  4. #4 peak

    Enchanted Learning website for:|⏎Copyright ©2002-2016 EnchantedLearning.com ------<|endoftext|>Next analogy uses the fresh etymology out of spam-unwanted rubbish email-to

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L13:1234 suppresses
  2. L16:2248 suppresses
  3. L9:662 suppresses
  4. L10:120 suppresses
  5. L10:1377 weakly suppresses
  6. L16:1212 weakly suppresses
  7. L2:2910 weakly excites
  8. L13:1345 weakly excites
  9. L1:1864 weakly suppresses
  10. L12:1990 weakly suppresses
  11. L3:1459 weakly excites
  12. L3:103 weakly excites
  13. L11:875 weakly suppresses
  14. L4:2742 weakly excites
  15. L10:221 weakly excites
  16. L17:2135 weakly excites 'the' after 'of' and similar words
  17. L17:35 weakly suppresses
  18. L3:1245 weakly excites
  19. L15:95 weakly suppresses
  20. L15:1848 weakly suppresses
  21. L17:2779 weakly suppresses
  22. L14:790 weakly excites
  23. L10:1924 weakly excites
  24. L11:259 weakly excites

Feeds later layers

  1. L20:2587 excites
  2. L20:2993 excites
  3. L19:3054 excites
  4. L23:1486 excites
  5. L19:1410 excites
  6. L21:2577 excites "the" in size comparisons
  7. L22:438 weakly excites
  8. L19:2973 weakly suppresses
  9. L19:2165 weakly excites
  10. L22:1824 weakly suppresses
  11. L25:823 weakly suppresses
  12. L20:2506 weakly excites
  13. L23:1149 weakly excites
  14. L20:2661 weakly suppresses
  15. L21:1422 weakly suppresses
  16. L24:2914 weakly suppresses
  17. L20:2625 weakly suppresses
  18. L22:202 weakly suppresses
  19. L20:2851 weakly excites
  20. L19:1725 weakly suppresses
  21. L19:1120 weakly suppresses
  22. L19:483 weakly suppresses
  23. L19:1775 weakly excites
  24. L20:1810 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

14 values between -1.46 and -1.02220 values between -1.02 and -0.581327 values between -0.58 and -0.141946 values between -0.14 and 0.31304 values between 0.31 and 0.7550 values between 0.75 and 1.199 values between 1.19 and 1.6312 values between 1.63 and 2.077 values between 2.07 and 2.512 values between 2.51 and 2.954 values between 2.95 and 3.402 values between 3.40 and 3.843 values between 3.84 and 4.281 values between 4.28 and 4.721 values between 4.72 and 5.161 values between 5.16 and 5.602 values between 6.49 and 6.931 values between 9.58 and 10.021 values between 12.67 and 13.111 values between 15.76 and 16.20offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. aines
  2. vic
  3. 谁知道
  4. ผล
  5. idenav
  6. amentos
  7. imentos
  8. ODY
  9. [result
  10. readcrumbs

Suppresses

  1. nnen
  2. ocytes
  3. vens
  4. filters
  5. Planner
  6. Filters
  7. agus
  8. Filters
  9. SPACE
  10. FILTER