Neuron Explorer

Qwen3-0.6B

line breaks before page-section headings

A neuron in layer 2 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the invisible line break that comes right before a heading or a menu item on a web page, such as 'Back to top' followed by a section title. Turning it up made the text get stuck in loops, so the link to web-page layout is only a rough guide.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    from you. Maybe they never let you off the hook, even if you got 98 out of 100 on an exam.⏎Back to top⏎The Role of Indirect Aggression⏎What goes on outside the home is also

  2. #2 peak

    West.<|endoftext|>Two dimensional spatial coherence of skeletal muscle's natural vibrations during voluntary contractions.⏎Archer, Akibi A. A.⏎MetadataShow full item record⏎Low frequency mechanical vibrations (<100 Hz) are naturally generated by skeletal muscles

  3. #3 peak

    , have of you⏎- Having high expectations of other people⏎But whatever form it takes, perfectionism can rob you of life's pleasures.⏎Back to top⏎The Roots of Perfectionism⏎It may not be so easy to figure out

  4. #4 peak

    06,<|endoftext|>Book/Printed Material Kings of Arabia; the rise and set of the Turkish sovranty in the Arabian peninsula,⏎About this Item⏎- Kings of Arabia; the rise and set of the Turkish sovranty

  5. #5 peak

    of balloons.⏎Submit a review<|endoftext|>1 year ago⏎Verified Sherpa Tutor⏎If a liquid has a definite volume, what this would mean is that you can

  6. #6 peak

    the persecutions suffered by Jews and Judaism in exile was not the decimation of our numbers, but the injury to Jewish...⏎Become a Member⏎Read all member content⏎Get exclusive in-depth reports from Israel.⏎Get exclusive in

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: I I E the in_ eInI1_tT__nT T__In_In_In_Pa_In_H_In_In_P_p_hStartH_pHi in_pP_start

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    . Choose the book you like when you register 4.⏎Discussion questions for ‘The Death and Life of the Great Lakes’⏎Skip to search form Skip to main content You are currently offline. Some features of the site may not work correctly.

  2. #2 peak

    rairie View A&M College⏎Rights© 2021 Prairie View A & M University⏎This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.⏎Date of Digitization⏎John B Coleman Library

  3. #3 peak

    NIZZOLI, Giampaolo ROSSETTI, Pierluigi VIAROLI⏎This work is licensed under a Creative Commons Attribution-NonCommercial 4.

  4. #4 peak

    ⏎Copyrights and publishing rights of all the texts on this journal belong to the respective authors without restrictions.⏎This journal is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License (full legal code).⏎

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L1:316 excites
  2. L0:1449 weakly suppresses
  3. L1:1623 weakly suppresses
  4. L1:1743 weakly suppresses
  5. L1:2340 weakly suppresses
  6. L1:1721 weakly suppresses
  7. L1:2683 weakly excites
  8. L0:1547 weakly suppresses
  9. L1:572 weakly excites
  10. L1:1464 weakly excites
  11. L1:2172 weakly suppresses
  12. L1:917 weakly excites
  13. L0:299 weakly excites
  14. L0:1265 weakly excites
  15. L1:1340 weakly suppresses
  16. L1:1407 weakly excites
  17. L1:1099 weakly excites
  18. L1:416 weakly suppresses
  19. L1:1651 weakly suppresses 'of' after 'full'
  20. L1:595 weakly excites
  21. L1:1126 weakly excites
  22. L1:251 weakly excites
  23. L0:479 weakly suppresses
  24. L0:1369 weakly suppresses

Feeds later layers

  1. L3:115 suppresses
  2. L3:121 suppresses
  3. L4:1188 suppresses
  4. L13:151 weakly excites
  5. L4:245 weakly suppresses
  6. L3:767 weakly suppresses
  7. L19:2452 weakly suppresses
  8. L4:38 weakly suppresses
  9. L4:2521 weakly suppresses
  10. L8:432 weakly suppresses
  11. L12:1240 weakly suppresses
  12. L5:2813 weakly excites 'in place' after 'in'
  13. L6:1161 weakly suppresses
  14. L7:997 weakly suppresses
  15. L14:789 weakly excites
  16. L3:2926 weakly suppresses
  17. L3:1161 weakly suppresses first digit after 'more than'
  18. L13:2982 weakly suppresses
  19. L10:1952 weakly suppresses
  20. L3:945 weakly suppresses
  21. L6:2437 weakly suppresses
  22. L17:1323 weakly suppresses
  23. L3:480 weakly suppresses
  24. L3:2578 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -0.64 and -0.602 values between -0.55 and -0.501 values between -0.50 and -0.463 values between -0.41 and -0.3710 values between -0.37 and -0.3222 values between -0.32 and -0.2866 values between -0.28 and -0.23108 values between -0.23 and -0.19233 values between -0.19 and -0.14428 values between -0.14 and -0.10586 values between -0.10 and -0.05709 values between -0.05 and -0.01658 values between -0.01 and 0.04484 values between 0.04 and 0.08291 values between 0.08 and 0.13164 values between 0.13 and 0.1783 values between 0.17 and 0.2236 values between 0.22 and 0.2611 values between 0.26 and 0.316 values between 0.31 and 0.351 values between 0.44 and 0.491 values between 0.49 and 0.531 values between 0.53 and 0.581 values between 0.89 and 0.941 values between 0.94 and 0.981 values between 1.12 and 1.16offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ственные
  2. agrams
  3. disciplinary
  4. تك
  5. into
  6. grids
  7. aturas
  8. agna
  9. indeed
  10. Guinea

Suppresses

  1. center
  2. http
  3. OOT
  4. ocation
  5. https
  6. endment
  7. cent
  8. Third
  9. former
  10. oz