Neuron Explorer

Qwen3-0.6B

line break after a section heading

A neuron in layer 12 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the line break that comes right after a short heading, like 'Some shocking statistics' or 'Flavors Start in the Womb', just before the body text starts. Turning it up made the model's output drift into long, repetitive or unfocused text, so the steering result does not show a clear theme.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    ,” said Long, who formerly worked for Diné Citizens Against Ruining Our Environment, a Navajo environmental-activist organization.⏎The fossil fuel of the future⏎Dust billows at the Navajo Mine as a dragline excavator sco

  2. #2 peak

    disparities for African Americans as well as many other groups, highlights areas where some progress has been made, and lays out the paths toward significant solutions.⏎Some shocking statistics⏎These statistics provide some enlightening examples of what the report found — and the discrepancies

  3. #3 peak

    feeding advocates insist that flavors in breast milk go beyond a simple enjoyment for the infant -- it might be important for health too.⏎Flavors Start in the Womb⏎"The fact that the flavor is passed to the<|endoftext|>Masdar City was a project

  4. #4 peak

    such as Carrier parts, and how to maintain and replace them when necessary. This guide provides a comprehensive look into the world of HVAC parts.⏎Understanding Different HVAC Components⏎HVAC systems consist of several key components, each with a specific function. The

  5. #5 peak

    iev collection of Kubotas. Jacqueline Atkin, a North Carolina-based art curator and historian, is in charge of the whole collection.⏎A unique piece of art⏎The entire exhibit is composed of different pieces. While each piece aims to depict a

  6. #6 peak

    ). "Childhood cancer patients and families shouldn't have to delay treatment because hospitals and cancer treatment centers ran out of medication."⏎The Fight Against Childhood Cancer Continues⏎The NCCS has provided assistance to more than 30,00

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: "I am" and "I am, my, my, my, my, my, my, my, my, my, my, my, my, my, my, my, my, my, my, my, my

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    puzzle ideas put out there by Quora members.⏎Practical Applications in the Classroom⏎- A teacher-created Escape room can provide a valuable opportunity for students to<|endoftext|>Imagine a star (like our sun) wandering close to a supermassive black hole

  2. #2 peak

    particularly humanities classrooms. I had a lot to say, and, since I’m often asked “Why clickers?” I thought I would reproduce my comments here.⏎I’m a little late to this discussion, having just found it on a Google blog

  3. #3 peak

    hole⏎Answerwaist coat tail gate way side arm pit fall out put down cast off spring time line man hole⏎See another brain teaser just like this one...⏎Or, just get a random brain teaser⏎If you become a registered user you

  4. #4 peak

    resulted in similar findings. Thus, methods are defined for improving neural stem cell grafting, survival and analysis of in vivo findings.⏎21 Related JoVE Articles!⏎A Radio-telemetric System to Monitor Cardiovascular Function in Rats with Sp

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L11:784 suppresses
  2. L9:2729 suppresses
  3. L10:1136 suppresses
  4. L10:494 suppresses
  5. L9:542 excites
  6. L10:928 suppresses
  7. L10:1516 excites
  8. L11:1614 excites
  9. L9:2447 weakly excites
  10. L9:455 weakly suppresses
  11. L7:1729 weakly suppresses
  12. L10:1580 weakly suppresses
  13. L10:1340 weakly excites
  14. L8:422 weakly suppresses
  15. L8:708 weakly excites
  16. L9:1039 weakly excites
  17. L10:1244 weakly excites
  18. L10:2801 weakly excites
  19. L8:2976 weakly excites
  20. L8:1885 weakly excites
  21. L10:44 weakly suppresses
  22. L4:183 weakly excites
  23. L8:807 weakly excites
  24. L9:582 weakly excites

Feeds later layers

  1. L14:135 suppresses
  2. L14:2189 excites
  3. L16:818 excites
  4. L26:373 suppresses
  5. L18:412 excites
  6. L15:512 suppresses
  7. L14:2400 excites
  8. L14:1132 excites
  9. L14:241 excites
  10. L14:2061 excites
  11. L13:626 excites
  12. L16:1401 excites full stop ending an encyclopedia-style opening sentence
  13. L13:1498 weakly excites end of a document boundary
  14. L15:2047 weakly suppresses
  15. L17:1204 weakly excites
  16. L13:1103 weakly suppresses
  17. L17:1930 weakly excites
  18. L15:2293 weakly excites
  19. L13:52 weakly suppresses
  20. L19:2931 weakly excites
  21. L17:243 weakly suppresses
  22. L15:1956 weakly excites
  23. L16:1545 weakly excites
  24. L16:348 weakly suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -0.81 and -0.731 values between -0.73 and -0.644 values between -0.55 and -0.4711 values between -0.47 and -0.3831 values between -0.38 and -0.3088 values between -0.30 and -0.21337 values between -0.21 and -0.13858 values between -0.13 and -0.041602 values between -0.04 and 0.04623 values between 0.04 and 0.13204 values between 0.13 and 0.2160 values between 0.21 and 0.3028 values between 0.30 and 0.3919 values between 0.39 and 0.4712 values between 0.47 and 0.563 values between 0.56 and 0.646 values between 0.64 and 0.736 values between 0.73 and 0.814 values between 0.81 and 0.905 values between 0.90 and 0.981 values between 0.98 and 1.071 values between 1.15 and 1.241 values between 1.41 and 1.491 values between 1.49 and 1.581 values between 2.52 and 2.60offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. imen
  2. imens
  3. serter
  4. imer
  5. inker
  6. TI
  7. orer
  8. concentr
  9. PEND
  10. TI

Suppresses

  1. ฆ
  2. сан
  3. `.⏎⏎
  4. [];⏎⏎
  5. 参
  6. StatusLabel
  7. eco
  8. modelName
  9. ”.⏎⏎
  10. ”。⏎⏎