Neuron Explorer

Qwen3-0.6B

"of" inside treaty names

A neuron in layer 10 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featured, so it has steering outputs.

What this neuron does

This neuron fires on the word "of" in historical treaty names such as "Treaty of Paris" or "Treaty of Versailles". Turning it up made the model drift into unrelated sentences about moral values and numbers.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    of Florida diplomatically in 1763 through the Peace of Paris, but Spain regained it after Britain's defeat by the American colonies and the subsequent Treaty of Versailles (1

  2. #2 peak

    the first recorded discovery of oil on the North American continent. The area where the spring is located has been a one square mile Seneca Reservation lot since the Treaty of Big Tree in 1797.⏎In 1927 a

  3. #3 peak

    a printer, a philosopher, and a statesman. She became a wife, a mother, and a widow. He signed the Declaration of Independence, the Treaty of Paris, and the Constitution. She strained to form the letters of her name.

  4. #4 peak

    signing of the Treaty of Paris in 1763.⏎Colonial Military Policy⏎Understanding the need

  5. #5 peak

    settlements in Virginia begins (1606-07). French and English territorial claims overlap Acadia. Acadia is recognized as French possession by the Treaty of Breda (1667). A Royal Charter (167

  6. #6 peak

    to do so.⏎Lenin had written The State and Revolution in Finland and outlined that he planned to create a single party State and did so gradually.⏎The Treaty of Brest

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: "What is a statement about the role of a company? I need to think about it." So, what can I say about a company? I need a statement. The purpose. The role of a company. The purpose of a company

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    testing the product. This involves checking the product against a predetermined set of requirements and validating that the product meets those requirements.⏎Examples of QC include technical reviews

  2. #2 peak

    months, depending on how often you receive injections, and how well you tolerate the injections.⏎Maintenance phase – This phase begins once your physician determines that you have reached your effective dose.

  3. #3 peak

    founded the Koryo dynasty. This dynasty, whose name is the basis of the word Korea, lasted until 1392.⏎Koryo had many Rulers. Koryo’s rulers continued to adopt Chinese ideas but worked to

  4. #4 peak

    very wise king who was always determined to live according to his principles.⏎Osasona was a successful farmer and one of the town’s richest people. He had many wives and children but made sure that all his wives and children embraced Christianity.⏎He

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L5:125 excites "of" after all three, both, ten
  2. L8:2201 excites
  3. L6:285 suppresses
  4. L8:1300 excites
  5. L6:1318 suppresses
  6. L7:2164 weakly suppresses period inside country abbreviations
  7. L9:2196 weakly excites
  8. L5:1763 weakly suppresses
  9. L8:892 weakly excites
  10. L6:1588 weakly excites
  11. L8:298 weakly excites
  12. L9:820 weakly excites
  13. L5:1511 weakly excites
  14. L9:2219 weakly excites
  15. L4:2085 weakly excites
  16. L8:508 weakly suppresses
  17. L8:553 weakly suppresses
  18. L4:731 weakly excites
  19. L1:445 weakly suppresses document start marker token
  20. L6:1518 weakly excites
  21. L8:636 weakly suppresses
  22. L4:2230 weakly suppresses
  23. L7:2063 weakly suppresses
  24. L8:1389 weakly suppresses

Feeds later layers

  1. L12:1053 excites
  2. L14:1774 excites
  3. L13:1651 excites
  4. L13:743 excites
  5. L21:1411 excites
  6. L17:2380 excites
  7. L19:2264 excites
  8. L14:2485 weakly excites
  9. L20:132 weakly excites
  10. L12:2046 weakly excites
  11. L14:1075 weakly excites
  12. L19:852 weakly excites
  13. L16:1608 weakly excites
  14. L14:453 weakly excites
  15. L14:193 weakly excites
  16. L16:284 weakly suppresses
  17. L13:74 weakly excites
  18. L16:1911 weakly excites
  19. L18:1700 weakly excites 'so' in 'and so on'
  20. L15:1798 weakly excites
  21. L25:1452 weakly excites
  22. L16:1179 weakly excites
  23. L14:1444 weakly excites
  24. L14:2156 weakly excites opening parenthesis after a term

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -4.52 and -4.351 values between -4.35 and -4.182 values between -3.66 and -3.491 values between -3.49 and -3.321 values between -3.32 and -3.142 values between -3.14 and -2.972 values between -2.97 and -2.804 values between -2.80 and -2.632 values between -2.63 and -2.454 values between -2.45 and -2.283 values between -2.28 and -2.113 values between -2.11 and -1.948 values between -1.94 and -1.768 values between -1.76 and -1.5911 values between -1.59 and -1.4225 values between -1.42 and -1.2530 values between -1.25 and -1.0730 values between -1.07 and -0.9034 values between -0.90 and -0.7351 values between -0.73 and -0.5658 values between -0.56 and -0.38163 values between -0.38 and -0.21628 values between -0.21 and -0.041164 values between -0.04 and 0.13750 values between 0.13 and 0.31398 values between 0.31 and 0.48254 values between 0.48 and 0.65116 values between 0.65 and 0.8268 values between 0.82 and 1.0035 values between 1.00 and 1.1727 values between 1.17 and 1.3415 values between 1.34 and 1.512 values between 1.51 and 1.694 values between 1.69 and 1.861 values between 1.86 and 2.031 values between 2.03 and 2.201 values between 2.20 and 2.38offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. itize
  2. случая
  3. 国家队
  4. Ẋ
  5. ⏎ ⏎ ⏎
  6. arrive
  7. dera
  8. ток
  9. stantiate
  10. Bring

Suppresses

  1. 水准
  2. CEED
  3. roud
  4. Ề
  5. hin
  6. 的空间
  7. sher
  8. OnClick
  9. cushions
  10. 人民服务