Neuron Explorer

Qwen3-0.6B

middle letters of capital acronyms

A neuron in layer 11 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featured, so it has steering outputs.

What this neuron does

This neuron responds to the inside letters of acronyms and abbreviations, such as the 'EP' in 'CEP' or the 'ND' in 'GND', where the word is only partly written. Its strongest negative responses come from the middle of long words and names, not from acronyms. Turning it up gave text that did not relate to acronyms.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

  1. #1 peak

    percent. This may extend eligibility to additional schools that could benefit from CEP. It may also increase the financial viability of electing CEP and maximize federal reimbursement. From school year 2013 to 2

  2. #2 peak

    <|endoftext|>Thread: FNG methods of attack question⏎05-06-2006, 05:45 PM #1⏎FNG methods of attack question⏎I read this a couple times and I'm still confused

  3. #3 peak

    Functions,⏎Spreadsheets in Education (eJSiE):⏎2, Article 1.⏎Available at: http://epublications.bond.edu.au/ejsie/vol8/iss2/1<|endoftext|>Some may argue that sleeping is

  4. #4 peak

    ⏎A recent poll from Data for Progress shows that 60 percent of U.S. voters support the GND. This support has materialized in local GND movements in every part of the country. And it’s not just in the U

  5. #5 peak

    82571(R); Published: 29-Nov-2022, DOI:10.35841/ aaajmr-6.11.155⏎Citation: Wook Y

  6. #6 peak

    companies or industries and applicable to their projects and products.⏎The STE specification is maintained by the ASD STEMG consisting of representatives from ASD member countries and non-ASD member countries. The STEMG was originally formed in 1983 as

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

turned down a lot
Prompt

Here is something I have been thinking about lately: What is the value of the function f(f(f(f(f(f(f(f(f(f(f(f(f(3))) f(x)),3) f(x),3 f(x) x(3) x(3) x(3)

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

  1. #1 peak

    Illustrated Bible Dictionary, Third Edition,⏎published by Thomas Nelson, 1897. Public Domain, copy freely.⏎Bibliography InformationEaston, Matthew George. "Entry for Tamarisk". "Easton

  2. #2 peak

    stampings, often in E-I shape pairs, but other shapes are sometimes used. Shields between primary and secondary may be fitted to reduce EMI (electromagnetic interference), or a screen winding is occasionally used.⏎Small appliance and electronics transformers may

  3. #3 peak

    02. He was unsuccessful, but hypothesized that hormones were necessary for proper development of plants in culture.⏎The first such hormone was IAA (Indole-acetic acid) in 1934. The use of IAA led

  4. #4 peak

    Smoke levels may be lower indoors but will still be elevated, so stay aware of your symptoms even when you are indoors.⏎Running a commercially available HEPA (high efficiency particulate air) filter

Connections

Show on map

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Fed by earlier layers

  1. L10:118 strongly excites
  2. L10:1747 strongly suppresses
  3. L8:1175 excites
  4. L10:576 weakly excites
  5. L7:12 weakly suppresses
  6. L4:817 weakly excites
  7. L0:2860 weakly excites
  8. L7:1404 weakly excites
  9. L10:2833 weakly suppresses
  10. L7:60 weakly suppresses
  11. L9:478 weakly excites
  12. L9:2275 weakly suppresses
  13. L5:1569 weakly suppresses
  14. L4:1931 weakly excites
  15. L8:2599 weakly suppresses
  16. L7:941 weakly suppresses
  17. L8:167 weakly suppresses
  18. L0:434 weakly excites
  19. L8:1271 weakly excites
  20. L10:2226 weakly suppresses
  21. L6:736 weakly excites
  22. L3:529 weakly suppresses
  23. L1:2051 weakly suppresses
  24. L0:16 weakly excites

Feeds later layers

  1. L13:2904 suppresses
  2. L17:1710 suppresses
  3. L12:614 excites
  4. L13:1045 excites
  5. L14:1098 suppresses
  6. L12:2137 suppresses
  7. L13:2722 suppresses
  8. L13:116 excites
  9. L12:627 suppresses
  10. L16:1734 suppresses
  11. L14:828 excites
  12. L13:1235 excites
  13. L15:1146 suppresses
  14. L14:1815 suppresses
  15. L21:1776 suppresses
  16. L14:2131 suppresses
  17. L12:541 excites
  18. L18:1308 suppresses opening parenthesis before an acronym
  19. L13:2790 suppresses
  20. L12:871 excites
  21. L14:2722 excites
  22. L12:1303 suppresses
  23. L12:1514 suppresses
  24. L18:1630 suppresses

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

1 values between -8.13 and -7.871 values between -3.58 and -3.331 values between -1.82 and -1.572 values between -1.57 and -1.317 values between -1.31 and -1.0611 values between -1.06 and -0.8121 values between -0.81 and -0.5671 values between -0.56 and -0.30813 values between -0.30 and -0.052750 values between -0.05 and 0.20215 values between 0.20 and 0.457 values between 0.45 and 0.715 values between 0.71 and 0.961 values between 0.96 and 1.212 values between 1.72 and 1.97offnegativepositiveoften

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.

Promotes

  1. ела
  2. STL
  3. akers
  4. HIS
  5. aceutical
  6. HSV
  7. ザー
  8. ipse
  9. aked
  10. weets

Suppresses

  1. anni
  2. 的能量
  3. owning
  4. 奈
  5. utow
  6. owan
  7. inin
  8. PropertyName
  9. pot
  10. ruk