academic and professional terms, college
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 5 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds to words from academic and professional writing, such as 'original' articles, 'professional' education and 'Applied' economics. It turns negative on words like 'college' and 'higher education'. Steering changed the text in ways that were mostly unrelated, with some drift toward students.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
such as business, medicine, the sciences, theology, history and humanities, among many others.⏎An academic journal also publishes different research types. Some of these include original articles, reviews, book reviews, case studies, short communications, and so on
-
ure.⏎New York licensed podiatrists have also passed comprehensive licensing examinations approved by the State Education Department. In addition, practicing podiatrists must satisfy annual continuing professional education requirements.⏎Podiatrists practice just about anywhere that health services are provided
-
Angus Deaton & Olivier Dupriez, 2011.⏎"Purchasing Power Parity Exchange Rates for the Global Poor,"⏎American Economic Journal: Applied Economics,⏎American Economic Association, vol. 3(2), pages 1
-
water testing labs can conduct a full-spectrum analysis of your water to determine its contents, there are a few types of contaminants
-
to the public.⏎How did the workforce change in the 1950s as a result of the changing economy? White collar workers began to outnumber blue collar workers. What contributed to the rise in life expectancy during the 195
-
awarded Caylor a $1.5 million Faculty Early Career Development (CAREER) grant to use laser-based sensors to study how vegetation in the region transports water
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the following is a small increase in the number of... of the..................... the following is a small increase in the number of... the following is a small increase in the number of... the following is a small increase
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of America.” Leaving the specifics up to a teacher or LEA who have only been educated in elementary education is ludicrous. Elementary teachers are taught how to teach in college, they are not taught content knowledge. Therefore, the teachers would need to rely
-
comparable learning experience and typically accredited to the higher education institutions.”⏎Mostly when students leave high schools they are choose honor courses over simple
-
.⏎Food insecurity has historically and disproportionately affected students of color, older students, former foster youth, parenting students, students who experienced childhood food insecurity, and first-generation college students.⏎A Hope Center study found that among 167,00
-
be manifested in only one specific academic area, such as math or foreign language. There might be problems in grade school, none in high school, and again in college.⏎Learning disabilities are not the same as mental retardation or emotional disorders.⏎Common
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L3:657 excites
- L3:1950 excites
- L3:880 suppresses
- L4:1795 suppresses "at least" phrase
- L1:2969 weakly suppresses
- L4:2063 weakly suppresses
- L2:1098 weakly excites
- L3:1155 weakly excites
- L4:2689 weakly suppresses
- L4:1880 weakly suppresses
- L4:3048 weakly excites
- L3:2324 weakly suppresses
- L3:2936 weakly excites
- L4:2299 weakly excites
- L2:59 weakly excites
- L4:2123 weakly excites
- L3:1691 weakly excites
- L0:1337 weakly excites
- L4:2583 weakly suppresses
- L2:3011 weakly excites
- L1:2553 weakly suppresses
- L4:1946 weakly suppresses
- L3:469 weakly suppresses
- L2:776 weakly excites
Feeds later layers
- L8:730 excites
- L21:2811 suppresses
- L9:627 suppresses
- L23:3004 weakly suppresses
- L19:2246 weakly suppresses
- L14:1341 weakly excites
- L16:1591 weakly suppresses
- L11:1426 weakly excites
- L17:2284 weakly excites
- L7:1957 weakly excites
- L15:2515 weakly excites
- L6:2307 weakly excites
- L14:2749 weakly excites
- L20:1008 weakly excites
- L6:611 weakly excites
- L15:2044 weakly suppresses
- L24:1633 weakly excites blank spot before an age number
- L14:1284 weakly suppresses
- L24:1009 weakly excites
- L23:2240 weakly suppresses
- L9:1094 weakly excites
- L11:2141 weakly excites
- L21:1015 weakly suppresses
- L20:2443 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- emos
- ipse
- ente
- salt
- .readFileSync
- ilestone
- autos
- entes
- osc
- 钵
Suppresses
- рон
- уд
- .bits
- ffe
- xFFFF
- ��
- то
- removeFrom
- ring
- wap