unclear: year digits and prepositions
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 16 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron is mixed. It fires on some digits in years, such as the "1" in "1870s", and on words like "Suggested" in lists of resources. It is quieter on prepositions like "for" and "to" after a noun. Turning it up or down did not give a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
addition to our editors' articles, see section below for printable documents, Ballotechnics books and related discussion.⏎Suggested Pdf Resources⏎Suggested News Resources⏎Suggested Web Resources⏎Great care has been taken to prepare the information on this page
-
2004, the increase varied widely among states. Residents of New York gained 4.3 years, the most of any state, during the 13-year period studied and can expect to live 79.2 years.
-
(During the 1834 Coorg Campaign)". www.archerfamily.org.uk. Archer Family. Archived from the original on 13 November 2013. Retrieved 13 November 2013.⏎-
-
2018, Schuldt et al. 2020). Under these circumstances, tree´s survival primarily depends on the extent to which tree function is impaired by drought (i.e. resistance, Lloret
-
the latest changes. If you use the database to generate your MLA citation, please make sure to compare the citation against the core elements, changes, and examples listed above.<|endoftext|>Progressivism is a political term that emerged in the late 19
-
three cases are the most fun to prove: a(5) = 4, a(8) ≤ 6, and a(30) ≤ 24. Try it!⏎By the way, K. Knop and L
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: how to use a combination of the methods of the K-12 curriculum and the principles of the Socratic method and the philosophy of education, specifically with the help of the MATLAB 2023a, which is a tool for
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
tell our children to remain out of these<|endoftext|>Though I've long been intrigued by the idea of design thinking, it was the recent launch of a "Design Thinking for Educators" workshop here at Edutopia that compelled
-
in interesting developments in consumer markets.⏎So what is the relevance for business schools? They do not create big data. They do not have 1
-
's ownership rights and society's desire to use his works. Although legal scholars continue to debate whether fair use is a right or a privilege, the distinction is irrelevant to teachers and students.
-
Governance⏎- Civil Society⏎Sunday, September 19, 2021⏎MONTEVIDEO, Mar 10 2010 (IPS) - “Nature is wise, and if we take the time to observe
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L15:965 excites
- L15:327 excites
- L15:2476 suppresses
- L12:1449 suppresses
- L15:2742 excites
- L15:3065 suppresses
- L8:824 suppresses
- L13:1075 suppresses
- L15:2825 suppresses
- L13:1817 excites
- L14:2071 suppresses
- L15:1088 weakly excites
- L15:1727 weakly excites
- L12:98 weakly suppresses
- L14:627 weakly suppresses
- L14:2488 weakly excites
- L15:2979 weakly excites
- L13:1466 weakly excites
- L14:872 weakly excites
- L10:51 weakly excites
- L13:3041 weakly suppresses
- L5:1196 weakly excites
- L13:2037 weakly excites
- L13:1326 weakly excites
Feeds later layers
- L17:2635 suppresses
- L18:2466 suppresses
- L19:2605 suppresses
- L18:1288 suppresses
- L18:826 suppresses
- L20:45 excites
- L17:2153 suppresses
- L17:2965 suppresses
- L24:367 suppresses
- L19:483 weakly suppresses
- L24:2396 weakly excites
- L25:609 weakly excites
- L17:876 weakly excites
- L19:192 weakly suppresses
- L18:307 weakly excites
- L20:312 weakly excites
- L17:2327 weakly suppresses
- L17:1084 weakly suppresses
- L23:348 weakly suppresses
- L21:12 weakly suppresses
- L17:1846 weakly suppresses
- L18:1536 weakly suppresses end of web page disclaimer
- L19:225 weakly excites
- L19:2035 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ibal
- ogle
- ocation
- скор
- eways
- zeich
- ecal
- icies
- icular
- ogy
Suppresses
- Tutor
- gL
- _bot
- g
- 崆
- transformer
- .asm
- ainen
- tutor
- uem