unclear: weak, varied mid-sentence words
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 14 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron responds only weakly and to a mix of words in the middle of explanatory sentences, such as "selecting the [feature]" or "motorists should [slow]". No single pattern stands out, and the steered text did not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: low. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
data until a stopping criterion is met. The goal is to find the best split that maximizes the predictive accuracy of the model. This is done by selecting the feature that provides the most information gain or reduces the impurity of the data.⏎D
-
the Toolbar on the right (press T if you don’t see it) and under Rigid Body Tools, select ‘Bake To Keyframes’. Enter how many frames you want keys to<|endoftext|>Ann Wright: Deer in the garden⏎In the
-
00. The SDS preparers may also include additional information in various section(s).⏎Sections 1 through 8 contain general information about the chemical, identification, hazards, composition, safe handling practices, and emergency control measures (e.g., firefight
-
The high level of tetracycline resistance was maintained in spite of the declining concentration of tetracycline. (C) 2002 Elsevier Science B.V. All rights reserved.⏎|Publication status||Published - 2
-
Spreadsheets in Education (eJSiE):⏎2, Article 1.⏎Available at: http://epublications.bond.edu.au/ejsie/vol8/iss2/1<|endoftext|>Some may argue that sleeping is one of
-
sometimes called tipping moments—during the process-layout and die-design phases of a project. Unfortunately, many tooling engineers and die-process engineers do not fully understand the impact of off-center loading on part quality
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the people who are left out in the days of the 11/12/31, in the 12/31/31, 12/31/3, 31/31
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of contrasting brilliant color and shade. Some galleries insist that artists stand alongside their works during shows, juxtaposing the art and the artist.⏎Quiz: What is juxtaposition?⏎- The act of placing two things next
-
adjectives, adverbs, conjunctions, and prepositions. Each section:⏎- Defines the part of speech and its usage⏎- Gives examples to illustrate the definition⏎- Provides a range of interactive exercises to develop and consolidate understanding⏎- Offers
-
spring. This reduces the amount of water available to grow crops.⏎- In some areas, rainfall events are occurring less often, but are more extreme when they do occur. Extreme rainfall can wash away soils and damage crops. The ground also cannot soak
-
a, “Introduction to Data Mining with Case Studies”, 2nd Edition, PHI.⏎Students will be able to:⏎1. Explain the concepts in data mining and KDD, recognizing issues in Data Mining⏎2. Practice the preprocessing operations of
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:1651 suppresses
- L11:1581 excites
- L13:3008 excites
- L12:1618 excites
- L13:1837 excites
- L13:2406 suppresses
- L12:1490 suppresses
- L11:979 suppresses
- L11:3034 suppresses
- L12:427 excites
- L12:822 excites
- L12:1701 excites
- L11:1136 suppresses
- L11:1151 excites
- L11:1887 excites
- L13:1394 suppresses
- L13:406 excites
- L11:2603 suppresses
- L13:2677 suppresses
- L11:2679 suppresses
- L11:573 weakly excites
- L13:2407 weakly suppresses
- L12:1044 weakly excites
- L13:1451 weakly excites
Feeds later layers
- L15:1425 strongly excites
- L17:2911 excites
- L16:2880 excites
- L16:357 suppresses
- L15:273 suppresses
- L16:2247 excites
- L16:3060 excites
- L16:1427 suppresses
- L15:1924 excites
- L15:143 suppresses
- L27:289 excites
- L16:1541 excites
- L15:3040 excites
- L15:509 excites
- L17:2529 excites
- L16:1364 excites
- L19:1092 suppresses
- L24:205 excites
- L15:1467 weakly excites
- L15:1339 weakly excites
- L15:412 weakly suppresses
- L21:739 weakly excites 'both X and Y' pairing words
- L15:2853 weakly excites
- L17:1491 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 及其
- &&
- and
- &&
- selectAll
- 和支持
- ands
- agus
- それに
- 并向
Suppresses
- lyn
- iful
- 也可
- ="--
- -enter
- ulti
- レビ
- visor
- iese
- взгляд