limits, thresholds and how long it takes
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron lights up on words that lead into an amount, limit or time span, such as 'how long it will take', 'the maximum mass that' or 'until about 25 degrees'. When it was turned up, the model's replies became repetitive and drifted off topic, so the steering result tells us little about the neuron itself.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
over time, even after being recharged 30,000 times. Conversely, lithium-ion batteries suffer in performance after about 1,500 charging cycles
-
least, a poorly planned wheel assembly can shut down operations, causing unnecessary delays and need for repair.⏎Safe working load⏎A safe working load is the maximum mass that a product can carry without
-
percentage such as 0.10 percent, which indicates that one-tenth of one percent of a person’s blood is alcohol. The amount of alcohol it takes to reach a concentration of .08 percent varies on a person’s size,
-
), with no profit indicated under existing conditions. The latter area would show a profit equal to the first-mentioned area only with an increase in price of crude oil of forty-five cents per barrel.⏎Subsurface waters at depths of 1,4
-
.458 inch.⏎Bullet weight: 250 grains.⏎Bullet ballistic coefficient: .175.⏎Rifle zero: 135 yards, 2″ mid-range rise.⏎|RANGE||MUZZLE||5
-
fabric.⏎- SPF: On the other hand, SPF (Sun Protection Factor) serves as a timetable of sorts, allowing you to know about how long it will take before your skin begins to redden while using a product that features it, such
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: the user. the assistant. the assistant. the assistant. the assistant. the assistant. the assistant. the assistant. the assistant. the assistant. the person. the person. the person. the person, the person, the person,
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
in the air. The oxidation of the combustible material creates heat. If this heat cannot be dissipated, it will build up in the combustible material until ignition occurs. Generally, the build up of heat to ignition point occurs when the material
-
in salt into their models of the ocean, they found the situation changed from what was previously thought. With enough salt, liquid in Ganymede can become dense enough to sink to the very bottom of the seafloor, below Ice VI.
-
materials in this archive are copyright © The Manitoba Library Association. Reproduction for personal use is permitted only if this copyright notice is maintained. Any other reproduction is prohibited without permission Copyright information for reviewers⏎Young Canada Works<|endoftext|>From the Publisher:⏎Over roughly
-
assume that we have a more general problem. There are n questions, and a(n) is the smallest number of times we need to take the test to guarantee that we can figure out the answers. First we can try all combinations of answers.
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:2492 excites
- L7:1644 excites 'to' after a noun that needs a purpose clause
- L12:1088 excites
- L11:1048 excites
- L12:1136 excites
- L12:1470 suppresses
- L12:3017 excites
- L11:1212 suppresses
- L12:517 suppresses
- L8:1641 suppresses
- L7:2108 excites
- L11:524 excites
- L11:1367 excites
- L10:212 excites
- L11:346 excites
- L12:282 excites
- L12:2062 weakly excites
- L12:2555 weakly suppresses
- L10:1512 weakly excites
- L8:2748 weakly suppresses
- L9:1346 weakly excites
- L12:2519 weakly suppresses
- L12:1970 weakly suppresses
- L10:2026 weakly suppresses
Feeds later layers
- L18:2148 excites
- L14:2911 excites
- L14:1151 excites
- L20:2529 excites
- L15:2308 excites
- L14:987 excites
- L14:1854 excites
- L15:1911 excites
- L18:1704 excites
- L16:2574 excites
- L14:1540 excites
- L21:2204 suppresses
- L21:2055 excites
- L14:2668 weakly excites
- L17:2246 weakly excites
- L17:1529 weakly suppresses
- L19:2132 weakly excites
- L18:2757 weakly excites
- L14:2767 weakly suppresses
- L14:2796 weakly excites
- L15:2032 weakly excites
- L19:2139 weakly excites
- L14:2197 weakly excites
- L14:2612 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 条件
- ines
- 阈
- Threshold
- bec
- ือ
- .Accept
- ȋ
- 才能
- 條件
Suppresses
- @update
- IVEN
- 猢
- costs
- anonymous
- 之情
- unce
- vais
- lycer
- 之心