'from' after change or increase verbs
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 2 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "from" when it marks a starting point after words about change, like "increased from 74 percent" or "changed from light orange". Turning it up did not clearly produce text about change.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
05 were identified as achieving above the national reading benchmarks and 91.6 percent in writing.⏎The percentage of staff involved in professional development has increased from 74 percent to 88 percent.⏎Thornland State School '
-
per year. This growth leads to the growth of the transit fees paid by and paid to the upstream ISPs.⏎For example, while the price for Internet Transit drops from $3/Mbps down to $2/Mbps, the volume of traffic during
-
prevalence of helmet wearing among skiers from 1996 to 2012. They noted that the number of skiers wearing helmets had increased from 8% to 84%, and that the number of reported head injuries
-
living substance emits its own electromagnetic frequencies. Our understanding of the human body is shifting from a mechanical-chemical perspective to a quantum-energetic perspective.⏎Dr. Robert
-
, making it easier for them to swim under Arctic ice sheets.⏎In the summer, these small whales migrate up and down the river each day as the tide changes from low to high. They travel in large groups called pods. When winter approaches they
-
1947 and 1948 have increased from 7 percent to 15 percent over those in 1946
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: ...and what if you copy this. The following is a very common question – I'll use x, and remember to answer my own questions. Okay, I'm sorry for any of you, but I'm not sure if I'm being
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
Clause in oracle. In following section i would like to explain about the syntax as well as multiple examples of with clause.⏎With SQL_Query_Name As⏎Select * from New_SQL_Query_name;⏎Execution of With Clause :⏎In this section i would like
-
stage of disease is characterized by fasting hyperglycemia, glucosuria and usually three p’s that are polyuria, polydipsia and polyphagia.⏎
-
r, pioneer cultural anthropologists Franz Boas and Margaret Mead, and ornithologist Robert Cushman Murphy. J. P. Morgan was among famous benefactors of the Museum.⏎American Museum of Natural History, Central Park West at 7
-
is often diagnosed during a visit to your doctor. Blood pressure is measured using a cuff around your arm and a device called a sphygmomanometer. Your doctor may ask you to sit quietly for five minutes before checking
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L0:1660 weakly suppresses
- L1:1105 weakly excites
- L0:709 weakly excites
- L1:2987 weakly excites
- L1:1583 weakly excites
- L1:835 weakly excites
- L1:1222 weakly suppresses
- L0:1565 weakly excites
- L0:1380 weakly excites
- L1:934 weakly excites
- L0:2623 weakly excites
- L0:178 weakly suppresses
- L0:248 weakly suppresses
- L1:371 weakly excites
- L0:1301 weakly suppresses
- L0:1717 weakly suppresses
- L0:1174 weakly suppresses
- L1:1592 weakly excites
- L1:2116 weakly excites
- L1:922 weakly excites
- L1:616 weakly suppresses
- L0:2341 weakly suppresses
- L1:14 weakly excites
- L1:2119 weakly excites
Feeds later layers
- L19:777 weakly excites
- L7:2715 weakly excites
- L7:2808 weakly suppresses
- L18:1108 weakly excites
- L5:1976 weakly suppresses
- L6:2447 weakly excites
- L5:1605 weakly suppresses
- L18:2225 weakly excites
- L20:697 weakly excites
- L7:2322 weakly suppresses
- L21:2011 weakly excites
- L17:2049 weakly excites
- L4:1954 weakly suppresses
- L7:856 weakly suppresses
- L9:1343 weakly excites
- L4:2468 weakly suppresses
- L13:1750 weakly excites
- L26:1999 weakly suppresses
- L26:1875 weakly excites
- L13:1211 weakly excites
- L13:1097 weakly suppresses
- L21:183 weakly suppresses
- L15:1127 weakly excites
- L23:92 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- tdown
- ificaciones
- versions
- daughter
- сан
- ��
- %%⏎
- ?><?
- 最低
- 在床上
Suppresses
- sters
- oku
- .Commit
- ster
- 睛
- bức
- estre
- guide
- 时刻
- 帮忙