'is' after a subject noun about likelihood
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 21 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word 'is' (or the Chinese word for rate) when a sentence says how likely, common or large something is, such as 'the chance of survival is'. Turned up, the model fell into loops of 'high' and 'low', which fits that theme of degree.
Written by Claude from this neuron's activations and steering outputs. Confidence: high. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
for Thai Learners Based on the Comparative Analysis⏎- 人文学院-已发表论文 ⏎“助动词”在汉语中具有较大的作用,使用率高,但是泰国学生经常在学习和使用汉语助动词中产生
-
to the west and over 2,300 nautical miles to the south.⏎Striped marlin are found throughout the Pacific Ocean, but their abundance is much greater in the eastern half of the Pacific and appears to merge seasonally in
-
cycle. As we are heading towards the next solar maximum, due in 2013, the chance of big magnetic storms is on the increase. On average you might expect to see aurora in the far
-
also in an attempt to reduce instances of child trafficking following the tsunami, placed a temporary hold on a child adoptions.⏎In regions where the potential for child trafficking is particularly high, countries can be spurred to action following the requests of other world leaders
-
or are unable to, enter the medical system for this important screening. In Asia, the number of prospective patients that fail to enter the system for annualized screening is closer to 70%, a leading contributor for breast cancer being the number #
-
Cell Disease?⏎The symptoms of sickle cell anemia start when the babies are around 5 to 6 months old. The risk of developing new medical conditions is high when they grow older. You must consult a specialist when you notice the first
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what are some of the useful and useful you can do in the first 5 years of your career, and what do you why you do it? Why you do it to why you do it for your future, why you do it to
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
of individual variation, or environmental conditions.⏎You have requested a machine translation of selected content from our databases. This functionality is provided solely for your convenience and is in no way intended to replace human translation. Neither BioOne nor the owners and publishers of
-
cone,’ from the ancient Greek strobilos, meaning ‘a twisted object’, a botanical term that describes the shape of the volcano’s peak.⏎Puncak Jaya, Australia (Oce
-
Dispersal of Aedes Aegypti in an Urban Area After Blood Feeding as Demonstrated by Rubidium-Marked Eggs," American Journal of Tropical Medicine Hygiene⏎52 (2):177-17
-
and criteria as we use for PAA and CAF.⏎Through these three programs each<|endoftext|>发布时间:2017-03-27 来源:新
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L20:1919 strongly excites
- L19:1454 excites
- L19:2023 suppresses
- L20:1800 suppresses
- L16:2072 suppresses
- L20:1762 suppresses
- L19:1165 excites
- L19:3017 suppresses
- L8:1032 suppresses
- L20:665 excites
- L19:366 suppresses
- L16:1721 suppresses
- L20:1733 weakly suppresses
- L18:1623 weakly excites
- L9:525 weakly excites
- L19:1915 weakly excites
- L17:1320 weakly excites
- L16:2744 weakly excites
- L15:2383 weakly excites
- L20:977 weakly suppresses
- L16:899 weakly excites
- L19:1065 weakly excites
- L20:1295 weakly suppresses
- L19:1373 weakly excites
Feeds later layers
- L25:934 excites
- L25:1993 excites
- L23:469 excites
- L22:1370 excites
- L23:545 excites
- L24:1595 excites
- L24:915 excites
- L25:461 excites
- L22:1407 excites
- L27:1258 excites
- L24:299 excites
- L23:530 excites
- L24:1668 excites
- L24:1052 excites
- L22:422 excites
- L23:1398 weakly excites
- L22:1046 weakly excites
- L25:1353 weakly excites "in" before "good" condition
- L25:1283 weakly excites
- L23:283 weakly excites
- L23:1266 weakly excites
- L22:3015 weakly excites
- L26:2458 weakly excites
- L23:514 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 很高
- 较高
- 更高
- 较高的
- 更高的
- 较低
- 很高的
- 高的
- 最高的
- highest
Suppresses
- subclass
- ;display
- diğini
- nc
- quete
- nek
- 斯塔
- dings
- iously
- reen