content nouns in health and advice text
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 13 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the key noun in a phrase in medical or how-to writing, such as 'references', 'treatment options' or 'numbers'. Its strongest negative cases are similar nouns in advice text, like 'changes' or 'tasks'. Turning it up did not produce a clear theme in the model's writing.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
Approximate location of Wernicke's area highlighted in gray|⏎| This article needs additional citations for verification.|⏎Please help improve this article by adding reliable references. Unsourced material may be challenged and removed. (October 200
-
. Clearly there was no consensus on the definition of a microservice and what it actually means. It is quite a buzzword these days but none of the panelists could come to a common understanding. This raised a few questions in my head.
-
irritation and damage to the ocular surface. There are many different forms of dry eye, each with a unique cause, and each with a unique set of treatment options available. The following video provides a brief introduction to dry eye disease, symptoms of
-
determine the cause and get you appropriate treatment.⏎Here are some of the medical conditions that can cause dizziness and lightheadedness, and how they’re treated:⏎Benign Paroxysmal Positional Vertigo (BPPV)⏎
-
modifications to the original file in the meantime. So your modified file could not replace it.⏎That is why patches exist. Patches list the modifications, the line numbers and a few other useful information to be able to put that patch back into the
-
few seconds:⏎See how “normal” is translated from English to French with more examples in context⏎- Create your own vocabulary list⏎- Contribute to the Collaborative Dictionary
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I just need to make sure that the system is designed to change the behavior of the customers that are in the present day that would be based on the future, and I am assuming the current system will be in the future that will affect the
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
to be.⏎With just a few simple tweaks to your ways of living, you can easily kick-start your sustainable lifestyle. It’s best to start with small changes so that they stick and build it up from there.⏎So how can you start
-
ing the issue quickly, ensuring timely and accurate repairs or replacements.⏎The Importance of Regular Maintenance⏎Maintenance is vital for the longevity of HVAC systems. This includes routine tasks such as replacing air filters, cleaning coils, inspecting ductwork, and ensuring
-
at which electrons flow past a point in a complete electrical circuit.⏎Want to Slash Your EMF Health Risks?⏎Good! Learn the one small change you should make right now.⏎To understand this better, think of electric current as athletes on a
-
Brooklyn, Iowa. A lot of kids work for neighbors, and there are certain things parents would like their kids to be able to do when they reach age 14 or 15—including running a tractor and
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L10:2456 suppresses
- L7:1815 suppresses
- L12:2731 suppresses
- L12:1849 suppresses
- L10:910 excites
- L12:1873 excites
- L10:3016 suppresses
- L10:882 suppresses
- L11:2298 suppresses
- L11:1024 suppresses
- L9:1066 excites
- L12:2247 weakly suppresses
- L3:1407 weakly suppresses
- L11:2765 weakly excites
- L4:1052 weakly excites
- L8:69 weakly excites
- L12:1427 weakly suppresses
- L12:2604 weakly excites
- L12:2246 weakly suppresses
- L1:2942 weakly suppresses
- L7:910 weakly excites
- L3:3060 weakly suppresses
- L12:1475 weakly suppresses
- L4:2095 weakly suppresses
Feeds later layers
- L16:2161 suppresses
- L14:2069 excites
- L16:2700 suppresses
- L19:2122 suppresses
- L14:492 suppresses
- L21:1579 suppresses
- L15:1691 suppresses
- L15:1851 suppresses 'that' after a noun, 'being' in passives
- L17:2504 weakly suppresses
- L18:2141 weakly suppresses
- L19:2584 weakly suppresses
- L14:2462 weakly excites
- L17:1222 weakly suppresses
- L19:1233 weakly excites
- L15:741 weakly excites
- L14:2835 weakly suppresses
- L20:1441 weakly suppresses
- L16:2474 weakly suppresses
- L18:1691 weakly suppresses
- L19:226 weakly excites
- L16:1858 weakly suppresses
- L14:2791 weakly suppresses
- L16:531 weakly suppresses
- L18:1022 weakly excites
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- rido
- adero
- ercul
- equality
- CCI
- Layout
- theless
- 实
- Doch
- 谁
Suppresses
- 比如
- inine
- ork
- 比如说
- 譬如
- 例如
- AppState
- daq
- 诸如
- -serving