animals, plants and natural hazards
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 12 of Qwen3-0.6B. Its strongest snippets are mixed: they peak on different tokens. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on nouns for living things and natural hazards, such as tornadoes, moths, bees, trees, crayfish and sand. It goes quiet or slightly negative on words that end definitions and examples, like 'that', commas and full stops. Turning it up did not produce a clear nature theme in the sample outputs.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
present their research findings on hazard preparedness and mitigation. The research teams, which receive some of their funding from the National Science Foundation, study disasters as varied as tornadoes, hurricanes, oil spills, earthquakes and landslides. They showcased projects
-
and most are comparatively benign. Have some introduced species caused changes that most everyone would agree have been very harmful? Absolutely. By killing timber trees, gypsy moths and the emerald ash borer have caused, and continue to cause, enormous
-
if you have a history of allergies to insect bites. Some insect bites or stings can provoke very serious allergic reactions (most of the time these are insects like bees or wasps), and nausea may be
-
As it moves around us, its viewpoint is changing, and that motion is reflected in the asteroid. Try this: look at some distant object like a mountain or tree, hold your thumb at arm’s length, close one eye, and then move
-
,000 other forest products. Trees are renewable, biodegradable and recyclable. Wood by-products become such products as vitamins, plastics, vanilla flavoring, photographic film, toothpaste and medicines.⏎By planting 20 million trees
-
that electric eels use their energy charge in a number of ways, and not just for stunning their prey. When tackling a larger prey, like a large crayfish, the eel will curl
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: I want to be a teacher. I need to teach a class. I want to teach a class. I want to teach a class. I want to teach a class. These are all examples of what I can do. The teacher is
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
.⏎- Onus Item — Definition,⏎- A payment that is deposited at the same financial institution in which it was drawn or written. For example, a cheque that is written by one bank customer and deposited by
-
.⏎Container. Containers are the elements that “hold” the source. For example, if a television episode is watched on Netflix, Netflix is the container.⏎Number and volume. Note that the abbreviations vol.
-
its effect through logical demonstration. (157)⏎a "system" of signs whose elements receive meaning through and within this system. Morse code is an example. (159)⏎superficial and mistaken definition of rhetoric, as a
-
WikiPedia often edit and re-upload images used to illustrate articles on that site. But in another way, it may not. Cropping or resizing a photograph is different from using the language of graphic design to convey a message.⏎I'm a
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L8:867 suppresses
- L7:255 excites
- L10:2157 suppresses
- L7:231 excites
- L11:2809 excites
- L9:2548 suppresses
- L7:1108 excites
- L7:1402 excites
- L3:1579 excites
- L10:927 weakly excites
- L10:2645 weakly excites
- L7:2400 weakly excites
- L10:1094 weakly excites
- L9:833 weakly excites
- L2:1311 weakly suppresses
- L10:2303 weakly suppresses
- L7:1997 weakly excites
- L10:850 weakly suppresses
- L11:662 weakly suppresses
- L11:742 weakly excites
- L11:175 weakly excites
- L6:2819 weakly suppresses
- L10:2079 weakly excites
- L9:358 weakly suppresses
Feeds later layers
- L13:2550 suppresses
- L13:2330 suppresses
- L20:2988 suppresses
- L14:1604 suppresses
- L14:2472 weakly suppresses
- L14:1539 weakly suppresses
- L13:2697 weakly suppresses
- L15:1348 weakly suppresses
- L21:2718 weakly suppresses
- L13:1266 weakly excites
- L13:2610 weakly excites
- L13:567 weakly excites
- L14:2555 weakly suppresses
- L13:252 weakly excites
- L15:776 weakly suppresses
- L16:2939 weakly suppresses
- L18:2720 weakly excites
- L13:2396 weakly suppresses
- L14:1562 weakly suppresses
- L15:1760 weakly suppresses
- L13:2488 weakly suppresses
- L20:1052 weakly excites
- L15:2865 weakly excites
- L17:2754 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- ployment
- ellidos
- ITTLE
- 越好
- 区委
- 时报
- &e
- adena
- positories
- lest
Suppresses
- defer
- دور
- 스크
- اض
- example
- ding
- [hash
- 爬
- would
- gibi