'and' between two verbs
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 15 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron reacts to the word 'and' when it joins two actions, like 'download and print' or 'identify and alter'. It is a weak signal. Turning it up gave rambling, repetitive text that did not show a clear theme.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
your assignment to the M5: Assignment 1 Dropbox.⏎Grading Criteria and Rubric⏎Note: This assignment will be graded using a rubric. Download and read the rubric to understand the expectations.<|endoftext|>A new bionic hand has
-
are referring to.⏎For ease of use the language guide is available in full as both a pdf via the link above, and as text below. You may download and print the language guide for personal use.⏎Please note: this is not a static
-
in a legible format, making it easier to perform the following actions:⏎- Review changes while staging.⏎- Decide whether to rebase or merge.⏎- Copy and paste code from a file.⏎Giving you even more confidence in your code game.
-
package can be installed like so:⏎cabal install bool-extras⏎If you don’t have cabal-install, you can manually download and install bool-extras:⏎tar xzf bool-extras-0.3.
-
items | World psychology |⏎Mindfulness-Based Cognitive Therapy (MBCT) is a method of therapy which blends features of two disciplines:⏎- Cognitive therapy aims to identify and alter cognitive distortions (warped or inaccurate thoughts);⏎- Mindfulness is a
-
the percentage of a number, you should first know how many decimal places it falls under. You can do this by multiplying the number by the maximum possible mark. Once you’ve determined the maximum, you can also divide it by the total marks.
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: How to best to write an effective, but how to best to write an effective, how to best to write an effective, how to best to write an effective, how to best to write an effective, how to best to write an effective
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
*A variety of GO Math resources are available.⏎*It can be accessed from school and home.⏎Research shows that students must have fact fluency in order to be successful in higher level math.⏎FASTT - Fluency and Automaticity through
-
methanol, or (2) transform biomass into long-chain molecules that can also be used as fuel.⏎CO2 is kinetically and thermodynamically inert, making reduction by chemical hydrogenation
-
open up the physical structure of the plant cell walls to permit further deconstruction during the hydrolysis stepyea. The more open structure of the resulting material makes the remaining carbohydrate polymers more accessible for hydrolytic conversion to soluble sugars by
-
in a lot of situations because if the physical wound isn't there it could still leave a mark on the mind," Siddens said.⏎The students said
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L12:1358 suppresses
- L8:984 suppresses
- L6:2695 suppresses
- L13:2493 suppresses
- L6:2530 suppresses
- L6:2820 weakly suppresses
- L8:410 weakly suppresses
- L12:1701 weakly excites
- L12:2208 weakly excites
- L6:2050 weakly suppresses
- L6:1500 weakly excites
- L14:2944 weakly suppresses
- L14:457 weakly suppresses
- L6:1185 weakly suppresses
- L11:1370 weakly excites 'then' in step-by-step sequences
- L11:654 weakly suppresses verb after modal can or could
- L12:1522 weakly suppresses comma after a 'before...' clause
- L14:2447 weakly excites
- L12:1084 weakly suppresses
- L9:2121 weakly suppresses
- L10:1664 weakly suppresses
- L1:1524 weakly excites
- L12:2375 weakly suppresses
- L12:2888 weakly suppresses
Feeds later layers
- L18:2274 excites
- L20:1560 suppresses
- L19:2236 suppresses
- L19:1396 suppresses
- L17:1642 excites
- L19:3020 suppresses
- L17:1698 weakly excites
- L16:1593 weakly suppresses
- L21:1045 weakly suppresses
- L19:517 weakly suppresses
- L16:1723 weakly suppresses
- L16:2949 weakly suppresses
- L27:777 weakly suppresses
- L21:250 weakly suppresses
- L18:2515 weakly suppresses
- L17:691 weakly suppresses
- L18:2932 weakly suppresses
- L16:1875 weakly suppresses
- L19:1349 weakly suppresses
- L17:2495 weakly suppresses
- L17:413 weakly suppresses
- L23:419 weakly suppresses
- L18:3056 weakly suppresses
- L24:1269 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- 除外
- bordered
- deactivated
- ogeneity
- finally
- (QtCore
- requency
- jewels
- undefeated
- IFT
Suppresses
- 很难
- 难
- enan
- plx
- 难以
- asso
- compost
- comp
- -make
- ctors