"that" starting a relative clause
A neuronOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in layerOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. 6 of Qwen3-0.6B. Its strongest snippets are very consistent: they mostly peak on the same token. It is featuredA neuron picked for the full treatment: steering outputs and a written explanation. About 3,000 of the 86,000 neurons are featured., so it has steering outputs.
What this neuron does
This neuron fires on the word "that" when it follows a noun and begins a describing clause, as in "materials that review grammar" or "links that support learning". Turning it up or down did not give writing that clearly reflects this pattern.
Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).
Fires most on
The text windows where this neuron's activationThe number a neuron produces for a token. Large positive means it fired hard; negative means it pushed the other way. was highest. Amber marks positive activation; the outlined tokenA piece of text the model reads at once: often a word, sometimes part of a word or a punctuation mark. is the peak. Hover a token for its strength.
-
, it's definitions, example sentences, related words, idioms and quotations.⏎More words from Urdu related to Communized⏎View an extensive list of words below that are related to the meanings of the word Communized meanings in Urdu in Urdu.⏎
-
your comprehension.⏎Grammar topics fill the second content area of the exam and consist of written excerpts and questions on grammar, vocabulary and syntax. Many study guides are available that review grammar topics and include exercises to help refine your grammar skills. In addition to
-
Freewrite for 15 minutes in your journal about what it means to be an educated person. To get started, think about someone you know or admire that you consider to be an example of an educated person.⏎2. Working with a
-
the vaccine industry. There are some different vaccine development methods on the horizon, however, that will use bacteria that have been genetically engineered to make flu vaccines. But until that
-
examples in lower grades or with minor faults sell for a surprising percentage of Scott catalog value.⏎Determine what you can afford and buy the best example you can find that
-
even color changes to their Ozobot to reflect the character’s feelings and actions.⏎Edpuzzle gives you the opportunity to easily create interactive video lessons for your students that you can integrate right into your Learning Management System (LMS). Join us as
SteeringAdding a push along a neuron while the model writes, to see how its output changes. Turning it up or down.
Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.
Here is something I have been thinking about lately: what is the value of x, x? March 14th, 2023, 23:55:23 AM, 23:55, 23:55, 2
Most negative on
Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.
-
resolution of disputes between disputants within reasonable time with mo additional cost.⏎(3) WHAT HAPPENS IN A MEDIATION -Mediation is a structured process and Comprises of various stages, which are as under :- 1. Introduction :-
-
Bible as a textbook—and worshiping God according to the revelation within its pages were key components<|endoftext|>Hey There, welcome and warm greetings. Below an interesting article and at the end my own speculation and not endorsed by the source providers, purely my
-
facilitate habits and, for some, sustained compulsivity and addiction. Like other complex illnesses and disorders, addiction is multifactorial, resulting from a combination of genetic, social
-
ite) exoskeletons, giving them structural rigidity. These colonial “hard corals” form elaborate finger-shaped, branching, or moundshaped structures and can create masses of limestone that stretch
Connections
Show on mapWhich neuronsOne of thousands of tiny dials inside each layer. It reads the text so far and produces a number, its activation, that nudges what the model writes next. in earlier layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.
Fed by earlier layers
- L1:2683 excites
- L5:322 weakly suppresses
- L2:483 weakly suppresses
- L5:225 weakly suppresses
- L2:66 weakly excites
- L1:1031 weakly suppresses
- L2:1710 weakly suppresses
- L1:2325 weakly suppresses
- L4:2517 weakly suppresses
- L3:59 weakly excites
- L4:2756 weakly suppresses
- L2:1162 weakly suppresses
- L5:653 weakly suppresses
- L5:1851 weakly suppresses
- L5:110 weakly suppresses
- L3:1744 weakly excites
- L1:2443 weakly suppresses
- L2:70 weakly excites
- L3:1905 weakly excites
- L5:1958 weakly excites
- L1:1833 weakly excites
- L3:1030 weakly excites
- L4:547 weakly suppresses
- L5:129 weakly excites
Feeds later layers
- L9:661 excites
- L7:1996 excites
- L17:1361 excites 'that' after verbs like recommend
- L11:1278 excites
- L7:2390 excites
- L8:94 excites
- L17:1008 excites
- L15:1902 excites
- L10:1256 weakly excites
- L7:2503 weakly excites
- L19:1185 weakly excites
- L9:865 weakly excites
- L18:2311 weakly excites
- L21:1010 weakly excites
- L8:1288 weakly suppresses
- L20:1445 weakly excites
- L12:559 weakly excites
- L17:3049 weakly excites
- L13:150 weakly suppresses
- L16:2035 weakly excites 'of' after a noun phrase
- L15:801 weakly excites 'of' inside organisation names
- L15:2521 weakly suppresses
- L15:969 weakly suppresses
- L15:817 weakly suppresses
Activation histogramA chart of how often a neuron takes each activation value.
How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.
Logit lensReading which output tokens a neuron pushes toward or away from, straight off its output weights, before the later layers have their say.
The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layersOne step in the stack the text passes through. Qwen3-0.6B has 28 layers, each with 3,072 neurons. instead.
Promotes
- Jvm
- heimer
- ej
- "]}⏎
- 经
- flexDirection
- aporation
- 炙
- avar
- ens
Suppresses
- toile
- 五星
- eral
- clases
- ths
- -stock
- thest
- шло
- [class
- 遑