words after 'what' and 'go through' in speech

What this neuron does

This neuron fires on small words that come right after a verb or 'what', such as 'through' in 'go through' or the 's and 're in 'what it's' and 'what you're'. It is most active in casual, spoken-style sentences. Its negative side, on words like 'says' after a person or group, is a different pattern.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   the events of that tragic year of 1941, but our memory should not allow us to forget what the Soviet people had to go through in those blood-filled years of 1941-1945

2. #2 peak

   ."⏎- “Godfather doesn't like being told what to do by the enemy.”⏎- “Godfather needs an airfield.”⏎Mark wanted to know what it’s called when someone talks like this. And he wondered if he was alone in thinking

3. #3 peak

   of the ovaries in a woman is a natural process that every female has to go through at some point in her life. By medical standards, this time is fixed during

4. #4 peak

   whatsoever. It's completely dark. That is what we're looking for and that is what makes this area so incredibly special."⏎The Namib

5. #5 peak

   ’ve heard this word many times over the last few years, but unless you have actually participated in a detoxification program, you probably don’t really understand what it’s all about. Given the somewhat controversial nature of this topic, as well as the

6. #6 peak

   lived in. That was the social contract before the New Deal. There was no Medicaid for the poor, no subsidized housing or home mortgage interest deduction, no unemployment insurance, no Social Security for the disabled or the elderly. Life was nasty, brut

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   and positive psychology is impacting the behavior of more than 70 boys with serious behavioral or criminal issues.⏎Salekin and his team have developed a system that he says has been more effective at reaching troubled youth at the facility than typical methods, like

2. #2 peak

   tide laps across them, back and forth, every day.”⏎One set of markings came from a two-legged, meat-eating dinosaur that researchers say was about the size of a car. They say its footprints have three toes

3. #3 peak

   a book or looking it up on a webpage. In particular – I will be focusing on the Romans and the Greeks as these are especially interesting, and in my opinion, more factual. We can learn a lot from visiting sites, but we can

4. #4 peak

   to a debate that we are likely to have in the coming decade, a debate about how we know the past and how we look at the written record that I suspect will be of interest to literary scholars and historians alike. It is a philosophical debate

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.