predicting the word two

What this neuron does

This neuron seems tied to the idea of the number two. It shows up on words that lead into counting or choosing, and when it was turned up the model kept saying the word two over and over.

Written by Claude from this neuron's activations and steering outputs. Confidence: medium. Think it is wrong? Flag it (opens a prefilled issue on GitHub).

Fires most on

The text windows where this neuron's activation was highest. Amber marks positive activation; the outlined token is the peak. Hover a token for its strength.

1. #1 peak

   shapes? Can you describe the⏎shapes in the picture?⏎10 space travellers are waiting to board their spaceships. There⏎are two rows of seats in the waiting room. Using the rules, where⏎are they all sitting? Can you

2. #2 peak

   change places and the Engine is back on the main line?⏎In how many ways can you fit two of these yellow triangles⏎together? Can you predict the number of ways two blue triangles can⏎be fitted together?⏎Using different numbers of sticks

3. #3 peak

   coastal dishes, oyster sauce, fish sauce and Clamato juice⏎Seafood, Molluscs, Crustaceans

4. #4 peak

   , and crustaceans, such as lobsters and crabs. They are commonly found in Japanese cuisine, coastal dishes, oyster sauce, fish sauce and Clamato juice.⏎Shellfish are an excellent source of protein and vitamins and minerals

5. #5 peak

   view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.⏎As the access to this document is restricted, you may

6. #6 peak

   our "Structures & Materials" activity, where children and parents will get to read the book “The True Story of the Three Little Pigs” by Jon Scieszka, build and test of the strength of structures built out of three different

Steering

Push this neuron up or down while the model writes, and watch what changes. The outputs were generated ahead of time, so nothing runs in your browser.

Most negative on

Where the activation went furthest below zero. Blue marks negative activation. Many neurons mean something different in each direction.

1. #1 peak

   fall under one of two forms of self-starvation: restricting, in which the person participates in extreme diets, fasting, or exercise; or binge-eating to purging, in which the person eats a large amount of food within a certain time

2. #2 peak

   overwhelming research that has found multiple issues with AOUM education: censoring vital health care information, jeopardizing adolescent sexual health, stigmatizing the LGBTQ community, purporting harmful gender stereotypes and one religious perspective, and withholding information teens need to

3. #3 peak

   on the front cover, which features a couple in classical dress in a Mediterranean countryside. The first performance of Acis and Galetea took place in the gardens at Cannons, the great house built by Handel's<|endoftext|>When school starts, sleep

4. #4 peak

   of Cell Cycle and Growth by Extracellular Cues, Fall 2012. (Massachusetts Institute of Technology: MIT OpenCourseWare), http://ocw.mit.edu (Accessed). License: Creative Commons BY-NC-SA<|endoftext|>

Which neurons in earlier layers feed this one, and which later ones it feeds. Amber links excite, blue links suppress; longer bars are stronger.

Activation histogram

How often this neuron fires at each strength. Almost always it does close to nothing (the tall bars in the middle); the snippets above are the rare moments it fired hard, amber for positive and blue for negative.

Logit lens

The words this neuron nudges the model toward (amber) or away from (blue) when it fires. A hint, not a label: many neurons work through later layers instead.