TIME WAIT BLOG.
#AI_Interpretability October 24, 2024 12 MIN READ

The Ghost in the Latent Space

Using sparse autoencoders to map hidden concepts inside large language models.

The Ghost in the Latent Space

Every prompt is a flashlight in a high-dimensional library of meaning.

The Geometry of Meaning

At billion-dimensional scale, concepts stop being loose metaphors and become measurable topology.

Implementing the Probe

We traverse semantic axes, capture high-entropy outputs, and backtrack their training-data bias.

// latent_probe.rs
fn traverse_latent_void(origin: Vector, direction: Vector) {
  let step_size = 0.05;
  for i in 0..200 {
    let probe = origin + (direction * (i as f32 * step_size));
    let output = model.decode(probe);
    if output.entropy() > 10.0 {
      println!("ghost detected: {:?}", probe);
      log_artifact(output);
    }
  }
}

/related_artifacts

Mechanical Sympathy: Software for Silicon Reality
#Systems Aug 02, 2024

Mechanical Sympathy: Software for Silicon Reality

A practical playbook for recovering performance lost in modern abstraction stacks.

read full log arrow_right_alt
Monoliths in 2024: Principled Simplicity
#Architecture Jul 15, 2024

Monoliths in 2024: Principled Simplicity

Why many teams ship faster with a disciplined monolith than early microservices.

read full log arrow_right_alt