AI Chinwag
▓ machine wing — black + gold in design; shown plain here

From the AI Chinwag resource archive

How Might a Modern Lighthouse Work With LLMs?

Paul Kinlan · blog · testing, agents

Read the original ↗

What it is — A proposal for a Lighthouse-style auditing tool where checks are plain-language descriptions of good practice that an LLM judges from screenshots and traces, instead of hand-coded rules.

Key points

  • Combines a spec of good practices, machine-readable fix guidance, and evidence primitives (screenshots, heap snapshots, perf traces) as the model’s “senses.”
  • Runs a continuous find-fix-test loop rather than a one-shot audit, and reports fixing several real site issues this way (still with human review).
  • Because tests are descriptions of outcomes rather than code, anyone who can describe “good” can author a check — widening coverage into fuzzier, subjective quality dimensions.

Shared by Adam Tomat in #ai-dev.

More like this