PraCha, home

Where do advanced systems go wrong, and how early can we see it?

inquiryworking

What I think now

The other side begins when the behavior of the model itself becomes part of the problem.

from Preferred Problem Spaces, Sep 2026

When these agents interact with each other, some sort of coordination can emerge, or cheating or lying can emerge as well — reward hacking is one such emergent behavior, I suspect.

from Complex Systems, Not Integrations, Sep 2026

What's beneath it

Have a better answer, or a better question? Write back. Write to mepc3197@columbia.edu · the title goes in the subject line

Sent through Substack, which will ask you to confirm. Your email is used for these letters and nothing else. Subscribe on Substack instead.