PraCha, home

Engineering Practice

A running place for the engineering I want to compound for the future of AI, ML, and data systems: evaluation, agents, tooling, data systems, inference, reliability, and end-to-end system design.

buildworkingscience · engineering

An engraved wooden frame holding a bar loaded with a hanging weight, with small numbered drawings of the test pieces around it.
Apparatus for testing the strength of materials, from Physicae experimentales et geometricae dissertationes, Pieter van Musschenbroek, 1729. Wikimedia Commons. Public domain.

This page is the running place for the engineering practice I want to compound for the future of AI, ML, and data systems. It sits between theory and deployment: not only building models, but learning how to make systems measurable, reliable, adaptable, and actually useful under real constraints.

What belongs in this log

  • Evaluation harnesses, benchmark design, failure analysis, and model debugging.
  • Training pipelines, fine-tuning workflows, reproducibility discipline, and experiment tracking.
  • Inference systems, latency and cost tradeoffs, retrieval layers, and tool-using agents.
  • Data contracts, feature and dataset quality, monitoring, and feedback loops.
  • Research-engineering drills: replications, ablations, implementation notes, and system-design exercises.
  • Enterprise-facing AI engineering where models have to survive workflow complexity, organizational constraints, and human decision loops.

The engineering that matters most

For the kind of future-facing AI work I care about, the center of gravity is shifting toward eval-driven development, agent and tool orchestration, data-system rigor, strong observability, inference and serving discipline, and end-to-end system design that can connect models to actual operations. This is the layer that turns ML capability into research leverage, product leverage, or organizational leverage.

Current focus

The immediate practice areas are reasoning and agent evaluation, model and workflow reliability, structured experimentation, enterprise decision workflows, and the engineering interfaces between frontier models, data systems, and deployed human-in-the-loop use.

If you'd have built it another way, I'd like to know how. Write to mepc3197@columbia.edu · the title goes in the subject line

Related

Sent through Substack, which will ask you to confirm. Your email is used for these letters and nothing else. Subscribe on Substack instead.