Sam Newby

Learning in public

Becoming an
AI / ML engineer.

I'm a senior software engineer learning to build models from scratch. I'm documenting the experiments and mistakes along the way, with a goal of training my own TypeScript language model from scratch.

Latest from the journey

Tokenisation isn't lexing

Why building a TypeScript language model made me rethink a familiar compiler concept.

Read note

Other writing & notes

Systems & infrastructure Interactive essay

Understanding load balancing

How a request finds its way to the right server. A practical explanation, with a few things to try along the way.

Distributed systems

Why CAP Theorem is still important

CAP Theorem is still important in distributed systems, but I think we often talk about it in the wrong way.

In the margins

The trade-offs are still there

A cache is you deciding that stale data is okay for a bit. A queue is you deciding that work can happen later, and maybe more than once.

Read note