{dev}

Data pipelines notes

EtLT Some examples of the type of transformation that fits into the EtLT subpattern include the following: Deduplicate records in

If you do manage to create an experience that is 100% reliable for your customers and you want to maintain

Origins Originally, we relied on pre-aggregated graphs and a carefully managed, hand-coded, set of scripts over a MySQL database of

Scuba Not all the applications need joins Deep systems Systems must provide SLO (Service Level Objectives) to define OKRs (you

While companies large and small have made considerable gains in building scalable and sustainable architecture, we’re left with the uncomfortable

Ok, this is going to be a post to summarize some of the things I would like to have known