Topic

Data Engineering

A collection of 3 posts


Data Engineering

Chaos testing for Data Engineering

Data pipeline resiliency testing is often delegated to human (or agentic AI) reasoning through time/token consuming and error-prone "What if?" sessions. What if an automated tool existed?

4 min read

Beyond the happy path: Building resilient data pipelines

Happy path thinking is a recurring behavior adopted by humans to simplify things. Often, such behavior leads to fragile systems built on oversimplified models which fails in real-world conditions.