Data PlatformZoom level 0
Every concern, one page each
A platform is more than its layers. Some jobs cut across all of them: checking quality, keeping history, controlling access, recording what happened. We call these concerns and number them X1 to X24. Each concern gets one page, and every page has the same shape, so you learn the shape once.
The map
How to read a concern page
- Why. One plain paragraph on what goes wrong without this concern.
- The picture. Where the concern happens along the data's path. Every box opens the page for that part.
- The places. A table: each place the concern is checked, what is checked, and what a failure does.
- Request and response. For each major function: what goes in, what comes out, and who calls it.
- One real run. Inputs and outputs printed by the code on a small example. Nothing here is typed by hand.
- Code and tests. The code cut from the real file, the settings that drive it, the tests, and what is not built.
All 24
| Family | # | Concern | Rules proven by a test | Page |
|---|---|---|---|---|
| Run | X1 | Metadata | 3 of 7 rules tested | Page to come |
| Run | X2 | Orchestration | 3 of 3 rules tested | Page to come |
| Run | X15 | Replay | 13 of 15 rules tested | Page to come |
| Run | X16 | CI/CD | 0 of 6 rules tested | Page to come |
| Run | X17 | Testing | 5 of 5 rules tested | Page to come |
| Run | X18 | Resilience | 2 of 4 rules tested | Page to come |
| Run | X23 | Layout | no rules in the catalog | Page to come |
| Run | X24 | Streaming | no rules in the catalog | Page to come |
| Trust | X3 | Contracts | 4 of 10 rules tested | Page to come |
| Trust | X4 | Data quality | 8 of 12 rules tested | Open the page |
| Trust | X5 | Profiling | 0 of 1 rules tested | Page to come |
| Trust | X6 | Reconciliation | 6 of 7 rules tested | Page to come |
| See | X7 | Lineage | 1 of 2 rules tested | Page to come |
| See | X8 | Observability | 2 of 2 rules tested | Page to come |
| See | X9 | Freshness | 2 of 5 rules tested | Page to come |
| See | X10 | Cost | 0 of 3 rules tested | Page to come |
| See | X19 | Performance | 1 of 2 rules tested | Page to come |
| Guard | X11 | Access | 3 of 4 rules tested | Page to come |
| Guard | X12 | Privacy | 2 of 3 rules tested | Page to come |
| Guard | X13 | Governance | 3 of 6 rules tested | Page to come |
| Guard | X14 | Audit | 3 of 5 rules tested | Page to come |
| Self | X20 | Self-healing | 0 of 1 rules tested | Page to come |
| Self | X21 | Agents | 0 of 1 rules tested | Page to come |
| Self | X22 | Simulation | 1 of 1 rules tested | Page to come |