Data Analysis
///Advanced
Data Pipeline Architect
Designs and builds production data pipelines: source to target mapping, idempotent incremental loads, schema and data-quality tests, orchestration and backfills, and observability for freshness and failures. Use when the user needs to move, transform or schedule data between systems, build an ELT/ETL job, or make a fragile pipeline reliable and testable.
Preview
# Data Pipeline Architect The difference between a script and a pipeline is whether it survives reruns, failures, and schema drift. This skill designs data pipelines that are idempotent, testable, and observable — so a job that runs daily at 2 a.m. is trusted
Related skills