General
156 views
Data Pipeline
Quick Definition
Series of processing steps moving data from source to destination
Full Definition
A series of data processing steps that move data from source to destination.
Examples
ETL, Apache Airflow, Kafka Streams, data transformation
Related Terms
etl
data-engineering
analytics
More General Terms
CI/CD
Automating build test and deployment pipelines
Scalability
Ability to handle increased load by adding resources
Documentation as Code
Applying dev practices to documentation management
Trunk Based Development
Branching model integrating code to main branch frequently
Domain-Driven Design
Software approach centered on business domain logic
Scrum
Agile framework using fixed-length sprints