Pip Install Your DE Packages From GitHub

Jonathan Duran
Towards Data Engineering
7 min readJan 17, 2024

--

Photo by Claudio Schwarz on Unsplash

Introduction

Most ETL pipelines I’ve come across go through the same process. Data is extracted from some source, validated, possibly transformed, and finally loaded into a destination. The implementation details differ across pipelines, but the general requirements remain the same.

--

--