Meltano is a open source self hosted and CLI first data pipeline. Data pipeline is code and version controlled. Local development is breeze with continuous integration and deployment.
My use cases
MongoDB to Clickhouse
In this use case I will extract data from MongoDB and load it into Clickhouse data warehouse.
Meltano project documentation provide decent guide for getting started quickly on local machine.
Mac (Big Sur)
Setting up from scratch.
- Make sure python 3.7.x or 3.8.x is used. Use Pyenv if you want multiple python versions