What are /r/ETL's favorite Products & Services?

From 3.5 billion Reddit comments

Pentaho Data Integration CE is free and open source, and does ETL well. It's even "big data" friendly as it can transform it's code to run on Spark

There's a cookbook on Safari for it (free week trial):

https://www.safaribooksonline.com/library/view/pentaho-data-integration/9781783280674/

I don't have experience with Prefect but check this podcast featuring prefect creator if you haven't already -

https://podcasts.google.com/?feed=aHR0cHM6Ly9zb2Z0d2FyZWVuZ2luZWVyaW5nZGFpbHkuY29tL2NhdGVnb3J5L2RhdGEvZmVlZC8&ep=14&episode=aHR0cDovL3NvZnR3YXJlZW5naW5lZXJpbmdkYWlseS5jb20vP3A9OTI1OQ

I was searching for the MySQL ETL tool, and I must say that your top list is outdated. Here I found the detailed description of the top free and paid ETL tools for MySQL on the end of 2021.

Consider using Python w/ Pandas dataframes as an alternative to Excel - and you can automate the work with Airflow or some other scheduler.

Happy to jump on a Zoom to discuss if you'd like.

Two git repositories you mean? You could investigate using a 3rd super-repo that has the two repos as git submodules.

https://git-scm.com/book/en/v2/Git-Tools-Submodules

https://github.blog/2016-02-01-working-with-submodules/

You might need to add an extra step to get the submodules pulled/updated, not sure.

Apart from Dataloader, the listed tools are very enterprise heavy.

I would suggest adding point-to-point tools like Zapier or Tray. and Reverse ETL like Census to that list.

You can use the free version of Talend to do this easily. Here is a video tutorial of Excel to MySQL. Have fun!