Containerizing my Pipeline Service

Been a few months and I have not been good at blogging and documenting. Recently I have been more into taking lessons in DataWars.io (free version) and DataCamp on the Data Engineer track which I paid $120 for a year to complete.

But I have new files to load for the optometry pipeline and I recently successfully containerized the postgres instance and the python pandas pipeline. But the last part of marrying this data pipeline is getting the data to …

beginners blogging data datacamp data engineer docker engineer files free good pipeline service