PinnedPublished inPython in Plain EnglishSchema Evolution Made Simple with Pandas and PostgreSQLHandling schema changes using Pandas and PostgreSQLMay 27May 27
PinnedWays to load data from source to targetIn an ETL process, there are multiple ways to load data from a source system to a target system. Let’s have a look at some of them.Mar 21, 20232Mar 21, 20232
Published inAWS in Plain EnglishETL: MS SQL Server to Redshift via S3 using Pandas and PyArrowIn this article, we’ll see how we can load data from an MS SQL Server instance to a Redshift cluster using pandas, pyarrow and pg8000. Code…Jun 11, 20233Jun 11, 20233
Test AWS Glue jobs locally using Docker and motoWe’ll find out how to run tests locally for an AWS Glue job which reads data from a Postgres instance and writes to S3 using Docker and…Jan 8, 2023Jan 8, 2023
Connecting to Cloud SQL with Cloud Functions using CLIConnect to Cloud SQL instance with Cloud Function using Cloud Shell(only) from scratch.Aug 14, 2021Aug 14, 2021
