PinnedSagadevan KinPython in Plain EnglishSchema Evolution Made Simple with Pandas and PostgreSQLHandling schema changes using Pandas and PostgreSQLMay 27May 27
PinnedSagadevan KWays to load data from source to targetIn an ETL process, there are multiple ways to load data from a source system to a target system. Let’s have a look at some of them.Mar 21, 20232Mar 21, 20232
Sagadevan KinAWS in Plain EnglishETL: MS SQL Server to Redshift via S3 using Pandas and PyArrowIn this article, we’ll see how we can load data from an MS SQL Server instance to a Redshift cluster using pandas, pyarrow and pg8000. Code…Jun 11, 20233Jun 11, 20233
Sagadevan KTest AWS Glue jobs locally using Docker and motoWe’ll find out how to run tests locally for an AWS Glue job which reads data from a Postgres instance and writes to S3 using Docker and…Jan 8, 2023Jan 8, 2023
Sagadevan KDimensional Modeling for a Data WarehouseWhat is dimensional modeling?Jun 6, 2022Jun 6, 2022
Sagadevan KConnecting to Cloud SQL with Cloud Functions using CLIConnect to Cloud SQL instance with Cloud Function using Cloud Shell(only) from scratch.Aug 14, 2021Aug 14, 2021