Cost optimization on DatabricksDatabricks is a very powerful platform but the cost can sometimes seem prohibitive for small and medium-sized companies. I recently had to…Feb 24, 20231Feb 24, 20231
Published inAWS in Plain EnglishHow to Solve Communication Problems in Cross-Team Dependent Companies Using AWS EventBridgeA tutorial on using AWS EventBridge for solving problems arising from cross-team dependency.Oct 21, 2021Oct 21, 2021
Published inAWS in Plain EnglishEnd to end pipeline mocking with localstack and Airflow MWAAIt is not a secret that with workflow orchestration tools like Airflow, testing and iterating a pipeline is notoriously hard, especially…Aug 13, 2021Aug 13, 2021
Published inAWS in Plain EnglishMy Personal Guide to Succeeding with AWS certificationsA detailed guide to properly prepare you for any and all of the AWS certifications.Jun 4, 2021Jun 4, 2021
Published inAWS in Plain EnglishA Guide to Demystifying Apache Spark’s QuirksThis article helps shed some light on some difficulties and confusing aspects that a lot of Spark users have encounteredOct 28, 20201Oct 28, 20201