Month: October 2023

What orchestrator to use for your ETL jobs?

What orchestrator to use for your ETL jobs?

In today’s data-driven world, organizations are facing the ever-increasing complexity of data pipelines. The need to handle diverse data formats, sizes, sources and processing requirements can result in the need of different types of transformations blocks, ranging from SQL to PySpark to low/no-code solutions. When complex table dependencies also enter the picture, you get high, […]

How AWS Well-Architected can improve your AWS cloud architecture

How AWS Well-Architected can improve your AWS cloud architecture

When talking about Amazon Web Services (AWS), most people associate it with Amazon’s online shopping platform. However, if you’re familiar with the “Web Services” aspect, this blog will interest you. Over the summer, I had the opportunity to participate in a training course regarding the Well Architected Partner Program. In this post, I will talk […]