Tag: aivix

Databricks as a unified platform for Generative AI Development

Databricks as a unified platform for Generative AI Development

Databricks is a pioneer in AI innovations for over a decade now and with the rise of Generative AI, it will take a new step in AI innovation. Leveraging a variety of applications and tools inside the Data Intelligence Platform, Databricks empowers to develop and deploy AI models with speed, reliability and full governance all […]

Geospatial data: finding pubs along cycling routes

Geospatial data: finding pubs along cycling routes

Part 1: Geospatial fundamentals “Data is everywhere”, a tagline you will often hear or read, especially when people are talking about big data. And it is definitely true, it is estimated that a mind-blowing 120 zettabytes of data has been created in 2023. A zettabytes, that is a byte with 21 zeros. However, the sentence […]

Redefining Data Lakes: Is AWS Lake Formation the Answer to Past Troubles?

Redefining Data Lakes: Is AWS Lake Formation the Answer to Past Troubles?

Over the past years the term ‘data lake’ has dominated many conversations about data and rightfully so. Whether it is used as a buzzword or not, whether you are a data engineer, or your business handles loads of data, your way of ‘storing’ the data is probably what is called a data lake. But what […]

Streamlining data warehousing: Harnessing the power of Amazon Redshift with dbt integration

Streamlining data warehousing: Harnessing the power of Amazon Redshift with dbt integration

Nowadays, data engineers and scientists cannot keep up with all the ETL-tools popping up like mushrooms from the ground. Imagine a tool, not strictly an ETL tool, taking center stage in data transformation? With your data already extracted and loaded (the E and L in ETL) into your data warehouse, dbt excels in transforming the […]

What orchestrator to use for your ETL jobs?

What orchestrator to use for your ETL jobs?

In today’s data-driven world, organizations are facing the ever-increasing complexity of data pipelines. The need to handle diverse data formats, sizes, sources and processing requirements can result in the need of different types of transformations blocks, ranging from SQL to PySpark to low/no-code solutions. When complex table dependencies also enter the picture, you get high, […]

How AWS Well-Architected can improve your AWS cloud architecture

How AWS Well-Architected can improve your AWS cloud architecture

When talking about Amazon Web Services (AWS), most people associate it with Amazon’s online shopping platform. However, if you’re familiar with the “Web Services” aspect, this blog will interest you. Over the summer, I had the opportunity to participate in a training course regarding the Well Architected Partner Program. In this post, I will talk […]

Uploading Json data to an on-premise REST API using Azure Data Factory and Azure Databricks

Uploading Json data to an on-premise REST API using Azure Data Factory and Azure Databricks

The goal of this exercise is to upload some data we read from csv files, structure them as Json and upload the data to a REST API. The catch is that we are uploading this data to an on-premise API from our azure cloud. The API requires authentication via an access token, and the API […]

Exploring the potential of Databricks Assistant: the future of Data Lakehouse interaction?

Exploring the potential of Databricks Assistant: the future of Data Lakehouse interaction?

On the past Databricks Data & AI Summit (2023), Databricks announced LakehouseIQ, an AI-powered engine that helps you get more insights in your data lakehouse, and facilitate interaction with it. While there is no official release date published for LakehouseIQ, Databricks just released the Databricks Assistant, an AI-based companion that helps you coding and interacting […]

Support that makes a difference

Support that makes a difference

Welcome to the Intellus support blog! We offer expert support beyond analytical projects, helping customers with day-to-day tasks, ad-hoc requests, technical questions and small projects. With extensive knowledge of SAP, Microsoft, AWS and Databricks systems, we tackle back-end and front-end issues, ensuring customer satisfaction with top-notch solutions. Our dedicated first-line support team, Jordy and Samuel, […]

Explaining AI: Interpreting using SHAP

Explaining AI: Interpreting using SHAP

The possibilities of Machine Learning models are almost limitless. Ranging from predicting customer churn over determining the right discount to maintaining your machines using predictive maintenance. The outcome of a machine learning model is often straightforward: a zero or one in classification problems, a continuous number in case of a regression problem. However, companies might also be interested in understanding how ‘the number’ […]