Tag: databricks

Databricks as a unified platform for Generative AI Development

Databricks as a unified platform for Generative AI Development

Databricks is a pioneer in AI innovations for over a decade now and with the rise of Generative AI, it will take a new step in AI innovation. Leveraging a variety of applications and tools inside the Data Intelligence Platform, Databricks empowers to develop and deploy AI models with speed, reliability and full governance all […]

Uploading Json data to an on-premise REST API using Azure Data Factory and Azure Databricks

Uploading Json data to an on-premise REST API using Azure Data Factory and Azure Databricks

The goal of this exercise is to upload some data we read from csv files, structure them as Json and upload the data to a REST API. The catch is that we are uploading this data to an on-premise API from our azure cloud. The API requires authentication via an access token, and the API […]

Exploring the potential of Databricks Assistant: the future of Data Lakehouse interaction?

Exploring the potential of Databricks Assistant: the future of Data Lakehouse interaction?

On the past Databricks Data & AI Summit (2023), Databricks announced LakehouseIQ, an AI-powered engine that helps you get more insights in your data lakehouse, and facilitate interaction with it. While there is no official release date published for LakehouseIQ, Databricks just released the Databricks Assistant, an AI-based companion that helps you coding and interacting […]

Support that makes a difference

Support that makes a difference

Welcome to the Intellus support blog! We offer expert support beyond analytical projects, helping customers with day-to-day tasks, ad-hoc requests, technical questions and small projects. With extensive knowledge of SAP, Microsoft, AWS and Databricks systems, we tackle back-end and front-end issues, ensuring customer satisfaction with top-notch solutions. Our dedicated first-line support team, Jordy and Samuel, […]

Pandas, Koalas and PySpark in Python

Pandas, Koalas and PySpark in Python

If you landed on this page to learn more about animals, I have to disappoint you. Pandas, Koalas and PySpark are all packages that serve a similar purpose in the programming language Python.  Python has increasingly gained traction over the past years, as illustrated in the Stack Overflow trends. Originally designed as a general purpose […]

Transfer learning in Spark for image recognition

Transfer learning in Spark for image recognition

Transfer learning in Spark demystified in less than 3 minutes reading Businesses that want to classify a huge set of images in batch per day can do this by leveraging the parallel processing power of PySpark and the accuracy of models trained on a huge set of images using transfer learning. Let’s first explain the […]

Managed Big Data: DataBricks, Spark as a Service

Managed Big Data: DataBricks, Spark as a Service

The title accompanying this blog post is quite the mouth full. This blog post will explain why you should be using Spark. If a use case would make sense, then we will introduce you to the DataBricks product, which is available on Azure. Being recognised as a Leader in the Magic Quadrant, emphasizes the operational […]

Architecture behind the Qatar World Cup 2022 model

Architecture behind the Qatar World Cup 2022 model

We explain the steps we took to predict the winner of the Qatar World Cup 2022 in this blog. The concepts covered include the various types of source data, the machine learning model, and the architecture used to obtain our results. Furthermore, we will go over and interpret the results in greater depth. Source data […]