Blog
Insights from the DataMax team on AI, data, and MLOps.
AWS
DataMax collaborates with AWS to deploy AI and Data Platform Solutions on AWS European Sovereign Cloud
DataMax announces they will be a launch partner for the Amazon Web Services (AWS) European Sovereign Cloud, a new independent cloud for Europe which will launch in the State of Brandenburg, Germany by the end of 2025.
Sadik Bakiu2 min read
AWS
DataMax achieves AWS Glue Service Delivery Recognition for our Data Engineering Expertise
We’re excited to share that DataMax has officially achieved the AWS Glue Service Delivery Validation, further strengthening our position as a trusted AWS Partner. This recognition highlights our proven expertise in designing and implementing modern, serverless data integration solutions using AWS Glue.
Sadik Bakiu1 min read
Data Platform
Comparison Open Table Formats: Apache Iceberg, Delta Lake and Apache Hudi
The concept of the data lake as a universal repository for structured and unstructured data in all kind of formats introduced significant flexibility but also brought challenges. Analytical systems must be able to rely on the structure of the data they process. Irregularities often lead to malfunctions, making such systems very susceptible to errors. The fact that data lakes are designed to store and process large amounts of data quickly led to the need to think about how to improve read and write efficiency. A problem that cannot be solved by the processing engines alone.
Ergin Gorishti5 min read
AI Engineering
Maximizing Efficiency in Distributed AI Training and Execution with Ray and DeepSpeed
Learn how to combine Ray and DeepSpeed to maximize efficiency in distributed AI training, reducing costs and cutting training times for large-scale models.
Erbli Kuka4 min read
AWS
Data Max becomes AWS Advanced Services Tier and AWS Well-Architected Framework Program Partner
DataMax achieves AWS Advanced Tier Services Partner status and joins the AWS Well-Architected Framework Partner Program, marking a major milestone in our cloud consulting journey.
Sadik Bakiu1 min read
Data Engineering
Streaming data from PostgreSQL to BigQuery with Datastream
Use Google Cloud Datastream to create a stream from a Cloud SQL PostgreSQL database to BigQuery — with Terraform for Cloud SQL, private connection, and Cloud SQL Auth proxy.
DataMax Team5 min read
AI Engineering
Harnessing the Power of Ray for Distributed Training and Execution
Discover how Ray simplifies distributed training and model execution, enabling ML teams to scale workloads across clusters with minimal code changes.
Erbli Kuka3 min read
Engineering
Preserving Privacy with an Open-Source Alternative to Windows Recall
Explore an open-source alternative to Windows Recall that keeps your activity data private and under your control, without sending anything to the cloud.
Erbli Kuka2 min read
AWS
DataMax achieves AWS Lambda Service Delivery Designation
Today, we are excited to announce that we have officially achieved the AWS Lambda Service Delivery designation. This is a confirmation of our expertise in delivering state-of-the-art, well-architected serverless solutions, reaffirming our commitment to innovation and excellence in leveraging AWS Lambda for modern cloud architecture.
Sadik Bakiu1 min read
Company
Data Max Partners with DataCamp
DataMax is pleased to announce a partnership with DataCamp, the leading platform for data science and analytics education, to support skill development and data literacy across organizations.
Sadik Bakiu1 min read
Data Engineering
Three Cost Management Pitfalls on GCP Cloud SQL
Common pitfalls when managing costs on Google Cloud Platform's Cloud SQL, and how to avoid unexpected bills while keeping your databases performant and secure.
Sadik Bakiu2 min read
MLOps
Cutting Costs - 3 Ways to Reduce Generative AI Product Development Budgets with Ray
Practical strategies to reduce costs when building generative AI products, leveraging Ray for efficient distributed compute and resource optimization.
Sadik Bakiu2 min read
AI Engineering
Elevating Interactivity in your Emails with AI: A Q&A Approach
In the realm of modern communication, email threads often harbor a wealth of information, yet extracting key insights can be a time-consuming task. To address this challenge, we developed a project utilizing a state-of-the-art RoBERTa model for quickly answering questions within email threads. This blog post provides an in-depth look at how we leveraged AI to enhance the email communication experience, while also keeping track of some metrics along the way.
Bujar Bakiu2 min read
AI Engineering
Mastering Email Efficiency: Harnessing AI to Summarize Email Threads
In an era when email the most common way of official communication, managing email threads efficiently is essential. Lengthy email conversations can become overwhelming, making it challenging to extract the key information or sentiments from them. To address this issue, we embarked on a journey to create an intelligent solution using AWS services and fine-tunning open-source LLMs. In this blog post, we'll walk you through our project, step by step, showcasing how it optimizes email comprehension efficiency with the power of AI.
Bujar Bakiu3 min read
MLOps
Monitoring LLMs With Grafana and CloudWatch
As large language models move into production, monitoring their performance and behavior becomes critical. This post shows how to build a robust LLM monitoring setup using Grafana dashboards and AWS CloudWatch, giving your team full observability into your AI systems.
Bujar Bakiu3 min read
Company
Data Max Announces Exciting Partnership with Databricks
DataMax is proud to announce our partnership with Databricks, the data and AI company, to deliver lakehouse and analytics solutions for our customers across Europe.
Sadik Bakiu2 min read
AWS
Celebrating a New Milestone - We Are Now AWS Partners!
DataMax is excited to announce that we have joined the AWS Partner Network, strengthening our ability to help customers build and run modern data and AI solutions on AWS.
Bujar Bakiu2 min read
AI Engineering
MultiGPU Kubernetes Cluster for Scalable and Cost-Effective Machine Learning with Ray and Kubeflow
How to build a multi-GPU Kubernetes cluster for scalable, cost-effective machine learning workloads using Ray and Kubeflow.
Sadik Bakiu8 min read
MLOps
A practical guide to A/B Testing in MLOps with Kubernetes and seldon-core
How to create a containerized microservice architecture for A/B testing ML models — easy to deploy, monitor, and scale — using Kubernetes and seldon-core.
Bujar Bakiu12 min read
MLOps
Apache Kafka and ML use cases
How Apache Kafka works, setting up Confluent Platform, and building a Kafka producer and consumer that sends images to a model and posts predictions to Slack.
DataMax Team5 min read
Data Engineering
Modern Data Team Hats
Cross-functional data teams and the different hats we wear — Data Engineer, Analytics Engineer, Data Analyst, Data Scientist, ML Engineer, MLOps, and Product Manager — to build end-to-end data products.
Bujar Bakiu & Martin Rusnak6 min read
AI Engineering
Dockerizing dbt Transformations for Managed Airflow: Docker, dbt, and GCP Cloud Composer
Airflow is one of the most popular pipeline orchestration tools out there. It has been around for more than 8 years, and it is used extensively in the data engineering world.
Bujar Bakiu5 min read
Data Engineering
A hands-on project with dbt, Streamlit, and PostgreSQL
A practical walkthrough of building a modern data project with dbt for transformations, Streamlit for interactive dashboards, and PostgreSQL as the backend database.
Bujar Bakiu7 min read
AI Engineering
Distributed Machine Learning Model Training with Spark (PySpark)
Apache Spark was designed to function as a simple API for distributed data processing in general-purpose programming languages. It enables tasks that otherwise would require thousands of lines of code to programm to be reduced to dozens.
DataMax Team3 min read
Engineering
Serving Dog Breed Classification model with Seldon-Core, TensorFlow Serving and Streamlit
In a modern Machine Learning workflow, after figuring out the best performing model, the next step is to bring it to the users. At Data Max we believe:
DataMax Team6 min read
AI Engineering
Deploy Airflow and Metabase in Kubernetes using Infrastructure-as-Code
A step-by-step guide to deploying Apache Airflow and Metabase on Kubernetes using Infrastructure-as-Code on Google Cloud Platform.
Igli Koxha4 min read
Data Engineering
Get started with SQLMesh
Various tools have introduced software engineering practices to data engineering, but gaps remain, particularly in areas like testing and workflows. SQLMesh aims to break new ground in these areas, addressing challenges where competing products like dbt have yet to offer robust solutions.
DataMax Team5 min read
Data Engineering
Orchestrating Pipelines with Dagster
A complete guide on how to integrate dbt with Dagster and an automated CI/CD pipeline to deploy on an AWS Kubernetes cluster
DataMax Team6 min read
AI Engineering
Why Your Company Needs an AI Platform
Why every data-driven company should invest in an AI Platform — and how it accelerates model development, deployment, and governance at scale.
DataMax Team6 min read