Data Factory
-
Transforming T-SQL (or any dialect) to Databricks with AI_QUERY: A Step-by-Step Guide
Hey folks, long time no speak – it’s been a crazy amount of time since my last blog, so it’s great to get back into it again. I won’t update…
-
Change of role!
It’s been a couple of months since my last post and that’s largely down to the fact that I’ve done something I never imagined doing – I’ve left Microsoft! There’s…
-
Data Quality ELT With Azure Data Factory
Been a while since my last post – got a few in the backlog now though so will have a trickle of articles coming through in the next few months.…
-
Change Data Capture Upsert Patterns With Azure Synapse Analytics and Databricks
Change Data Capture (Referred to as CDC for the rest of this article) is a common pattern used to capture change events from source databases and push them to a…
-
From Warehouse To Lakehouse – ELT/ETL Design Patterns With Azure Data Services
I like a good pattern. I also like a good framework. From a data perspective, nothing lends itself better to having both of these as ETL/ELT. For those not familiar…
-
Extracting data from the Microsoft Bookings API (and any others) with Azure Data Factory
The rise of remote working has come as no surprise in the last year for obvious reasons. From a Microsoft perspective, this has seen the massive growth in use of…
-
Extract, Transform & Load Options In Azure
Extract, Transform & Load (ETL), or ELT, ETLT or whatever term we use nowadays, has been around for many decades. In terms of “what it is” – although I’m sure…
-
Loading Multiple Tables With Azure Data Factory
There arn’t many articles out there that discuss Azure Data Factory design patterns. One big concern I’ve encountered with customers is that there appears to be a requirement to create…
-
Building The Data Warehouse-less Data Warehouse (Part 2 of 2)
Part 1 of this series can be found here. In my previous post I discussed and explored the feasibility of building a simplified reporting platform in Microsoft Azure that did…
-
Building The Data Warehouse-less Data Warehouse (Part 1 of 2)
*Update – part 2 of this series is now live, and can be found here* In times of yore, those who maketh the houses of data would bring forth vast…
