Category: Spark
07
Jul
Liar, liar! What to do when AI writes your pipelines confidently wrong?
by Nikola
No Comments
Should we let AI write our pipelines? YES...But not the way you probably think.
26
Mar
Batch or Stream? The Ethernal Data Processing Dilemma
by Nikola
No Comments
"Should we process our data in batches or in real-time?" It's not batch vs. stream: it's "when does the answer matter?"
27
May
Data Modeling DP-700 KQL Lakehouse Mastering DP-600 Mastering DP-700 Microsoft Fabric Real-Time Intelligence Spark T-SQL
Triple Five – How to Perform Common Data Transformations in Fabric!
by Nikola
1 Comment
Discover how to perform 5 essential data transformations in Microsoft Fabric using PySpark, T-SQL, and KQL. Whether you're coding in Python, SQL, or Kusto, this...
13
May
Data Modeling DP-700 KQL Lakehouse Mastering DP-600 Mastering DP-700 Microsoft Fabric OneLake Spark T-SQL
Stop Guessing! Choose the Right Fabric Engine for Your Data!
by Nikola
2 Comments
Microsoft Fabric is all about the options. This article provides a guidance on the most common Fabric dilemma - which analytical storage engine to choose?
10
Apr
From Default to Dynamic: Customizing Spark Settings in Your Fabric Workspace
by Nikola
No Comments
Spark settings in Fabric aren't just technical fine print - they are your ticket to immortality when it comes to Spark performance!