Data Mozart

Course

Showing all 2 results

  1. Paritosh

    You don’t need a disconnected table. I measure changing the filter context would be sufficient.
    Something like sameperiodlastyear method.

    1. Nikola

      Thanks for your comment Paritosh. As for almost any problem, there are multiple different solutions, and disconnected table is just one of them:)

  2. Dennes

    Very Good, but also scary!

    This is the kind of thing which can change on any minute, in a service pack or something like that, and many would not notice.

    1. Nikola

      Thanks for your comment Dennes. I agree with you, we should be careful and try to stay tuned for all adjustments.

  3. Guy Glantser

    Thanks Nikola!
    I disagree with you. I think that DATETIME2 still has some important benefits, just like you mentioned – less storage, bigger precision, larger date range and being SQL standard compliant. I think that the only meaningful drawback of DATETIME2 is the bug in the cardinality estimator when associated with the DATEADD function. This is a big deal, but it can be avoided by using a DATETIME value in the relevant expression inside the DATEADD function, and then converting back to DATETIME2, just like Paul White suggested.

    1. Nikola

      Hi Guy,

      Thanks for your comment.

      I agree with your disagreement:)…I was also wholeheartedly on Datetime2 in the beginning, exactly because of all advantages you mentioned, but in the end I’m not sure which type is “better”. Hmmm, for larger date range and being SQL standard compliant, I don’t consider these as so significant advantages, since I really don’t see many scenarios when that can make big impact (of course, maybe I’m just assuming wrong). But, for bigger precision and memory consumption – fully agree with you, those are really important advantages, which one should seriously consider when making design decisions.

      I guess, as in 99.9% of situations when it comes to SQL Server, the correct answer is: “It depends:)”

      Thanks again for your opinion, really appreciate that.

  4. Gudmundur Asmundsson

    This is far better dimdate function that I have been using since 2017. It creates a custom function with date from and to plus u can specify the local language for days and months.

    let CreateDateTable = (StartDate as date, EndDate as date, optional Culture as nullable text) as table =>
      let
        DayCount = Duration.Days(Duration.From(EndDate – StartDate)),
        Source = List.Dates(StartDate,DayCount,#duration(1,0,0,0)),
        TableFromList = Table.FromList(Source, Splitter.SplitByNothing()),
        ChangedType = Table.TransformColumnTypes(TableFromList,{{“Column1”, type date}}),
        RenamedColumns = Table.RenameColumns(ChangedType,{{“Column1”, “Date”}}),
        InsertYear = Table.AddColumn(RenamedColumns, “Year”, each Date.Year([Date])),
        InsertQuarter = Table.AddColumn(InsertYear, “QuarterOfYear”, each Date.QuarterOfYear([Date])),
        InsertMonth = Table.AddColumn(InsertQuarter, “MonthOfYear”, each Date.Month([Date])),
        InsertDay = Table.AddColumn(InsertMonth, “DayOfMonth”, each Date.Day([Date])),
        InsertDayInt = Table.AddColumn(InsertDay, “DateInt”, each [Year] * 10000 + [MonthOfYear] * 100 + [DayOfMonth]),
        InsertMonthName = Table.AddColumn(InsertDayInt, “MonthName”, each Date.ToText([Date], “MMMM”, Culture), type text),
        InsertCalendarMonth = Table.AddColumn(InsertMonthName, “MonthInCalendar”, each (try(Text.Range([MonthName],0,3)) otherwise [MonthName]) & ” ” & Number.ToText([Year])),
        InsertCalendarQtr = Table.AddColumn(InsertCalendarMonth, “QuarterInCalendar”, each “Q” & Number.ToText([QuarterOfYear]) & ” ” & Number.ToText([Year])),
        InsertDayWeek = Table.AddColumn(InsertCalendarQtr, “DayInWeek”, each Date.DayOfWeek([Date])),
        InsertDayName = Table.AddColumn(InsertDayWeek, “DayOfWeekName”, each Date.ToText([Date], “dddd”, Culture), type text),
        InsertWeekEnding = Table.AddColumn(InsertDayName, “WeekEnding”, each Date.EndOfWeek([Date]), type date)
      in
        InsertWeekEnding
    in
      CreateDateTable

    1. Nikola

      Fantastic! Thanks for sharing Gudmundur!

  5. hubert

    About date … Could you please display publish date? It’s crucial for tech blogs!

    1. Nikola

      Sure, thanks for the suggestion.

  6. Eitan Blumin

    I think the bad statistics estimations should pretty much be a deal-breaker here…

  7. Fred Kaffenberger

    what about CDM, Python, R?

    1. Nikola

      Hi Fred,
      Personally, I’ve had maybe one question with R, no Python/CDM at all. Which doesn’t imply that it can’t happen that someone else had it.

  8. Fred Kaffenberger

    thanks! I’m reviewing the official training now, so I don’t expect too many difficulties

  9. Carmine

    i’m curious then… how is productive to store/display date in Powerbi? Can you give a hint on that?

    1. Nikola

      Hi Carmine,

      If you don’t need the time part, then store it as a Date only, since there will be less distinct values and therefore data compression will be better and your data model size will be lower.

      In any case, don’t forget to change the data type in Power Query Editor, BEFORE you load data into your report. Once you load it to a report, you can just change the formatting to exclude time part, but underlying data model will still keep the time part.

      Hope that this helps.

  10. Vivek Ranjan

    Great article. Thanks!

    I have a question: How can we get the column header name instead?

    1. Nikola

      You’re welcome. Sorry, but I’m not sure that I understood your question: column header name instead of what?

  11. Sérgio. Silva

    Great articule. Kind regards from Portugal.

    1. Nikola

      Thanks Sergio, much appreciated! Greetings to you from Austria:)

  12. Ray Ludeña

    Thank Sergio.
    Very interesting this article.
    I have a question. These recommendations also could use in other visualizator like Qlik, right?
    Regards from Perú

    1. Nikola

      Hi Ray,

      Some of these rules are generally applicable (like, for example, eliminating columns/rows you don’t need), but I really don’t have any experience with Qlik, so I don’t know how it stores or compresses the data. The example from my article relates to the Tabular model, which runs in the background of SSAS Tabular, Power BI, and Power Pivot for Excel.

  13. Baz

    You could always group the slicers with two small shapes at either end of your panel to create the width and height you want. Go to the selection pane hide the shapes so they are not visible to the end user. You can then add a background to the group. No bookmark needed.

    1. Nikola

      That’s also an awesome trick! Thanks for sharing Baz.

  14. Wederley

    Very interesting and useful article! Thanks for sharing!
    Greetings from Brazil.

    1. Nikola

      Thanks Wederley, I’m glad that you find it useful! Greetings from Austria.

  15. Srecko

    Dobar i korisan clanak Nikola!

  16. John K

    Nice tip. Now to push for more.
    How can you have CONCATENATE X to substitute “and” for the last comma? Instead on getting “Apples, Bananas, Pears”, you get “Apples, Bananas and Pears”.

    1. Consultant Power BI

      You have to use SUBSTITUTE with the last parameters, [InstanceNumber] being equal to DISTINCTCOUNT of the given column minus 1 (this means the last position in the serie). This is an example :
      Selected Brands = SUBSTITUTE( [YOUR_CONCATENATE_FORMULA], “,” , ” and”, DISTINCTCOUNT(‘Product'[BrandName]) – 1 )

  17. mobile legends hacks

    You really make it seem really easy with your presentation however I to find this topic to be really
    something which I believe I might never understand. It seems too complicated and very huge for me.
    I am looking ahead for your next submit, I’ll attempt
    to get the grasp of it!

    1. Nikola

      Thanks! It’s really not that hard, just try to understand general data modeling principles (Kimball methodology): After that, I’m sure you will get to grasp with specific related topics.

  18. mobile legends cheat

    Hmm it seems like your blog ate my first comment (it was
    extremely long) so I guess I’ll just sum it up what I wrote and say, I’m thoroughly enjoying your blog.
    I too am an aspiring blog writer but I’m still new to everything.
    Do you have any helpful hints for newbie blog writers?
    I’d really appreciate it.

  19. mobile legends hack

    This is very fascinating, You’re a very skilled blogger. I have joined your rss feed and
    sit up for in quest of extra of your excellent post.
    Additionally, I have shared your site in my social networks

  20. mobile legends hack

    Pretty! This was a really wonderful article. Thanks for providing this info.

  21. Bharath

    Nice article. Agree with the way you mentioned here. What happens when user says they want the same conditional formatting in the exported Excel as well??

    1. Nikola

      Good question! Unfortunately, at this point in time, conditional formatting doesn’t work when exporting data from the Power BI report to Excel.

    2. Ben Connelly

      Yeah, unless MS finds a brilliant way to unify how conditional formatting works and is written in both pieces of software, it seems like that may never happen unfortunately. Even the Export to Excel feature is only squeezing out the data only… Excel wouldn’t be able to read how PBI encodes its calculation engine.

      Don’t get me wrong, Excel has through Power Pivot the wherewithal to understand all that, but it doesn’t appear MS is interested in wiring all these similar systems together. I hope I’m wrong. I hope they come out with Excel 2022 and say: “Hey, we’re merging Excel and Power BI’s differing functionalities into one… Power Excel BI!!!”

      1. Nikola

        Completely agree with you, Ben. Let’s hope that MS hears our prayers before 2022:)!
        By the way, Power Excel BI – sounds awesome:)!

  22. Lee

    I’ve been using bookmarks as navigational tools on paginated reports but never considered using books marks in place of static tooltips. This is definitely going to raise my visual game, thank you!

    1. Nikola

      You’re welcome, I’m glad if you find it helpful!

  23. Carlos Santos

    Very nice and sinple way to improve the report performance!

    1. Nikola

      Thanks Carlos, I’m glad if you find it useful

  24. Ferdinand Santos

    Hi Nikola,

    Thank you! I will be using this approach in my upcoming project.

    Comment on the following;

    “Before we conclude, one important remark: in order for this trick to work in Power BI Service, you need to switch the function in My Tasks measure, and use USERPRINCIPALNAME() instead of USERNAME():”

    Shouldn’t it say “use User Service instead of User Local”?

    Best regards,

    Ferdinand

    1. Nikola

      Hey Ferdinand,

      Thanks for spotting this, you are completely right! Just updated in the article:)

      Thanks again!
      Nikola

  25. Rhonda

    I love this! Great example of a real world scenario, and gives me ideas to get away from the boring tables!

    1. Nikola

      Thanks Rhonda, I’m glad if you find the article useful!

  26. Roland Szirmai

    Hi Nikola,

    I was just exploring this option last week, and I’m so happy that GITC pointed me here! Really great example – and more importantly I can copy-paste this 🙂 “I’m not lazy, just efficient”, right?
    One thing, which in my case helps a bit more is the below (sorry for the formatting in advance):

    My Customers =
    VAR user = USERNAME()
    VAR uName = LOOKUPVALUE(‘User Directory'[Surname],’User Directory'[E-mail],user)

    RETURN

    CALCULATE(
    COUNTROWS(Customers),
    //KEEPFILTERS(
    CONTAINSSTRING( Customers[Sales Rep Search], uName)

    )

    The reason behind that is we can have multiple SalesReps linked to a single Customer. Of course, this makes it a bit more challenging to apply page level filters (or maybe I’m doing something wrong), but can apply this filter on each visual on the page.
    With the bookmarks and buttons of course!

    Again, great stuff, and thanks!
    Regards,
    Roland

    1. Nikola

      Hey Roland,

      Thanks for expanding on this, really great use-case, I like it! And, yes, “we are not lazy, just efficient”😁😎
      Best,
      Nikola

  27. Steve

    Great info. Looking forward to your other Power BI 101 topics/posts.

    1. Nikola

      Thanks Steve! The next article is already published: https://data-mozart.com/power-bi-data-shaping-in-a-nutshell/
      Stay tuned for the rest of the series:)

  28. Weekly Data Round-up 01

    […] Slicing Data with Images in Power BI – Nikola Ilic (DataMozart) has blogged about how to use images for slicing data in Power BI reports here. […]

  29. Kay

    Great summary! Love this. If I’ll get asked what the differences are, I’ll point them to this post.

  30. camo phone case

    Your mode of describing all in this paragraph is truly good, all be capable of
    without difficulty know it, Thanks a lot.

  31. autenticos y exclusivos

    Great article post.Thanks Again. Will read on…

  32. we just did shirt

    These are actually enormous ideas in on the topic of blogging.
    You have touched some nice factors here. Any way keep up wrinting.

    1. Nikola

      Thank you, I’m glad if you find these questions inspiring

  33. Triparna Ray

    Thanks for sharing useful insights on this important topic. With regard to guid if we do not have option to change source structure we have to bring in guid and to improve performance trying to add index column and join based on that. What we found was this caused query folding not to work any further. Any thoughts?

    1. Nikola

      Hi Triparna,

      As far as I know, there is no proper way to optimize GUID performance once you import it into the Power BI. Query folding will not work in cases when your Power Query transformations can’t be “translated” to a source language (mostly SQL).

  34. Sohail Imtiaz

    Nice article. Thanks for sharing this.

    1. Nikola

      You’re welcome, glad that you liked it!

  35. Bharat

    Wow amazing article must know for Power Bi developer.

  36. Anas Farah

    Love this series of posts!

    I actually have a quick question/potential article topic. I was working on a report this week and I wanted to create a 24 hour moving average measure and I realized a lot of the time intelligence function seem to only go down to the hour granularity. So I was wondering how do you handle hourly data in Power BI? I didn’t find a lot of resources online on how to tackle that.

    Thanks!
    Anas

    1. Nikola

      Hi Anas,

      Good question! I believe you’ve wanted to say that a lot of the time intelligence functions go down to the DAY level of granularity, instead of HOUR:)…I think you can’t use built-in time intelligence functions for hour calculations, but all of these built-in functions can be rewritten in “normal” DAX. Honestly, I don’t know from the top of my head how to handle this request, but you are right – it’s a good idea for one of the next articles:)

  37. Hitchhikers guide to Azure Purview for Power BI professionals - vcunews

    […] should have noticed that Microsoft made two important announcements a few weeks ago: the first, Azure Synapse Analytics became GA, while the other also caused a lot of interest: by introducing Azure Purview as the […]

  38. Small Multiples in Power BI – Curated SQL

    […] report performance even if they aren’t displaying any data; several other people have written similar posts too. Small multiples are just another way you can replace several visuals with a single visual […]

  39. Daniel Clark

    Have you tested the performance on this?

    1. Nikola

      Hi Daniel,

      Honestly, I haven’t tested performance, because my table was really small (<1000 records).

  40. Peter Hui

    This is still pretty amazing, could have saved me so much time !

    1. Nikola

      Thanks Peter, I’m glad to hear that you find it useful!

  41. Bob Blackburn

    Thanks for a ton of great content. Most people don’t realize how long technical posts take.

  42. Chandru Sugunan

    Hi Nikola, Correction to the third screenshot from the top(Configuring Power BI tenant). The red box is pointing to incorrect feature switch.
    The correct one is documented in our official Purview documentation page. https://docs.microsoft.com/en-us/azure/purview/register-scan-power-bi-tenant#associate-the-security-group-with-the-tenant

    1. Nikola

      Thanks for spotting it Chandru! It’s been corrected:)

  43. Ayobami Adeleke

    Nice one, please can you leave a link to the pbix here?

    1. Nikola

      Hi Ayobami,

      Unfortunately, I can’t, as it contains real data that is not for sharing outside of the company. Sorry about that!

  44. NEil Rodrigues

    simple but super useful.. Thank you. this is a great blog. the synapse bit is of less use to me, the development and report building is certainly something i enjoyed reading

    1. Nikola

      That’s great to hear Neil! Cheers from Austria!

  45. Nikola

    Thanks Jolie, great to hear that!

  46. Jerry Brown

    This is good news, and hard to find resources on this for PBI Report Server, so thank you! I have a question about where you enter the query. I need to set this up for my team but I’m missing information on how to access these logs. Do you enter the queries you show from inside Power BI Desktop (for server), or do you sign on from a url, or maybe MSSMS Report Server Configuration Manager?

  47. Nico Botes

    Awesome, indeed! Use it all the time… I see on your sample Report, you have a Year, and Month Slicer, each being a dropdown… I use the same, but additionally, I have a Date-Range slicer, that allows for getting to a custom date-range, or maybe specific days…

    I have seen that when I use such, as your Year and Month dropdown filters…and then changing to a specific day, then going back to changing the Year or Month, only the Start-Date of the Date-Range slicer updates – I’ve checked “Edit Interactions”, so that should allow for perfect interaction between the different Date slicers…which all comes of my Date-Dimension table, with hierarchies… I’m just wondering, if it is a bug in Power BI with the slicer itself…it’s not a showstopper, but annoying…a quick reset filters bookmark, or even the clear button on top-right of filter sorts it out…it’s just not the best user experience alltoghether…

  48. Weekly Data Round-up 06 – 18/12/2020

    […] Extend Power BI theme with an image! – Nikola Ilic (@DataMozart), MCT, has blogged a really great trick to add images to a Power BI theme to automate adding images to Power BI report pages. Read more. […]

  49. Les Actus Power Platform du 05/02/21 - Neoreeds

    […] 📊 Power BI : Bien démarrer avec Azure Purview pour Power BIhttps://data-mozart.com/hitchhikers-guide-to-azure-purview-for-power-bi-professionals/ […]

  50. Nico Botes

    Hello, have you ever encountered this whilst running a “job” in Azure Analysis Services?

    1. Nikola

      Hi Nico,

      Honestly, not in AAS, as I’m using on-prem SSAS only.

  51. Haradev

    Hi Nikola,
    I am preparing for more than a month and relying on the practice tests. Can you suggest any other things apart from Microsoft’s online training material? Do you think the MS official practice test is useful? I already finished Steven Parker’s videos after taking your suggestion and it was helpful. Thanks

    1. Nikola

      Hi,

      I took the exam while it was still in beta, so there were not many resources out there (even MS Learn path came later). I don’t have experience with the MS official practice test, so I can’t say if it’s useful – probably yes, but you should maybe check that with someone who tried it.

      I think Parker’s training is excellent for someone trying to complete DA-100, and I believe you will do great! Good luck with your exam!

  52. Bibin Bastian

    Very neat technique

  53. Erik

    Very interesting blogpost!

    I am now getting curious if it is possible to choose both dimensions and put them both in a different column so the data will be grouped by both chosen dimensions.

  54. Derek

    It can be from different sources or excel, as long as you put a dataflow (plus enhanced compute engine) in between 🙂

    1. Nikola

      Hah, that’s cheat😉!

  55. Marcus Wegener

    Hi Nikola,
    if you merge two queries and expand the columns, it should bring back the query folding.

    https://www.thebiccountant.com/2019/04/18/query-folding-joinkind-inner-gotcha-power-bi-power-query/

    1. Nikola

      Oh, man! Thanks for the tip Marcus, didn’t know that:(…Is that a bug, or what?

      1. Marcus Wegener

        It never a bug, it’s always a feature 😉

  56. CHRISTOPHER MAJKA

    Great blog post Nikola. There is also a Github that Alex has posted with M functions that fold, etc. https://github.com/itsnotaboutthecell/powerquerym/blob/master/QueryFolding.md

    1. Nikola

      Thanks Christopher. And special thanks for providing a link to the Github repo that Alex created for PQ related stuff!

  57. How to Capture SQL Queries Generated by Power BI - H4Host.com - Latest Web Hosting News

    […] already written why you should reconsider using DirectQuery, and in which scenarios (maybe) it makes sense to go that […]

  58. Nathan Watkins

    As you might know, query folding will occur with Table.TransformColumns() if you use Date.From instead of DateTime.Date. Great article nevertheless!

    1. Nikola

      Great point Nathan! Thanks for expanding on this

  59. Nathan Watkins

    As you might know, query folding will occur with Table.TransformColumns() if you use Date.From instead of DateTime.Date. Great article nevertheless!!

  60. Creating a Timetable Fact Table from a Schedule - Shetland Data

    […] rows will be 500 times the number of scheduled activities. Still a tool like Power BI should still make quick work of this.  Again this query uses the prior as the […]

  61. Ionut Danciu

    Thanks Nikola for sharing, this is great stuff!
    Only one thing is puzzling me: your DirectQuery “cold” data is an Azure AS tabular model?

    Thanks,
    Ionut

    1. Nikola

      Thank you Ionut. Direct Query “cold” data is in SQL Server database, as all client’s legacy technologies are on-prem (SQL Server and SSAS MD).

  62. Ioan Danciu

    Thanks for your fast reply!
    This means you use your SQL Server on-prem database twice: as “hot” and “cold” data, right?

    1. Nikola

      “Hot” data is loaded into Power BI (in the aggregated table), but yes, it “lives” also in on-prem SQL Server. Essentially, it is physically just one big fact table in the SQL Server database, and it is split into two for Power BI – “hot” data goes in Import mode, “cold” data stays in SQL Server. Aggregated tables over “cold” data are imported into Power BI too, as they are not memory exhaustive, and satisfy 95% of the reporting requests.

      1. Ionut Danciu

        Thanks again Nikola for the detailed explanation – I understood now properly.
        I was surprised at first glance as I thought you used Direct Query directly against the on-prem SSAS MD, which is at this time not supported (as I know).

        Another question: are there features you used here in preview mode, or all included in GA? Or, in other words: is this approach safe to be used on a productive customer environment?

        1. Nikola

          No problem at all!

          You’re right, Direct Query over SSAS MD is not supported (only Live Connection). Regarding your question: all the features are GA, so you can freely use them in a production environment.

          Cheers!

  63. Frank Tonsen

    Nice tutorial. One question.
    Why did you build an agg table based on factBetSummaryHot?
    Isn’t it sufficient to import the hot data directly instead?

    1. Nikola

      Thanks Frank!

      You’re right, you can also import “hot” data “as-it-is”, without aggregation, but it will then consume more memory.

  64. General Ledger

    It seems a screenshot is missing at Based on this value, I will determine if the product belongs to High, Medium or Low group. To achieve that, SWITCH function comes in handy:

    1. Nikola

      Oh, good catch! Thanks! It’s been fixed now:)

  65. Marcus Wegener

    Nice blog post Nikola! Just to be correct, you can use implicit measures in multiple different aggregation types.
    You just have to drag the column several times into the value area and assign different aggragations to it.

    Love greetings
    Marcus

    1. Nikola

      You’re right Marcus, thanks for pointing this out! I’ve corrected this part of the article👍

  66. Jessica Jolly

    Great article! I was just talking about explicit and implicit measures to my students. Now I have an excellent link to share with them.

    1. Nikola

      Thanks Jessica, I’m glad if you find the article helpful!

  67. Marius

    Or you could just use calculation groups in TE!
    Thats a game changer 🙂

    1. Nikola

      Great point Marius, thanks!

  68. Denisse

    Hello, when you remove the columns or reduce the rows, do you do it at the source or in Power Query?

    Thank you,

    Denisse

    1. Nikola

      Hi Denisse,

      You can do it at both places. When I write a native SQL query to import the data, I’m removing unnecessary rows and columns on the source side, to preserve the query folding afterward. While, when I import the table in a “regular” way, I’m filtering data in the Power Query editor.

      Hope this helps.

  69. Jon

    Love it.
    Can you make a blog post on how to calculate Mode (most frequent values) in different granular detail? Such as by order, by product, by category, by the whole, assuming the order qty is whole number. Each order can have multiple lines for the same product or different products.

  70. taras koniukhov

    Thanks Nikola for sharing, very inspiring!

    1. Nikola

      You’re welcome Taras!

  71. Balde

    Hello Nikola,

    Thanks for sharing.
    I have one question, I can see you have many id columns in your tables. What If you just « deleted » those unused column Id to reduce the model size ?

    How do you proceed If you want to calculate a year to date ?

    Regards,

    1. Nikola

      Hi Balde,

      Great point! For this demo, I’ve removed multiple dimension tables from the model, but forgot to remove the foreign keys (ID columns) from the fact table. As you rightly said, that would reduce the model size even more.

      Regarding YTD calculation – that should not be a problem until you are using the measure that hits the imported or aggregated tables.

      Cheers,
      Nikola

  72. Steffen

    Hello Nikola,

    very cool tips! I tried #3. Do you know also a script for formating calculated columns?
    Thank you

    Steffen

  73. Vinay B N

    Wow! This is mind-blowing.

  74. Bibin

    Thanks for the detailed explanation

  75. christopher majka

    Looking forward to this series of posts – very relevant for any Power BI user out there!

    1. Nikola

      Thanks Christopher, glad to hear that you find the article useful! Hope you’ll enjoy the rest of the series:)

  76. Rolly

    Great article out there! . Is there any documentation as to how to create a star schema with multiple fact tables?

    1. Nikola

      Hey Rolly,

      Patrick from Guy in a Cube has a great video on how to handle multiple fact tables in Power BI. Here is the link: https://www.youtube.com/watch?v=TnyRsO4NJPc

      Hope this helps.

  77. ARJUN DN

    Nice one Nicola…

  78. CHRISTOPHER MAJKA

    Nicely done! Will definitely be able to use this technique in our reporting. Thanks

    1. Nikola

      Thanks Christopher, great to hear that!

  79. Building an End-To-End Analytic solution in Power BI: Part 5 — Action, please! – Kamran Mahmoudi

    […] over a specific visual, the respective action should be displayed! I’ve already written how to enhance your report using tooltip pages, and here we will follow a similar […]

  80. Ilya Rzhevskiy

    Wow, I didn’t know this. However in Data Science its always advisable to clean up tables, replacing Blanks with O’s. Because that could enable more complex algorithm calculations later on. So it depends on your usage of data.

    1. Nikola

      Yes, it depends on the use case, but it’s good to be aware of the possible consequences.

  81. Prince Kher

    In an ideal reporting solution Data Marts for the specific period should be in place. To be honest on performance based Table will def have better performance if you can load the whole view data rather than joining but if its a timely refresh of data we can always refresh at a non peak time of the report.

  82. Georgi

    Great post, Nikola! I am playing with this new visual now to build a case for one of my customers and everything looks perfect until I publish the report to the service. Then it says that the report couldn’t access the data source and it doesn’t render. Have you stumbled upon such issue? I am thinking it might be because the source for my paginated report is an SSAS tabular database but then again, it doesn’t make sense to work in PBI Desktop and fail in the service.

    1. Nikola

      Thank Georgi! Are you using Live Connection, or Import mode?

  83. Anil

    Thank you so much for the wonderful explanation about BI. I am curious to learn thoroughly. How can I get the next parts, please. Regards

  84. Nichole Minnick

    Hello Nikola, this is amazing! I have a couple of charts that will greatly benefit from this. However, when I try to apply the logic to a data point that is not a measure, it doesn’t work. Is there something I can do to convert the data to a measure or a different dax code?

  85. Sushanth B

    As you said views are stored query upon multiple tables that execute upon calling the view, ok then what will happen when a view is joined to another table to get a result set? Will the stored query need to execute for each record in the join with the table?
    Is this a best practice? Or what Is the best practice in this situation?
    Select * from tableA a join viewA b
    On a.id=b.id
    Will viewA stored query will execute for every join records from tableA???

    Please clear my question…

    1. Nikola

      Hi Sushanth,

      Here is a very good article explaining considerations in the scenario you mentioned: https://codingsight.com/top-3-tips-you-need-to-know-to-write-faster-sql-views/

  86. TWIL: November 14, 2021 – André Vala

    […] 3 reasons to use views instead of tables in Power BI!In recent months, I was frequently asked if one should use tables or views when IMPORTING data in Power BI. I’ve intentionally marked word importing, as the main purpose of this article is to compare usage of views vs tables in Import mode. […]

  87. Raju kumar

    To much informative.

  88. Alexandre Doyen

    Thanks this is amazing! So concise. Much better than Microsoft lessons =)

  89. Last Week Reading (2021-11-28) | SQL Player

    […] Power BI Performance Tuning Cheatsheet! […]

  90. bschobs

    This is great!!!

  91. Vishwajeet

    In a dataset if there are parameters created using Manage Parameters option in edit query. How can we add or utilize those Parameters to our Native query?

  92. Wouter De Raeve

    Can partitions come from different tables?
    Eg your import partition is one table and the DQ one is a different table (but they both have near-identical structures)?
    If you then set up your ETL so your DQ-table is always the differential vs the import table, the scan to the DQ-table is not that costly…
    Just don’t know if that is technically possible….

    1. Nikola

      Hi Wouter,

      The approach you are proposing is possible and it’s called the Composite model. Basically, you keep one table in DQ mode, while the other(s) are in import mode.
      More details here: https://docs.microsoft.com/en-us/power-bi/transform-model/desktop-composite-models

      With Hybrid tables, you are simply splitting DQ and Import data within one same table. Hope this helps.

  93. Ron

    Hi Nikola, happy you write this article!! Trying to understand. So:
    – scenario 1 is where the direct query data is recent/hot and the imported data is cold
    – scenario 2 is where the imported, aggregated data is recent/hot and the directquery data is cold?

    What if you have a composite model, that is only refreshed at the beginning of day (so no real-time data) whereby the requirement is that I want to have insight in aggregated (import) and very recent detailed (direct query) data ?
    Is it then better just to stick to the composite model?

    regards
    Ron

    1. Nikola

      Hi Ron,

      Well, the only correct answer is “it depends”:)

      If you’re using a composite model where tables are with different granularity (I’m assuming the import data is aggregated per year/month/product/whatever…and DQ table goes to the lowest level of granularity), then I’d say you should stick with composite model. Because, in the end, a Hybrid table is just a table: so, you can’t define different granularities within one single table.

  94. Paul Olding

    Nice piece.
    I find this a really interesting question and have come to the opposite conclusion – go with 2 actors as the default. It seems this puts me out of step with most experts on the topic but my reasoning is all about ease of use for self-service. I find that a big benefit of 2 actors is you can name the columns: Bet Placed Month, Bet Processed Year, etc etc. Much clearer for the end user to build a visual, and much clearer for the report consumer to have a visual with Title and axis labelled unambiguously.
    To me the extra training of end users comes with the 1 actor approach. Having to explain that if you want to slice by date you have to pick the right measure, but you can choose any measure if you want to slice by product is what confuses. Also, ending up with a visual that, for example, counts bets by product that then mentions (Date Processed) in the Title when the date is totally irrelevant leads to confusion too.

    1. Nikola

      No issues with the “2 actors” approach at all! It just depends on a specific use case, and evaluating all pros and cons that come with any of these two solutions in that specific case.

  95. Kamil Kaleciński

    Great Article, thanks for clarifying how 2nd Scenario should be configured in practice, as I immediately imagined this version while learning about Hybrid table preview. I only have one question – Tabular Editor was raising an error until I set an import partition Data View to Sample mode. Do you know why it was needed and if there are any consequences related?

    1. Kamil Kaleciński

      Doesn`t matter, just found that the problem was caused by an incorrect Compatibility Mode. When I switched from 1500 to 1565, it is all working as expected, so I am just leaving a hint to the others. Great feature!

  96. Kirill Perian

    Thanks for posting this, Nikola! The requirement of slicers reacting to other slicers is not new and the common go-to solution for new Power BI developers is to accomplish it with bi-directional relationships. Somehow, the slicer filtering by non-blank measure results isn’t yet widely popular, so thank you for bringing it to everyone’s attention.

    1. Nikola

      Thanks Kirill! You’re absolutely right, I saw this multiple times, and it was almost always bi-directional relationship included

  97. Martina

    Hi,
    we are trying to apply scenario #2 on our power bi data model. I would like to ask what is/should be the settings of Data view for each partition.. Because we created 2 partitions – import with data view Full and DirectQuery with data view Sample (as Full or Default is not posible to choose). After finishing the full process of appropriate table in SSMS, only data from DirectQuery are displayed in report/excel. Can it be caused by partition setting on Sample data view? Or do you have any idea where could be the problem? Thanks.

    1. Krystian Sakowski

      you shouldn’t set up any data view settings.
      that feature is deprecreated & discontinued for powerbi.
      did you upgrade compatibility level of your dataset to 1565 like Kay did in his article?
      https://powerbi.microsoft.com/en-us/blog/announcing-public-preview-of-hybrid-tables-in-power-bi-premium/
      w/o doing that indeed you can observe some legacy errors mentioning data view settings.

  98. Tom

    A lot of drama in this article. lol
    Don’t get me wrong, thanks to the article, and made me learn when to use the new DAX: ‘CROSSFILTER’.

    Thank you, Nikola.

  99. Hans Peeters

    Hi Nicola,
    Question I tried Page Refresh with DirectQuery to a SSAS cube on Prem; But this doesn’t give me the desired result. I think this is not yet supported and what you show only DirectQuery to a database is supported. Is this correct?

    To test this; i have created a PBI report, connected it to a SSAS cube; set the page refresh to 1 second; uploaded it to PBI cloud; Opened dax studio and turned the profiler on; If I open the report this registers my queries; but I can’t see the queries from the page refresh; and if I update the cube on the background there is no update in my PBI report.

  100. Leveraging Hybrid Tables to get real-time data updates

    […] DirectQuery (uses no memory for storage but it showers and limits many reporting features) […]

  101. Michael

    “I’ll now duplicate my original flat table 4 times”

    Why is it a duplicate and not a link? (I hope the translation is correct)
    Why for each of these requests to repeat all the previous steps?

    1. Nikola

      Hey Michael,

      Thanks for your comment. You can also use Reference (I guess you thought Reference when you said link), but my preferred choice is almost always Duplicate. Let me explain why:
      Duplicate creates a brand new copy with all the existing steps and a new copy is completely independent of the original query. You can freely make changes in both the original and new query, and they will NOT affect each other. On the other side, Reference is a new copy with one single step: retrieving the data from the original query. If you change the original query, let’s say, remove the column, the new query will not have it anymore.

      1. Michael

        If you use a Reference, then there are problems with the preview.
        When the first table is the main table, you cannot see the columns of the referencing query and accordingly select them for the join. You can only do the opposite, but it makes no sense.
        I hope you understand, I’m not an English speaker)

    2. Michael

      yea, i already figured it out…

  102. Khaled Chowdhury

    I love this!!

  103. Cardinality — Your Power BI Majesty! – Data Science Austria

    […] optimal condition — which means, reduce the data model size whenever possible! This will enable VertiPaq’s Storage Engine to work in a more efficient way when retrieving the data for your […]

  104. Ambaji

    This is excellent. Till now I was in an assumption that Vertipaq plays role in both Import and Direct Query, but with this I got clarity on the Row mode storage and Columnar storage too. Thanks for the best one.

  105. Wale

    This is fantastic. Had no idea you could do that gif thingy.

  106. Bharat K

    Hi Nicola,
    This is wonderful article, I am currently Using SSAS import mode to get 10 million rows of data and it’s super slow. Is there is any suggestion or blogs you have on the site to refer to in order to deal with long time loading queries, for now I have splitted data in multi queries set using SQL LAG , and then appending all table as new query.

    Thank you , Bharat

    1. Nikola

      Hi Bharat,

      It’s hard to answer without knowing more detail. Generally speaking, if you’re facing issues with slow data refresh process, I’d strongly recommend checking Phil Seamark’s blog about visualizing the data refresh process. Then, you can identify which part (or which query) of the process is the bottleneck and check if something can be done to optimize it.

      https://dax.tips/2021/02/15/visualise-your-power-bi-refresh/

      Cheers,
      Nikola

  107. Fernando Calero

    Hi Nikola,
    Great article, thank you. One comment, I see you don’t include the publishing date of your blog post, do you see that better than including it?
    Regards,
    Fernando

    1. Nikola

      Hey Fernando,

      Thanks for your feedback! Actually, the original published date is included on the main page, while I keep the “Updated date” within the article itself (at the bottom), as it sometimes happens that I apply modifications to the article.

  108. Philip Robinson

    Hi Nikola, this article (and all the others in the DP-500 series) is really helpful. Just one question if that’s ok, why is the [factonlinesales] table in direct query mode? Can you end up in a scenario where the data in [factonlinesales] table and [Sales Product Agg] don’t balance as the direct query tables have the latest data and the import tables might not have been refreshed. Thanks Phil

    1. Nikola

      Hi Phil,

      Thanks! For User-defined aggregations in Power BI to work, the detailed table (which is FactOnlineSales in our example) MUST be in DirectQuery storage mode. If you want a “one table fits all” solution, then I’d recommend taking a look at the Hybrid tables feature, which combines DirectQuery and Import within one single table! I wrote about this feature here: https://data-mozart.com/hybrid-tables-in-power-bi-the-ultimate-guide/

      Hope this helps:)

      1. Philip Robinson

        Cheers Nikola!

  109. Sreedhar Vankayala

    I will ask you to add, if it makes sense

    Data Refresh
    – Query Dependencies
    Level of dependencies. I have seen queries with more than 4 levels of depth cause time to refresh
    – Size.
    Most of the time we don’t need all data, but we bring in those needed.

    Data Model
    – Data types
    – Role Playing Date Tables or other Dimensions.
    Note: Date tables are getting internally created if we don’t have date tables and linked to them.
    – Relationships.
    Some unwanted relationships can be deleted.
    Some may need relationships
    – Data formats and default summarize by
    – Hide columns that are not needed (Hide in report view)

    DAX
    – Check the DAX generated using Performance Analyzer. (You placed Stop or Red icon not sure whether you meant to check the queries or ignore it.)
    – Sync slicers
    – Bookmarks

    Visuals
    – Pay attention to number of elements displayer or retrieved

    External Tools
    – ALM Toolkit
    – Model Documenter
    – Dax Studio (You placed Stop or Red icon not sure whether you meant to check the queries or ignore it.)
    – Tabular Editor

    We have lot more to consider. I gave those within your limit of diagram focus and these will enhance by adding to the diagram

    Thanks

    Sreedhar Vankayala

  110. Swayam

    I tried to replicate through Sales & Stores Table . But I don’t get the circular dependency issue at all.

  111. carmen

    Thanks for the detailed explanation Nikola

  112. Ajit

    Great article as always. Thanks Nikola.

  113. DWIJEN BARUAH

    Nice one
    Can you send me the PBIX file?
    When I am trying to put it matrix from two slicers it is not working

  114. Power BI Field Parameters and Slowly Changing Dimensions - SharewarePile.com - Latest Web Hosting News

    […] You can find more info about Power BI field parameters in the official blog post, but also here, here and here. The use case I’m talking about is slowly changing dimensions of Type 2, you know, the […]

  115. Tingting

    Hi, can I still apply for this free bootcamp? Thanks

    1. Nikola

      Hi,
      Unfortunately, the application window for this edition is closed:(

  116. Jessica Jolly

    I have mixed feelings about allowing personalization. I don’t necessarily want to have to answer questions about changes that someone else has made. What are your thoughts about supporting personalizations?

    1. Nikola

      Thanks for your comment, Jessica. Generally, I like them and I think it’s an undervalued feature in Power BI. However, I understand your concerns. In the end, I guess it’s all about educating report consumers on how to use certain features and functionalities:)

  117. Power BI XMLA Endpoints, Demystified | by Nikola Ilic | Jul, 2022 - Techno Blender

    […] there were many “game changers” — features that brought revolution instead of evolution! Composite models, Dataflows, AI-powered visuals, Hybrid tables, Bookmarks…You name […]

  118. Sakasra vadamalai

    First of all thanks for such a wonderful article. Will it suit the same hot and cold concept on databricks source?

  119. Joyce Woo

    Hi Nicola,
    This is wonderful and thanks for sharing. Can I know is it unique dates on ‘Date UTC Agg’ table? How to make this table as ‘Many’ relationship to ‘One’ on DimDate table?

    Regards,

  120. Bob Dobalina

    UNION ALL will return all records, UNION returns a unique set… think you might have the wrong way around

  121. Hristo

    My source SQL query contains a transaction isolation level modifier READ UNCOMMITED. With it, the query does not fold. Without it – it does fold. Do you have an idea why this is the case? I can find some sense in presuming that folding will lift more load off the server than the transaction isolation level modifier but still.

  122. Ani

    Hi
    I have one query.
    I created two partitions on my table hot data partition and cold data partition with import mode and direct query mode respectively. But when I filter the records from Hot data partition, it still hits the direct query. Does it mean that Import query mode is not working at all in this scenario?
    Thanks,
    Ani

    1. Nikola

      Hi Ani,

      Even though you’re retrieving the data from the import mode table, the DirectQuery query will still be generated (even though it should return an empty result set). You can check the exact query in SQL Server Profiler.

  123. A Hidden Little Gem that Can Save Your (Power BI) Life | by Nikola Ilic | Aug, 2022 - Techno Blender

    […] data, reduced the cardinality wherever was feasible, adjusted column data types, and applied some additional recommended practices…And, then, I remembered Benni’s tip and decided to give it a shot and see what happens if I […]

  124. A Hidden Little Gem that Can Save Your (Power BI) Life | by Nikola Ilic | Aug, 2022 – Machine Learning News Hubb

    […] data, reduced the cardinality wherever was feasible, adjusted column data types, and applied some additional recommended practices…And, then, I remembered Benni’s tip and decided to give it a shot and see what happens if I […]

  125. Tamir Basin

    1. Why would a denormalized model be more efficient in terms of storage? I would except the opposite as I have redundant data
    2. Why less joins reduce footprint in memory?

    1. Nikola

      Hi Tamir,

      Good questions!

      1. In the Tabular model, VertiPaq stores compressed data. So, if you don’t have many distinct values in the column (let’s say a column with 50.000 records and 20 distinct values), this column will be highly-compressed and therefore potentially consume way less memory than the relationship between two separate tables (relationships also have memory footprint). Of course, that’s not always the case, but potentially could be.
      2. Please see my answer on 1. Relationships also consume memory in the data model, so getting rid of joins means you are also getting rid of these relationships.

      Hope this helps.

  126. Dritan Skarra

    When you deleted duplicates you deleted them from CTE which is available only in the query.
    Meanwhile duplicates remain in the SpecialOffer table.

    Or maybe you just wanted to demonstrate that we can reference a CTE in a DELETE statement as well.

  127. 3 Steps to troubleshoot any DAX Query | by Nikola Ilic | Sep, 2022 - Techno Blender

    […] two key components of the underlying architecture — Formula engine and Storage engine — in this article, and I strongly encourage you to read it before proceeding further, as it will help you to get a […]

  128. Olivier

    Hi Nikola,
    Thank you for your work, and all your articles. They are very clear and helpful.
    My question is close to the previous one.
    We always discuss Aggregation with both import and DQ tables. Is there any sens doing it with only import tables to reduce the granularity scanned on most measures but still being able to deep dive, while avoid multiple switch measure checking with table should be queried.

    1. Nikola

      Hi Olivier,
      That’s a fair question. However, user-defined aggregations in Power BI work ONLY and only if the main table (fact table) is in DQ mode. Hope this helps.
      Cheers,
      Nikola

  129. Eirik Maalen Andersen

    Hi Nikola, I have an issue with Power Apps visual refreshing when I navigate between different report pages. Do you think this will potenitally fix this issue? I want the Power Apps visual not to start the app over and over again…

    Thanks! Eirik

Comments are closed.