TechDays Hong Kong 2014 is under way, It would be 11-13 of March 2014. and I am glad that I’ll present four sessions in this conference. Sessions are: Advanced Data Transformations with Power Query Deeper Data Insight and Prediction with Data Mining ETL Architecture for Solving Data Warehouse Challenges Power BI Data Visualization with Power Read more about TechDays Hong Kong 2014; My Speaking Engagements[…]
In previous posts I’ve mentioned that Power Query is a self-service ETL tool. One of the most fundamental functions of an ETL tool is ability to schedule ETL run. In the other words you would require to populate data from operational data stores on a schedule basis to feed into your Data Model. Power Query Read more about Scheduling Power Query ETL Runs[…]
In previous post I’ve generated a date dimension with Power Query M script. In this post I will add public holidays to the date dimension from live websites. This post only considers New Zealand public holidays, but once you’ve learned how to deal with data, you can apply similar transformations with small changes to any Read more about Data Dimension in Power Query – Public Holidays Fetched Live[…]
There are many date dimensions scripts on the internet, and even there are some scripts for the Power Query (Thanks to Chris Webb for his very early version of the date dimension, and also to Matt Masson for his version of Date Dimension). I’ve built a date dimension from scratch (not a copy or Read more about Script to Generate Date Dimension with Power Query M – With Financial Columns[…]
One of the most powerful features of M is that you can write custom functions to re-use part of your code. Custom functions can be single or multiple liner, they will be written in Lambda style syntax. In this post you will learn how to write functions and invoke them in M. Custom functions and Read more about Writing Custom Functions in Power Query M[…]
Yesterday I’ve found a very awesome feature in Power Query (Thanks to Matt Masson). The feature is: you can see list of all functions in the Power Query with enumerations and option types with a keyword. I’m personally coming from a developer background, so that option for me looks like the Object Explorer in Visual Read more about How to Get List of All Functions and Invoke Them in Power Query[…]
In previous post you’ve learned about Formula language of the Power Query known as "M". you’ve learned that M is a functional language that apply data transformations through script. In examples of previous post you’ve learned some of table functions such as Table.AddColumn, Table.Sort, Table.Join, and Table.PrefixColumns. In this post we will discover more table Read more about Power Query Formula Language M : Table Functions Part 1[…]
In previous post, I described what is Power Query, and how we can use that for self service ETL. You’ve how to work with Power Query menus and connect to different data sources, and apply multiple transformations on the data. In this post I’ll go one step closer to the core of Power Query Formula Read more about Power Query Formula Language: M[…]