Presentation Materials: TechDays Hong Kong 2014, ETL Architecture for Solving Data Warehouse Challenges

Thanks to all attendees of my session in TechDays 2014 Hong Kong about ETL Architecture for Solving Data Warehouse Challenges. Here is session Title, Description, and presentation file; Title: ETL Architecture for Solving Data Warehouse Challenges Description: Data Warehouses are heavily in use nowadays in most of businesses around the world. Data Warehousing brings higher Read more about Presentation Materials: TechDays Hong Kong 2014, ETL Architecture for Solving Data Warehouse Challenges[…]

Data Dimension in Power Query – Public Holidays Fetched Live

In previous post I’ve generated a date dimension with Power Query M script. In this post I will add public holidays to the date dimension from live websites. This post only considers New Zealand public holidays, but once you’ve learned how to deal with data, you can apply similar transformations with small changes to any Read more about Data Dimension in Power Query – Public Holidays Fetched Live[…]

Script to Generate and Populate Date Dimension Version 2: Adding Multiple Financial Years

Almost a year ago I published first version of T-SQL script to generate and populate a general purpose date dimension here. Today I want to publish the second version of that date dimension which has some corrections (fiscal calendar calculation fixed), and additional attributes (such as current year, current month, and current day) Multiple countries Read more about Script to Generate and Populate Date Dimension Version 2: Adding Multiple Financial Years[…]

Insert, Update, and Delete Destination table with SSIS

Previously I’ve wrote about design and implementation an UPSERT with SSIS. UPSERT is about Update existing records, and Insert new records. Today I want to extend this to cover DELETED records as well. So method used in this post can be used to find INSERTED / UPDATED / DELETED records from the source table and Read more about Insert, Update, and Delete Destination table with SSIS[…]

Speaking about Inferred Dimension Members with SSIS and MDS: Charlotte SQL Saturday

Hi folks, I proud to announce that I will speak in the SQL Saturday #237 Charlotte BI Edition Which will run in 19th of October 2013 in Charlotte, North Carolina  In this session I will speak on one of my favorite topics which is Design and implementation architecture for Inferred Dimension Members with SSIS and Read more about Speaking about Inferred Dimension Members with SSIS and MDS: Charlotte SQL Saturday[…]

Script for Creating and Generating members for Date Dimensions: General Purpose

Date Dimension can be found in every Data Warehouse, because Date dimension is one of the most important factors of each operational system that users like to view reports based on date dimension. So the importance and requirement to a date dimension persuade me to write a t-sql script to generate records for date dimension. Read more about Script for Creating and Generating members for Date Dimensions: General Purpose[…]

SSIS Upsert With Lookup Transform

This is a very common question everywhere; how can I check if data is exists in destination table then update it, otherwise insert new records. This Scenario named Upsert in common ( Update / Insert ), there are lots of ways to do it, but in this post I’ll describe how to do it with Read more about SSIS Upsert With Lookup Transform[…]