Latest Power BI and AI articles from RADACAD team
In this Video I tried to gather some information about Dog Breeds from different 3 websites : http://www.mans-best-friend.org.uk/dog-breeds-alphabetical-list.htm http://www.dogbreedslist.info/ https://en.wikipedia.org/wiki/List_of_dog_breeds I have explained how to get data from these websites even they don’t provide any API.
It is a honor for me that I’ve been selected to speak in SQL PASS Summit 2015. SQL PASS Summit is the largest SQL Server conference and event in the world. Last year about 6ooo people from more than 55 countries attended this great event. I’ve been honored previously to speak in this great conference Read more about I’ll Speak in SQL PASS Summit 2015; 3 Years in a row[…]
SQL Server Integration Services is not a new technology, this technology is a mature data transfer and data consolidation tool which has been in the market since 2005. Prior than that SSIS had another name; DTS. However SSIS nowadays is capable of doing far more than what DTS had to offer.
You can transfer data from any source to any destination, you can upload or download files, you can set priority on execution of tasks, you can call third party applications or command lines, you can get part of the data from Web Service, you can zip or unzip result set, change structure of the result set and load it wherever you want.
SQL Server 2016 CTP 2 released almost a day ago, and I’ve had a chance to install it and play with Master Data Services to see what changes has been made in this product. Master Data Services is a service of SQL Server first released in SQL Server 2008R2, and enhanced in SQL Server 2012. There was no changes in MDS of SQL Server 2014. But fortunately MDS wheels are spinning now, there are some changes in 2016. Changes are not major though they are evidence of Microsoft investing on this services nowadays.
Predictions always matter; it is always nice to find a pattern in existing data. It will help to have a more accurate decision-making. These days, I am busy with designing and implementing a prototype for tourist recommendation system. I need to use variety of data mining algorithm such as “clustering” “Decision Tree”, “Regression”, “Neural Network”. All of these algorithms accept inputs with different data types. These inputs are the main factors that will affect the predictions.
Incremental Load is always a big challenge in Data Warehouse and ETL implementation. In enterprise world you face millions, billions and even more of records in fact tables. It won’t be a practical practice to load those records every night, as it would have many downsides such as;
So what would be the solution? Solution is Incremental Load approach. In this approach data will be loaded partially, preferably only part of the data that has been changed. A change set will be much smaller than the total amount of data. As an example in a 200 million records fact table which stored data for 10 years, only 10% percent of that data might be related to the current year and changes frequently, so you won’t usually required to re-load the rest 180 million records.
It has been long time passed from my presentation in Hong Kong TechDays 2015 on Mid February, I’ve been really busy so far and hadn’t chance to upload my presentation files here. I would like to thank all audience of my session on Azure Data Factory vs. SSIS, and provide you the link to my presentation slides. In this session you will see comparison between SSIS and Azure Data Factory on different factors such as developments, features, deployments, user experience, environment, and etc. For each comparison factor you will see a table comparison of these two products and their pros and cons for different situation.
there is a first experience with DMX I employed DMX in my .NET code last year to create a travel mining model for predictions travel budget, length of travel, destination. I need to predict via different algorithms. so I have added a reference to Microsoft.AnalysisServices.AdomdClient to my C# project using Microsoft.AnalysisServices.AdomdClient; public AdomdConnection connection = Read more about DMX practice for Tourist Recommendation System[…]
CodeCamp Christchurch 2015- SQL and BI I attended the CodeCamp Christchurch 2015 16th May. It was a great event. there are very nice presentation by Martin, Warwick, Simon and Nick . there were plenty of nice sessions. I really enjoyed the power bi preview present by Simon. my session started at 3.30 pm, Read more about CodeCamp Christchurch 2015- SQL and BI[…]
Codecamp Christchurch 2015 ran today on Christchurch Poly-technique of Technology. I’ve joined the even in last minutes when the agenda was full set, so I only joined as audience. There was a really good turnout for the codecamp about 200 registered. Three streams ran on Software Development, SQL/BI, and SharePoint. 5 sessions in each stream. In total it was a good event, I had a chance to meet some friends and SQL Community down in Christchurch. Here is my highlights of the event.