Few weeks ago, I’ve written how REST API can be used for real-time dashboard in Power BI. Another method for real-time dashboard is using Azure Stream Analytics. This can be combined with Azure IOT and Event Hub to get data from IOT devices. In this post I’ll explain to you all steps necessary to push Read more about Stream Analytics and Power BI Join Forces to Real-time Dashboard[…]
Power BI and Power Query can connect to files such as Excel, CSV, text files and on-premises databases such as SQL Server, Oracle, MySQL. Power BI can connect to many data sources on cloud such as Azure SQL Database, Azure SQL Data Warehouse and etc. In this part you will learn how to connect from Read more about Power BI Get Data: From Azure SQL Database[…]
Azure Data Factory has been released as general availability 10 days ago. There has been also an extension for Visual Studio published a little earlier for Data Factory. The good news is that now you can create Azure Data Factory projects from Visual Studio. This is a great step forward in development of Data Factory Read more about Azure Data Factory Templates for Visual Studio[…]
With the announcement of Power BI a week ago and with great features in this product, there are many opportunities that this product and service can be used. Power BI can be used alongside some other Azure services, and even On-Premises services to build an end-to-end enterprise BI and Data Analysis Solution. In this post I’ll just explain one example scenario of Hybrid and End-to-End BI solution that uses below technologies;
It is a honor for me that I’ve been selected to speak in Microsoft Ignite New Zealand 2015. Microsoft Ignite New Zealand 2015 (TechED) is an annual conference for developers and IT professionals put on by Microsoft. It is held in several locations around the world. and it’s the biggest annual technology event in New Zealand. This conference gives Read more about I’ll Speak in Microsoft Ignite (TechED) New Zealand 2015; First time[…]
Thrilling news of public preview availability of Azure Data Catalog spread the word from Joseph Sirosh’s blog post yesterday; Azure Data Catalog will be available for public preview this Monday 13th of July. This is great step forward for using metadata alongside tools for extracting and visualization of the data. I would like to share my thoughts about what is a data catalog and what to expect from it on Monday.
What is Data Catalog; Data Catalog contains metadata related to the data source, metadata can contains tags, comments, descriptions, annotations…. about data source, tables, views, indexes, and all other objects in the data source. Most of you worked with databases (readers of my blog are database pros usually 😉 ). In all database environments there are two sides; business and IT (or let’s say owner, producers, or consumers of the database technology). Business usually understand concepts, while IT understand database structure. Metadata stored in a data catalog is the connection between these two.
Many organizations nowadays are in transition from on-premises to cloud, and many of them use hybrid solutions where part of the computing will be done in cloud and the rest on-premises. The trend nowadays is to use cloud to have better maintenance, lower costs, more reliable solutions, lower administrative efforts, and powerful shared resources. In BI world there is a high demand for solutions to be on cloud, some computing services such as data transfer and ETL to be done on cloud, some data analysis and mining solutions happens on cloud, and even data to be stored on cloud data warehouse at some stage. There are many BI vendors in the market, but there are few who provide BI on the cloud.
Many of you worked with SSIS and are familiar with term of ETL. Azure Data Factory is Microsoft Cloud based ETL technology, which has ability to work with large volume of data, working with data sources such as SQL Server on premises, SQL Server Azure, or Azure Blob storage. Data can be transformed with Azure Read more about Introduction to Azure Data Factory[…]
Today I’ve faced an issue; when the Power BI Admin Center does not work I want to configure and set up Data Management Gateway. Data Management Gateways is a service that install on your machine or any on premises server, and allow cloud services (such as Power BI or Azure Data Factory) to connect to Read more about Configure Data Management Gateway from Azure Portal[…]