In previous posts (part 1 and part 2), I have explained the process of data live streaming. In the first post, I have explained the process of setting up the Raspberry PI 3 and Weather station. In the second one, I have explained the process of setting up the Event Hub that helps us to. In Read more about Live Streaming Weather Station with Cortana Analytics – Part 3[…]
Few weeks ago, I’ve written how REST API can be used for real-time dashboard in Power BI. Another method for real-time dashboard is using Azure Stream Analytics. This can be combined with Azure IOT and Event Hub to get data from IOT devices. In this post I’ll explain to you all steps necessary to push Read more about Stream Analytics and Power BI Join Forces to Real-time Dashboard[…]
With the announcement of Power BI a week ago and with great features in this product, there are many opportunities that this product and service can be used. Power BI can be used alongside some other Azure services, and even On-Premises services to build an end-to-end enterprise BI and Data Analysis Solution. In this post I’ll just explain one example scenario of Hybrid and End-to-End BI solution that uses below technologies;
Data Sources On-Premises
Azure Data Factory or SSIS with Azure Pack for Data extraction and transformation
Azure SQL Database or Azure SQL Data Warehouse as the database / data warehouse engine in cloud
Thrilling news of public preview availability of Azure Data Catalog spread the word from Joseph Sirosh’s blog post yesterday; Azure Data Catalog will be available for public preview this Monday 13th of July. This is great step forward for using metadata alongside tools for extracting and visualization of the data. I would like to share my thoughts about what is a data catalog and what to expect from it on Monday.
What is Data Catalog; Data Catalog contains metadata related to the data source, metadata can contains tags, comments, descriptions, annotations…. about data source, tables, views, indexes, and all other objects in the data source. Most of you worked with databases (readers of my blog are database pros usually 😉 ). In all database environments there are two sides; business and IT (or let’s say owner, producers, or consumers of the database technology). Business usually understand concepts, while IT understand database structure. Metadata stored in a data catalog is the connection between these two.