Part 4 – Live Streaming Weather Station with Cortana Analytics (Online Data Analytics with Azure ML)

Facebooktwittergoogle_plusredditpinterestlinkedintumblrmailFacebooktwittergoogle_plusredditpinterestlinkedintumblrmail

In previous posts, I have showed the process of creating a live weather data streaming with Cortana.

iotprocess

In Part 1 the process of setting up Raspberry PI3 and weather station sensor has been explained. Following, in Part 2, the process of setting up the Event Hub as a median to digest the data from Raspberry PI has been explained. The collected data has been send to the Stream Analytics for aim of streaming data to Power BI and Azure ML. The process of setting up Stream Analytics and how to show data in Power BI has been explained in Part 3.

There is a possibility to pass data to Azure Ml and do a live data Analytics for example classify the collected data into different Cluster. In this post I will show just the process sending data from Stream Analytics to Azure Ml and how call a predefined Azure ML web service. However, I am not going to show how to create a web service in Azure Ml but, in next series I will talk completely about Azure ML, Machine Learning, creating Web service and so on.

part4-first

For sending data to Azure ML web service we need some information such as web service url and key. In Azure Ml after you creating the web service (I will explained this in next series), Azure provided you a URL and key . So first log in to your Azure Ml account, then go to web services section, and choose specific web service. I created a web service that get the temperature of weather and cluster it to identify this measurement is related to which cluster. this will help to see the temperature data trend and classify the temperature data.

part4-azureml

then by clicking on then specific web service, in our case “weather azure”, you will access the created API (Web Service) Specifications. copy the API key. then click on the request and response (number 2)to fetch the API URL

part4-azureml2

by clicking on the “Request/Response” (number 2) you will see the an API documentation. In API documentation, you will see the “Post” url.

part4-url

After copying the post url and key, now we are going to call this API with these specifications. In “Stream Analytics” specifications, click on the “Function” option. then click on the “Add” menu (see below picture)
part4-azure1

by clicking on the “Add” function, you will see the below window. here in function alias, specify a name for function. then in “Function type” select ” Azure ML”. Then specify the subscription and put the web service API (you already fetch from Azure Ml website) also the API key, you should put it in “Key” place. then click on “Create” option to set up the web service.

part4-5

by creating web service, you will see the web service specifications (number 1). as you see in below image, the created function accept one parameter (temperature), the out put is a record as it send the temperature and the Azure ML cluster number.

part4-azure

In the next step, we want to write a query to get data from Azure Event Hub and pass it to the Azure ML, the out put for Azure ML result can be shown in Power BI dashboard.

finally by clicking on the query we will see below windows. we should specify the output and input here.

the process of creating input and out put have been explained briefly in Part 3. here we get data from “event Hub” as input “iotevent” then we want to put the result of Azure ML in Power BI visualization dashboard.

hence in the query, we first fetch data from azure ml function by

as you can see the “value” is input for our function and is one of the columns of data collected from Event Hub. Value has the measure for weather specifications such as temperature, humidity and so forth. so we pass the value input from event hub to Azure ML web service and created function in Stream analytics.

then we want to show the result of azure ML (which in this case is cluster number) into power bi dashboard, hence in select we have original value and the cluster number and we put the result into “powerbiazure”

moreover, the only value that we want to pass to the Azure ML API is temperature so we exclude the others.

by “Starting” the Stream Analytics, the dataset in power bi is created and the result of azure Ml clustering will be shown .

part4-poert

This Series with four parts is now finished.

In next series I will start to talk about Azure ML environment, the upcoming series can contain of 6 or 7 parts that I will explain the Azure ML environment, algorithms, how to create models, evaluate model and enhance models in Azure ML, Azure ML components, API and so forth.

Save

Facebooktwittergoogle_plusredditpinterestlinkedintumblrmailFacebooktwittergoogle_plusredditpinterestlinkedintumblrmail
rssyoutuberssyoutube
Leila Etaati
Dr. Leila Etaati is Principal Data Scientist, BI Consultant, and Speaker. She has over 10 years’ experience working with databases and software systems. She was involved in many large-scale projects for big sized companies. Leila has PhD of Information System department, University of Auckland, MS and BS in computer science. Leila is Microsoft Data Platform MVP.

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code class="" title="" data-url=""> <del datetime=""> <em> <i> <q cite=""> <strike> <strong> <pre class="" title="" data-url=""> <span class="" title="" data-url="">