Wednesday, May 10, 2017

How to setup a Real-Time data analyze using Azure Stream Analytics and PowerBI

These days’ demand is high for Real-Time data analytics and can easily implement the system using cloud technologies. Real-time analytics is the use of, or the capacity to use, data and related resources as soon as the data enters the system.
Few well-known applications of real-time analytics:
  • Real-time credit card fraud detection  
  • CRM real-time analytics can provide up-to-the-minute information about an enterprise's customers and present it so that better and quicker business decisions.
  • Traffic detection
  • Wind speed
In this post, using a real-time feed from Twitter and Azure Cloud technologies.
You can find Azure Event Hub and Azure Stream Analytics under Internet Of Things marketplace category.
Step1: Create an Azure Event Hubs
Azure Event Hubs is a highly scalable publish-subscribe service that can invest millions of events per second and stream them into multiple applications. This lets you process and analyses the massive amounts of data produced by your connected devices and applications.
Use Event Hubs to:
  • Log millions of events per second in near real time.
  • Connect devices using flexible authorization and throttling.
  • Use time-based event buffering.
  • Get a managed service with elastic scale.
  • Reach a broad set of platforms using native client libraries.
  • Pluggable adapters for other cloud services.
Step2: Create Azure Stream Analytics
Azure Stream Analytics is a fully managed, cost-effective real-time event processing engine that helps to unlock deep insights from data. Stream Analytics makes it easy to set up real-time analytic computations on data streaming from devices, sensors, websites, social media, applications, infrastructure systems, and more.
With a few clicks in the Azure portal, you can author a Stream Analytics job specifying the input source of the streaming data, the output sink for the results of your job, and a data transformation expressed in a SQL-like language. You can monitor and adjust the scale/speed of your job in the Azure portal to scale from a few kilobytes to a gigabyte or more of events processed per second.
Stream Analytics leverages years of Microsoft Research work in developing highly tuned streaming engines for time-sensitive processing, as well as language integrations for intuitive specifications of such.
In this case Power BI used as stored data.

Used query:
SELECT Topic,count(*) AS Count, Avg(SentimentScore) AS AvgSentiment, System.Timestamp AS Insert_Time
FROM [tweets-input] TIMESTAMP BY CreatedAt
GROUP BY TumblingWindow(second,5), Topic
Step3: Feed real-time data to Event Hub
In this case, Twitter WPF Client used as real-time data feeder. To use this, you should create a twitter app and access token key for that.
You can create apps https://apps.twitter.com
Step4: Crete a Dashboard using real-time data
Once you start your Azure Stream Analytics, you will find data source will be available in Powerbi.com

Cheers!
Uma

Wednesday, May 3, 2017

How to setup an Azure Analysis Services and connect via Power BI

Azure Analysis service is available now for business and users can connect to the SSAS Tabular model using analytical tools such as Power BI, Excel etc.
  • Model and shape virtually any data of any size
  • Provide secured access, anytime from virtually anywhere
  • Visualize your data using your favorite data visualization tool
  • Get started quickly without the need to manage infrastructure
  • Scale resources to match your business needs
  • Govern, deploy, test and deliver your BI solution with confidence
Currently available pricing tiers:
Step1: Create Azure Analysis Service
Step2: Create an Azure SQL DB
Step3: Connect Azure Analysis Service using Visual Studio
Step4: Select Databases/SQL Server Analysis Services and then connect
Cheers! Uma