Showing posts with label Azure Databricks. Show all posts
Showing posts with label Azure Databricks. Show all posts

Wednesday, March 10, 2021

Creating Azure Databricks workspace and explore

Azure Databricks is a data analytics platform optimized for the Microsoft Azure cloud services platform. Azure Databricks offers three environments for developing data intensive applications: Databricks SQL, Databricks Data Science & Engineering, and Databricks Machine Learning.

You are redirected to the Azure Databricks portal.


You can format it

Click on present the workbook

Cheers!
Uma

Monday, May 4, 2020

Wine Quality data analytics using Databricks

Data can be downloaded from here

https://archive.ics.uci.edu/ml/datasets/wine+quality

In the preview data, use “First row is header” to identify the column name & “ Infer Schema” to automatically identify the data types.


The table will be created in Default database

Let’s crate a new database and load data into the table

Create a SQL Notebook and Import that downloaded data.


Some sample useful SQL commands

You can change to plot view

Using Python Notebook

Create a data frame and load the data from the table

Some common useful Python commands


Save the results as another table

Cleaning Data

Handling NULL value


Remove extreme values or outliers

Machine Learning

Create multiple charts and dashboards



Cheers!
Uma