تبلیغات

آموزش Big Data با Spark Streaming و Scala 

دسته بندی ها: آموزش آپاچی اسپارک (Apache Spark) ، پایگاه داده ، آموزش های Packtpub ، آموزش اسکالا (Scala) ، کلان داده (Big Data)

packtpub-taming-big-data-with-spark-streaming-and-scala-hands-on-video

آیا این نوشته را دوست داشتید؟
Taming Big Data with Spark Streaming and Scala - Hands On! [Video] Publisher:Packtpub Author:Frank Kane Duration:5 hours 54 minutes

Process large amounts of data in real time using Spark Streaming
Businesses these days require constant, real-time analysis of large amounts of data, along with meaningful insights which influence business decisions. Apache Spark has emerged as the most popular tool in the Big Data market for efficient real-time analytics of Big Data. Spanning over 5 hours, this course will teach you the basics of Apache Spark and how to use Spark Streaming - a module of Apache Spark which involves handling and processing of Big Data on a real-time basis. You will learn how to create Spark applications with Scala to process streams of real-time data. Whether you want to analyze continuously incoming website traffic, analyze real-time streams of Twitter feeds or query your streaming data in real time, this course has got you covered. You will also learn how to use the MLlib module of Spark to train machine learning models with streaming data, and use those models to make real-time predictions. The course assumes some programming experience, and uses Scala to develop Spark applications. It includes a crash course in the Scala programming language in case you're new to it.
Released: Monday, September 26, 2016

Getting Started
Introduction and Getting Set Up
Stream Live Tweets with Spark Streaming!

A Crash Course in Scala
Scala Basics – Part 1
Scala Basics – Part 2
Flow Control in Scala
Functions in Scala
Data Structures in Scala

Spark Streaming Concepts
Introduction to Spark
The Resilient Distributed Dataset (RDD)
RDDs in Action – Simple Word Count Application
Introduction to Spark Streaming
Revisiting the PrintTweets Application
Windowing – Aggregating Data over Longer Time Spans
Fault Tolerance in Spark Streaming

Spark Streaming Examples with Twitter
Saving Tweets to Disk
Tracking the Average Tweet Length
Tracking the Most Popular Hashtags

Spark Streaming Examples with Clickstream / Apache Access Log Data
Tracking the Top URLs Requested
Alarming on Log Errors
Integrating Spark Streaming with Spark SQL
Intro to Structured Streaming in Spark 2
Analyzing Apache Log files with Structured Streaming

Integrating with Other Systems
Integrating with Apache Kafka
Integrating with Apache Flume
Integrating with Amazon Kinesis
Writing Custom Data Receivers
Integrating with Cassandra

Advanced Spark Streaming Examples
Stateful Information in Spark Streams
Streaming K-Means Clustering
Streaming Linear Regression

Spark Streaming in Production
Running with spark-submit
Packaging Your Code with SBT
Running on a Real Hadoop Cluster with EMR
Troubleshooting and Tuning Spark Jobs

You Made It!
Learning More

پیشنهاد فرادرس