آموزش Apache Spark با Java - یادگیری Spark از Big Data Guru

Learn to analyze large data sets with Apache Spark by 10+ hands-on examples. Take your big data skills to the next level.
This course covers all the fundamentals of Apache Spark with Java and teaches you everything you need to know about developing Spark applications with Java. At the end of this course, you will have gained an in-depth knowledge pf Apache Spark, general big data analysis and manipulations skills. With these new skills you'll be able to help your company to adapt Apache Spark for building a big data processing pipeline and data analytics applications. This course covers 10+ hands-on big data examples. You will learn valuable knowledge on how to frame data analysis problems as Spark problems. Together we will learn examples such as aggregating NASA Apache web logs from different sources; we will explore the price trend by looking at the real estate data in California; we will write Spark applications to find out the median salary of developers in different countries through the Stack Overflow survey data; we will develop a system to analyze how maker spaces are distributed across different regions in the United Kingdom, and much more.
Style and Approach
This course is very hands-on, James has put in lots of effort to provide you with not only the theory but also real-life examples of developing Spark applications that you can try out on your own laptop.
Released: Monday, April 9, 2018
Get Started with Apache Spark
The Course Overview
Introduction to Spark
Install Java and Git
Set up Spark project with IntelliJ IDEA
Set up Spark project with Eclipse
Run our first Spark job
RDD
RDD Basics
Create RDDs
Map and Filter Transformation
Solution to Airports by Latitude Problem
FlatMap Transformation
Set Operation
Actions
Solution to Sum of Numbers Problem
Important Aspects about RDD
Summary of RDD Operations
Caching and Persistence
Spark Architecture and Components
Spark Architecture
Spark Components
Pair RDD
Introduction to Pair RDD
Create Pair RDDs
Filter and MapValue Transformations on Pair RDD
Reduce By Key Aggregation
Sample solution for the Average House problem
Group by Key Transformation
Sort by Key Transformation
Sample Solution for the Sorted Word Count Problem
Data Partitioning
Join Operations
Advanced Spark Topic
Accumulators
Solution to StackOverflow Survey Follow-up Problem
Broadcast Variables
Spark SQL
Introduction to Spark SQL
Spark SQL in Action
Spark SQL practice: House Price Problem
Spark SQL Joins
Strongly Typed Dataset
Use Dataset or RDD
Dataset and RDD Conversion
Performance Tuning of Spark SQL
Running Spark in a Cluster
Introduction to Running Spark in a Cluster
Package Spark Application and Use spark-submit
Run Spark Application on Amazon EMR (Elastic MapReduce) cluster