Spark and Scala Training

1 vote, average: 5.00 out of 51 vote, average: 5.00 out of 51 vote, average: 5.00 out of 51 vote, average: 5.00 out of 51 vote, average: 5.00 out of 5
Please Log in or register to rate

Spark and Scala Training


The Apache Spark and Scala training teaches: Scala basics; The fundamentals of Spark architecture, installation, configuration, administration and tools; and Advanced Scala topics.

This course designed for Java software engineers who want a deep dive into Scala and Spark. The course scope may be adjusted (32-48 hours) based on clients need, based on its actual implementation and usage.


Previous knowledge:
Database management and Java Programming

5 virtual machines per student w/ small configuration (1 CPU, 4GB RAM, 500GB disk)

Each day will include a theoretic discussion as well as hands on training. Complementary exercises will be given to participants

Course Topics

Day 1+2: Scala Rampup

Scala REPL
Functions and Transformations
Objects and Traits
Option Type
Collections and functional programming
Pattern Matching
Libraries and RESTful APIs

Day 3+4: Spark for Scala

Scala Collections and Spark API foundations
Spark Setup Locally
Big Data cluster
Resilient Distributed Datasets (RDDs)
Key-Value Pairs and Map/Reduce the Spark way
Functions, Transformations, and Actions
RDD Persistence
Testing Scala Spark programs
Loading and cleaning data
Data summaries and reporting
Introduction to Spark SQL
Introduction to algorithms with MLLib and GraphX
Introduction to BlinkDB, Tachyon, and the rest of Berkeley Stack

Optional Day 5+6: Advanced Scala

When to use Mutable State
Type Parameterization, Co and Contra Variance, Upper and Lower Bounds
Abstract Members in Depth
Implicit Conversions and Parameters
Type-classes / Context Bounds
Implementing Types
Going Further with Akka
Modular Programming, Cake and Parfait
Object Equality, the Gory Details
Workflows and Monads
Scala Idioms and Best Practices
Domain Specific Languages
Design Patterns for Scala
Tail Recursion, Trampolines

© Copyright - Skilit - Site by Dweb