neocoder

Spark SQL/DataFrames

Home Training Library Big Data Spark SQL/DataFrames

We've everything to build a perfect L&D program

700+
Learning Topics
120+
Video Content
100+
Coding Exercises
300+
Quiz
450+
Skill Assessment
100+
Hands-on Projects

Topics Covered

Spark SQL/DataFrames
Spark SQL
  • Introduction to Spark SQL
  • Download and Installation
  • Introduction to DataSets
  • Introduction to DataFrames
  • Entry point: SparkSession
  • Creating DataFrames
  • RDB
  • List Operation
  • Working with RDDs
  • Tranformation
  • Using DataFrame aggregate functions
  • Bucketing
  • Sorting and Partitioning
  • Working with JSON Datasets
  • Creating Project
  • Creating DataSets
Spark SQL/DataFrames
Spark/Kafka Streaming
  • Introduction to Streaming
  • Introduction to Kafka
  • Kafka Fundamentals
  • Topics/Brokers/Consumer/Producer
  • Apache Kafka architecture
  • Pub-Sub messaging
  • Creating a Kafka topic
  • Retrieve list of topics
  • Create producer and consumer
  • Send messages from Producer
  • Producer API
  • Introduction to Spark Streaming
  • Spark engine
  • Sending data stream from Kafka to Spark
  • Processing data stream using Spark streaming
Spark SQL/DataFrames
Spark SQL
  • Introduction to Spark SQL
  • Download and Installation
  • Introduction to DataSets
  • Introduction to DataFrames
  • Entry point: SparkSession
  • Creating DataFrames
  • RDB
  • List Operation
  • Working with RDDs
  • Tranformation
  • Using DataFrame aggregate functions
  • Bucketing
  • Sorting and Partitioning
  • Working with JSON Datasets
  • Creating Project
  • Creating DataSets
Spark SQL/DataFrames
Spark/Kafka Streaming
  • Introduction to Streaming
  • Introduction to Kafka
  • Kafka Fundamentals
  • Topics/Brokers/Consumer/Producer
  • Apache Kafka architecture
  • Pub-Sub messaging
  • Creating a Kafka topic
  • Retrieve list of topics
  • Create producer and consumer
  • Send messages from Producer
  • Producer API
  • Introduction to Spark Streaming
  • Spark engine
  • Sending data stream from Kafka to Spark
  • Processing data stream using Spark streaming

Tailor the curriculum for your tech team with customizable skill modules

Yes, L&D professionals can handpick the skill modules of their choice from our huge repository to design the perfect skill development program for their tech team and drive greater ROIs.

Contact us for a Demo +91 - 93429 07576

Why neoCoder's skill
modules are the finest?

Content structured to different learning level

Organizations commit a huge mistake in the employee L&D programs by providing the same learning content for both entry-level freshers and experienced professionals.

Organizations commit a huge mistake in the employee L&D programs by providing the same learning content for both entry-level freshers and experienced professionals.

  • Noob
  • Beginner
  • Intermediate
  • Advanced
  • Master

 

Diverse
assessment options

In a world of continuous technological advancement, the learning materials should be fresh and updated.

Our skill modules are constantly updated with respect to the changes in the tech universe. Hence your employees stay on track with the latest tools and technologies used in the industry.

Diverse
assessment options

Our powerful AI-powered engine helps you to assess your employee’s potential at once. With the aid of the auto-evaluation feature, the following diverse assessment modules are evaluated at a rapid rate, thereby saving an enormous time.

  • Quiz
  • Skill assessments
  • Coding Exercises
  • Hands-on projects

Accelerate your upskilling program with NeoCoder

Scroll to Top