Working with Pyspark & it's Optimizations
2 Scenarios
1 Hour 10 Minutes
Intermediate
Industry
e-commerce
Skills
data-wrangling
approach
problem-understanding
performance-tuning
data-storage
Tools
databricks
spark
Learning Objectives
Apply performance tuning strategies to improve job execution time
Overview
This practice set covers PySpark fundamentals and advanced optimization techniques
Prerequisites
- Basic knowledge of Python & Spark