PySpark

PySpark is a Python API for Apache Spark, a fast and distributed data processing engine for big data analytics and machine learning applications. Readers can learn about a high-level interface for interacting with Spark's distributed datasets (RDDs) and structured data processing APIs.

Comprehensive roadmap for pyspark

By roadmap.sh