Skip to content
UPEEC

Apache Spark and PySpark

Distributed processing of very large datasets with a DataFrame API.

Intermediate
Comments 0
from pyspark.sql import SparkSession
spark = SparkSession.builder.getOrCreate()
spark.read.parquet("s3://bucket/logs").groupBy("device").avg("temp").show()

Spotted a mistake or want to add detail? Suggest an improvement — Content Contributors' edits are reviewed by editors before they go live.

Discussion (0)

Sign in or join free to ask questions and discuss this topic.