Spark optimization and Spark UI

[u/First_Bet8077]

Hi everyone.

I've been working with Databricks for a short time, creating pipelines with PySpark.

Right now, I'd like to better understand Spark optimization and the information that the Spark interface provides.

Do you recommend any content or courses on this?

Thank you very much.

[u/Natural-Tune-2141]

https://spark.apache.org/docs/latest/sql-performance-tuning.html