How to See Record Count Per Partition in a Spark DataFrame (i.e. Find Skew) | by Landon Robinson | Hadoopsters
How to See Record Count Per Partition in a Spark DataFrame (i.e. Find Skew) | by Landon Robinson | Hadoopsters
![scala - How to check the number of partitions of a Spark DataFrame without incurring the cost of .rdd - Stack Overflow scala - How to check the number of partitions of a Spark DataFrame without incurring the cost of .rdd - Stack Overflow](https://i.stack.imgur.com/iwYnm.png)
scala - How to check the number of partitions of a Spark DataFrame without incurring the cost of .rdd - Stack Overflow
![4. Spark SQL and DataFrames: Introduction to Built-in Data Sources - Learning Spark, 2nd Edition [Book] 4. Spark SQL and DataFrames: Introduction to Built-in Data Sources - Learning Spark, 2nd Edition [Book]](https://www.oreilly.com/api/v2/epubs/9781492050032/files/assets/lesp_0401.png)