Before we understand the difference between Coalesce and Repartition we first need to understand what Spark Partition is.Simply put Partitioning data means to divide the […]
Blogs
Hive Table Creation
In Previous chapter we learned about HIVE DATA TYPES and today lets check out HIVE TABLE CREATION. In HIVE there are two kinds of tables , […]
Spark – Create Dataframe From List
One can create dataframe from List or Seq using the toDF() functions. To use toDF() we need to import spark.implicits._ Here the column names are […]