How to save Spark dataframe as dynamic partitioned table in Hive

Question

I want to dynamic partition the hive table based on the creationdate(column in the table) and then save the spark dataframe. ANy ideas?

Answer 1

Hey, you can try something like this:

df.write.partitionBy('year', 'month').saveAsTable(...)

or

df.write.partitionBy('year', 'month').insertInto(...)