How to create a parquet table in hive and store data in it from a hive table

Question

This is my hive table :

sqlContext.sql("select * from 20181121_SPARKHIVE_431591").show()
# I am storing data as a parquet file on hdfs
sel = sqlContext.sql("select * from 20181121_SPARKHIVE_431591")
sel.write.parquet("test/parquet_nw",partitionBy = "productID")

#trying to use prev location as parquet table location
sqlContext.sql("CREATE EXTERNAL TABLE 20181118_HIVE_431591 (code string,name string,quantity int, price float) PARTITIONED BY (`productID` int) STORED AS parquet LOCATION "/user/edureka_431591/test/parquet_nw"") 

#querying parquet table
sqlContext.sql("select * from 20181118_HIVE_431591").show() --> this returns nothing

How to store it in parquet?

Answer 1

Please use the code attached below for your reference:

To save the parquet file:

sqlContext.sql("SET hive.exec.dynamic.partition.mode= nonstrict")
sqlContext.sql("SET hive.exec.dynamic.partition = true")
sel.write.format("parquet").save("custResult.parquet")

Then you can use the command:

sqlContext.sql("CREATE EXTERNAL TABLE nedw_11 (code string,name string,quantity int, price float) PARTITIONED BY (`productID` int) STORED AS parquet LOCATION "/user/edureka_431591/'custResult.parquet'")

To know more, It's recommended to join Big Data Certification today.