Error split value is not a member of org apache spark sql Row

Question

Hi,

Error : split value is not a member of org.apache.spark.sql.Row

I am working on  eclipse EdurekaVM, when adding split(",") i am getting this error, please help.

val rdd2col = spark.read.csv("file:///home/edureka/rk/2Cols.csv")

val names = rdd2col.map(line => line.split(",")(0))

Answer 1

spark.read.csv is used when loading into a data frame. The error message that you are getting states that the 'split' function that you are using is not a member of spark.sql. It is searching split in spark.sql because of the loading technique.

Please refer to the below commands for your requirement:

val rdd2col = sc.textFile("file:///home/edureka/Documents/datasets/emp.csv")
val names = rdd2col.map(line => line.split(",")(1))
names.collect()