Distcp From Local to HDFS giving error file not found

Question

I was checking the ways to copy data from local to HDFS, so I found copyFromLocal, put and distcp command. Distcp performs the operation faster than put or copyFromLocal. So I was trying the same but I am receiving the error FIleNotFoundException. Can anyone help to resolve the error?

Answer 1

Hey, @Amey,

This is probably because of a lack of configuration. Try to add the Hadoop configuration files as a resource to the object Configuration:

Configuration conf = new Configuration();
conf.addResource(new Path("/etc/hadoop/conf/core-site.xml")); 
conf.addResource(new Path("/etc/hadoop/conf/hdfs-site.xml"));
FileSystem hdfs = FileSystem.get(conf);

I hope this will help. If you get any other queries regarding this, please post it here.