Explain to me how to get Hadoop configuration in Java Util

Question

I am programming a Java Utility which requires to access HDFS for that I needed a configuration object. I created one using the following method.

Configuration conf = new Configuration()

it doesn't seem to find the DFS, and just uses the local file system; printing

fs.getHomeDirectory()

I've tried adding core-site.xml,mapred-site.xml,yarn-site.xml, and HDFS-site.xml to the Configuration as resources. Nothing seems to work out. Please help me out on this one.

Answer 1

In order to get access to the File system you are expected to use the following configuration and a file system:

1. Get the instance of Configuration

2. Get the HDFS instance

#Configuration configuration = new Configuration();
#FileSystem hdfs = FileSystem.get(new URI("hdfs://"+HadoopLocation+":8020"), configuration);

In Your case, The HadoopLocation is the location in which you have your hadoop server (Possibly Localhost)