Trending questions in Big Data Hadoop

0 votes
1 answer

Can DataNode and NameNode be commodity hardware?

DataNodes are the commodity hardware only as ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Neha
 • 6,300 points • 3,180 views
0 votes
1 answer

What does a secondary namenode do in Hadoop?

The Secondary namenode is mainly used as a ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,044 views
0 votes
1 answer

Hadoop Job Tracker problem. I cannot connect to http://localhost:50030/

I think you are using new version ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,938 views
–1 vote
1 answer

Display contents of my Parquet file.

Make sure you are running from the ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,112 views
0 votes
1 answer

How will you submit job as particular user?

You need to create a new user ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,240 views
–1 vote
1 answer

Setting Hive properties

Hey. It's definitely not a stupid question. ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,405 views
0 votes
1 answer

What is the Path of hdfs.site.xml?

Here's where you can find the file: /etc/hadoop/[service ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,366 views
0 votes
1 answer

Not able to insert data into hive table

Seems like a hive version problem.​ insert operation is ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,245 views
0 votes
1 answer

How to create files in hdfs?

You can create a file directly in ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,457 views
0 votes
1 answer

Doubt regarding sqoop updated data

Incremental append or load in sqoop will ...READ MORE

Feb 15, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 550 views
0 votes
1 answer

How will you decide whether you need to use the Capacity Scheduler or the Fair Scheduler?

Fair Scheduling is the process in which ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,962 views
0 votes
1 answer

Not able to insert in hive partition table

You have to add the partition before ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,204 views
–1 vote
1 answer

Does Hadoop merge the output files after reduce phase?

No, the files after the reduce phase are ...READ MORE

Jan 23, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,548 views
0 votes
1 answer

expected org.apache.hadoop.io.IntWritable, received org.apache.hadoop.io.LongWritable

Hey George!  This error comes whenever you use ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,365 views
0 votes
1 answer

Not able to list tables in sqoop

The default port number for MySQL is ...READ MORE

Jan 29, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,219 views
0 votes
1 answer

What is the command to count number of lines in a file in hdfs?

hadoop fs -cat /example2/doc1 | wc -l READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,094 views
0 votes
0 answers

I have a file uploaded through ftp. Next I want to upload it to local file system in hadoop

Jan 24, 2019 in Big Data Hadoop by Mohan
 • 140 points
edited Jan 24, 2019 by Omkar • 1,416 views
0 votes
1 answer

[edureka_159609@ip-20-0-41-190 bin]$ hdfs dfs -mkdir ://localhost:9000/Pig_Data -mkdir: java.net.URISyntaxException: Expected scheme name at index 0: ://localhost:9000/Pig_Data

Hey @Mohan! Could you try the following ...READ MORE

Jan 23, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,416 views
0 votes
1 answer

Using HBase jar files. Where to download and set classpath

There are many sites you can get ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,119 views
0 votes
1 answer

What are active and passive “NameNodes” in Hadoop?

In HA (High Availability) architecture, we have ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 3,142 views
0 votes
1 answer

Not able to install yarn on Ubuntu

Seems like your system does not have ...READ MORE

Feb 5, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 852 views
–1 vote
1 answer

Namenode not running

Never mind. I forgot to run hadoop namenode ...READ MORE

Dec 27, 2018 in Big Data Hadoop by digger
 • 26,740 points • 2,563 views
0 votes
1 answer

Not able to start namenode with ./start-all.sh

Try this: stop all the daemons: ./stop-all.sh format the namenode: cd ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 2,226 views
0 votes
1 answer

Hadoop HDFS: Java API to move files to hdfs

You can use the FileUtil api to do this. Example: Configuration ...READ MORE

Nov 19, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,158 views
0 votes
1 answer

How to control logging functionality in Hadoop?

 Logs are distributed across your cluster, but ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 4,443 views
–1 vote
1 answer

Hadoop error: can not start-all.sh

Try adding <property> <name>dfs.name.dir</name> <value>/path/to/hdfs/dir</value> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,868 views
0 votes
1 answer

Can't access hadoop job logs

The error which you are getting can ...READ MORE

Jan 28, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,089 views
–1 vote
1 answer

Hadoop MapReduce word count program failed

Seems like Firewall is blocking the connection. ...READ MORE

Jan 21, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,413 views
0 votes
1 answer

How to set input split settings?

It can be controlled by setting the ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,425 views
0 votes
1 answer

Why scala generates 2 files, Person.class and Person$.class?

While running Scala, Scala objects are translated ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 609 views
0 votes
1 answer

Hadoop: namenode -format error "java.io.IOException"

Run the command as sudo or add the ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,673 views
0 votes
1 answer

Error while starting hadoop daemons

First, format the namenode and then try ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,654 views
0 votes
1 answer

Cant access file from Hive. permission denied

There are two possible reasons for this: Wrong ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,107 views
0 votes
1 answer

Class not found exception when I am running my Word Count Program jar file

You have forgotten to include the package name ...READ MORE

Jan 18, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,314 views
0 votes
1 answer

What is the hdfs command to check free space available?

You can see the free available space ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,808 views
–1 vote
1 answer

How to use multiple spark version?

You can use the  SPARK_MAJOR_VERSION for this. Suppose ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,292 views
0 votes
1 answer

Hadoop tools/eco-system version compatibility doubt

Below are the versions which can be used ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 710 views
–1 vote
1 answer

Hadoop daemons not starting

You have to write this directory in ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,586 views
0 votes
1 answer

Creating a Parquet or Avro file

In hadoop, we do not create different ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,111 views
0 votes
1 answer

Start-dfs.sh daemons not starting. localhost: mkdir: cannot create directory `/user': Permission denied

Make the following changes to the hadoop-env.sh ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,138 views
0 votes
1 answer

How to run Nutch in Hadoop installed in pseudo-distributed mode

Make sure you have built Nutch from ...READ MORE

Jan 24, 2019 in Big Data Hadoop by Frankie
 • 9,830 points • 980 views
0 votes
1 answer

Hadoop: “Unhealthy Node local-dirs and log-dirs are bad”

You can increase the threshold in yarn-site.xml <property> ...READ MORE

Nov 8, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,305 views
0 votes
1 answer

What are the different types of tombstone markers in HBase for deletion?

1)Family Delete Marker- This markers marks all ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,594 views
0 votes
1 answer

Junit test for Map Reduce Hadoop

Hi. This is the code I used ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,578 views
0 votes
1 answer

Hadoop installation issue on fedora 24

type jps and check whether namenode and datanode is ...READ MORE

Jan 24, 2019 in Big Data Hadoop by Frankie
 • 9,830 points • 942 views
0 votes
1 answer

Update hdfs data before stroring in MySql

Yes, you can update the data before ...READ MORE

Jan 27, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 792 views
–1 vote
1 answer

Pig code in Eclipse shows error :LongWritable cannot be resolved to a type

To rectify this errors, you need to ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,904 views
0 votes
1 answer

Hive: How to know the path of a created table?

You can use the DESCRIBE command to ...READ MORE

Nov 28, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,305 views
+1 vote
1 answer

How can we list files in HDFS directory as per timestamp?

No, there is no other option to ...READ MORE

May 8, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 12,073 views
0 votes
1 answer

How to open MySql console in Ubuntu?

sudo service mysqld restart mysql -u <username> root ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,593 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.