Trending questions in Big Data Hadoop

0 votes
1 answer

Hadoop: How to get the column name along with the output in Hive?

You can get the column names by ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
5,050 views
0 votes
1 answer

Error while accessing the file outformat method SetOutputpath

You have imported org.apache.hadoop.mapred.FileOutputFormat, ​​you need to import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat So, make ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,004 views
0 votes
1 answer

How to reduce shuffling cost in map reduce?

You can define a Combiner function, which does the ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,269 views
0 votes
2 answers

Not able to use npm after installing yarn

 "The easiest way to get started is ...READ MORE

Feb 5, 2019 in Big Data Hadoop by rajesh
• 1,270 points
1,644 views
0 votes
1 answer

hadoop: command not found

The reason you are getting hadoop as ...READ MORE

Mar 28, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
15,262 views
0 votes
1 answer

Sqoop getting error while connecting to MySQL

Have you set a password for MySQL? ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,528 views
0 votes
1 answer

Hbase to pig integration

First enter into grunt shell: $ ./pig –x ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,220 points
982 views
0 votes
1 answer

How to create a Hive table with a sequence file?

In Hive we can create a sequence ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,744 views
0 votes
1 answer

How to retrieve the list of sql (Hive QL) commands that has been executed in a hadoop cluster?

Well, what you can do is use ...READ MORE

Apr 4, 2018 in Big Data Hadoop by kurt_cobain
• 9,350 points
14,834 views
0 votes
1 answer

Hadoop Spark Derby: Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database

As mentioned in the error, there's another ...READ MORE

Nov 16, 2018 in Big Data Hadoop by Omkar
• 69,220 points
5,067 views
0 votes
1 answer

Error connecting hive using python pyhs2

Seems like the host IP is not ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,629 views
0 votes
1 answer

How to convert Spark data into CSV?

You can use this: df.write .option("header", "true") ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,808 views
0 votes
1 answer

Apache storm installation

The “conf/storm.yaml” file contains configurations of Storm. And ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,119 views
0 votes
1 answer

Permission denied while uploading files to hdfs

It is not the problem about permission ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,994 views
0 votes
1 answer

How to send curl downloaded data in hdfs?

Try using put command with stdin as ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,973 views
0 votes
1 answer

Hadoop Hive query to filter employees

select * from tablename where DOJ> '2018-01-01' ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,793 views
0 votes
1 answer

How to concatenate hdfs files and store in output file?

You can use a combination of cat and put command. Something ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,135 views
0 votes
1 answer

Unable to instantiate org.apache.hadoop.hive

You might not have set the connector. ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,944 views
–1 vote
1 answer

WARN util.NativeCodeLoader: Unable to load native-hadoop library

To remove this warning, you can use:  hdfs ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,121 views
0 votes
1 answer

How to create new directory in hdfs using java code?

Try this: { Configuration config ...READ MORE

Dec 6, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,045 views
0 votes
2 answers

start-dfs.sh command is not starting Hadoop JobTracker & TaskTracker

On which version of hadoop do you ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Lokesh Singh
4,110 views
0 votes
1 answer

Hadoop Distribution Differences

The Yahoo distribution is a version of ...READ MORE

Feb 18, 2019 in Big Data Hadoop by Frankie
• 9,830 points
879 views
0 votes
1 answer

MapReduce: Map Value Mismatch error

Seems like you have not specified few ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Haman
1,051 views
0 votes
1 answer

Why should we use "extends Mapper" for Mapreduce code?

The Mapper class belongs to package org.apache.hadoop.mapreduce ...READ MORE

Feb 8, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,268 views
0 votes
1 answer

What is the difference between Apache ZooKeeper and Apache Oozie?

The main difference between these two is ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Anoop
4,719 views
0 votes
1 answer

Failing to execute the script pig file on HDFS

By convention, the pig script that you ...READ MORE

Feb 15, 2019 in Big Data Hadoop by John
989 views
0 votes
1 answer

BigData in MPI

MPI is a communication protocol for programming ...READ MORE

Feb 14, 2019 in Big Data Hadoop by Disha
1,021 views
0 votes
1 answer

Not able to see racks in reports

Seems like rack awareness is not configure.  Try ...READ MORE

Feb 22, 2019 in Big Data Hadoop by Lucky
588 views
–1 vote
1 answer

Getting error while starting hdfs namenode -format

Check your /etc/hosts file, the format should be like ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,421 views
0 votes
1 answer

Mapreduce problem with output part file

As the error suggests and you have ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,191 views
0 votes
1 answer

How to check Cloudera Manager Service status?

There surely is a command to check ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,423 views
0 votes
1 answer

Can DataNode and NameNode be commodity hardware?

DataNodes are the commodity hardware only as ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Neha
• 6,300 points
3,373 views
0 votes
1 answer

What does a secondary namenode do in Hadoop?

The Secondary namenode is mainly used as a ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,277 views
0 votes
1 answer

Doubt in word count query

The COUNT function returns the number of ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
• 69,220 points
685 views
0 votes
1 answer

What is Metastore in Hive?

It stores metadata for Hive tables (like their schema ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,247 views
0 votes
1 answer

Hadoop Job Tracker problem. I cannot connect to http://localhost:50030/

I think you are using new version ...READ MORE

Nov 30, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,143 views
0 votes
1 answer

Spark - load CSV file as DataFrame?

spark-csv is part of core Spark functionality ...READ MORE

Sep 25, 2018 in Big Data Hadoop by slayer
• 29,370 points
6,958 views
0 votes
1 answer

Not able to insert data into hive table

Seems like a hive version problem.​ insert operation is ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,464 views
0 votes
1 answer

Browse HDFS & Job Logs

You can browse the hdfs and see the ...READ MORE

Jan 26, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,637 views
–1 vote
1 answer

Display contents of my Parquet file.

Make sure you are running from the ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
• 69,220 points
3,253 views
–1 vote
1 answer

Setting Hive properties

Hey. It's definitely not a stupid question. ...READ MORE

Jan 5, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,552 views
–1 vote
1 answer

Does Hadoop merge the output files after reduce phase?

No, the files after the reduce phase are ...READ MORE

Jan 23, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,748 views
0 votes
1 answer

expected org.apache.hadoop.io.IntWritable, received org.apache.hadoop.io.LongWritable

Hey George!  This error comes whenever you use ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,571 views
0 votes
1 answer

What is the Path of hdfs.site.xml?

Here's where you can find the file: /etc/hadoop/[service ...READ MORE

Jan 4, 2019 in Big Data Hadoop by Omkar
• 69,220 points
2,468 views
0 votes
1 answer

What is the command to count number of lines in a file in hdfs?

hadoop fs -cat /example2/doc1 | wc -l READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
• 69,220 points
4,322 views
0 votes
1 answer

How will you submit job as particular user?

You need to create a new user ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,319 views
0 votes
1 answer

How to create files in hdfs?

You can create a file directly in ...READ MORE

Jan 25, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,567 views
0 votes
1 answer

Not able to list tables in sqoop

The default port number for MySQL is ...READ MORE

Jan 29, 2019 in Big Data Hadoop by Omkar
• 69,220 points
1,392 views
0 votes
1 answer

How will you decide whether you need to use the Capacity Scheduler or the Fair Scheduler?

Fair Scheduling is the process in which ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Frankie
• 9,830 points
3,062 views