Trending questions in Big Data Hadoop

0 votes
1 answer

Name node RAM metadata

For the above requirement, the memory consumption ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Reshma
1,700 views
0 votes
1 answer

How to use appnedToFile command in HDFS?

Hey, This Hadoop fs command appends single sources ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,141 views
0 votes
1 answer

Command to see the status of MapReduce job?

Hi, You can use this command given below: Syntax: $ ...READ MORE

Jun 14, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,348 views
0 votes
1 answer

Hive- unable to load data into table

The command you are typing is incorrect. ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Firoz
1,606 views
0 votes
1 answer

Which one is better MR or Spark?

The above difference clearly points out that ...READ MORE

Jul 15, 2019 in Big Data Hadoop by Daniel
1,978 views
0 votes
1 answer

How to Modify the Maximum Number of Versions for a Column Family in Hbase?

Hey, The example uses HBase Shell to keep ...READ MORE

May 31, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,886 views
0 votes
1 answer

What are the different daemons in yarn?

Hi, The different Daemons in YARN are:- Resources Manager:- Runs ...READ MORE

Apr 24, 2019 in Big Data Hadoop by Gitika
• 65,770 points
5,520 views
0 votes
1 answer

How to Compress Map output?

With MR2, now we should set conf.set("mapreduce.map.output.compress", true)  conf.set("mapreduce.output.fileoutputformat.compress", ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Varun
1,542 views
0 votes
1 answer

Can a table be renamed in hive?

Hey, Yes, you can rename a table in ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,787 views
0 votes
1 answer

Hive: LOCATION and WITH DBPROPERTIES command in create table command

By default, the Hive database will be ...READ MORE

May 22, 2019 in Big Data Hadoop by Firoz
4,255 views
+1 vote
2 answers

Error: com/eng/mr/WordCountDriver : Unsupported major.minor version 52.0

The reason why you get this error ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Venkita
• 240 points
888 views
0 votes
1 answer

When do Reduce tasks start in Hadoop?

As much I understand Reduce phase start ...READ MORE

Aug 9, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
803 views
0 votes
1 answer
0 votes
1 answer

Is it possible to change the default location of a managed table?

Hi, Yes, you can do it by using ...READ MORE

Jun 18, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,008 views
0 votes
1 answer

Unable to create table in Hive

It is looking like your Hadoop daemons ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Yogi
891 views
0 votes
1 answer

Unable to find Java and eclipse installation on my webconsole.

You can either install java and eclipse ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Isha
754 views
0 votes
1 answer
0 votes
1 answer

What is DAG in Hive?

Hey, DAG in Hive architecture is nothing but ...READ MORE

May 11, 2019 in Big Data Hadoop by Gitika
• 65,770 points
4,663 views
0 votes
1 answer

Not a host:port pair: PBUF?

Hey. This error usually occurs when the ...READ MORE

Jul 22, 2019 in Big Data Hadoop by Esha
1,570 views
0 votes
1 answer

What is the role of Job tracker Hadoop?

Job tracker's function is resource management, tracking ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
• 65,770 points
5,995 views
0 votes
1 answer

Error: permission denied locoalhost: chown: cannot access /usr/local/hadoop/ No such file or directory

Hey, As the error suggested that you have ...READ MORE

Jun 17, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,950 views
0 votes
1 answer

Install PostgreSQL JDBC driver for Sqoop

All you have to do to install ...READ MORE

Jun 6, 2019 in Big Data Hadoop by Quill
3,431 views
0 votes
1 answer

What are the challenges we faced as Hadoop Admin?

Hey,  There are some of the key responsibilities ...READ MORE

Jun 25, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,617 views
0 votes
1 answer

What is fork Keyword in Oozie? How Fork and Join keyword are related t o each other in Oozie?

Hey, Basically, when we want to run multiple jobs ...READ MORE

Jun 12, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,173 views
0 votes
1 answer

How to assign server access to client(s) through NFS export file?

Hi, You can create the export folder, you will ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
• 65,770 points
772 views
0 votes
1 answer

Mapreduce: What is the use of setting the name of the job?

Job job = new Job(conf,"job_name"), is just ...READ MORE

Jul 22, 2019 in Big Data Hadoop by Madhu
1,379 views
0 votes
2 answers

What is the relationship between Hadoop and Database?

Hadoop software framework work is very well ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Dinesh
1,579 views
0 votes
1 answer

Mapreduce: custom Input format

Here's a list of Input Formats: CombineFileInputFormat CombineS ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Veer
1,232 views
0 votes
1 answer

Hadoop Hive: How to split string in Hive?

You can use the split function along ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
• 69,220 points
12,475 views
0 votes
1 answer

Unable to run Sqoop scirpt to copy data to Cassandra

Unfortunately, this can't be achieved with open ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Shri
1,269 views
0 votes
1 answer

How to download Large Hadoop[]closed] Data?

The best thing with Millions Songs Dataset ...READ MORE

Jul 23, 2019 in Big Data Hadoop by ravikiran
• 4,620 points

edited Jul 25, 2019 by ravikiran 1,233 views
0 votes
1 answer

How to fix corrupt files on HDFS

1 - Spark if following slave/master architecture. So ...READ MORE

Jul 18, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,427 views
0 votes
1 answer

Map-reduce code for finding average salary

You can choose your mapper output key ...READ MORE

May 22, 2019 in Big Data Hadoop by Yogi
3,872 views
0 votes
1 answer

MapReduce to count alphabets

Please find the code below for alphabet ...READ MORE

May 23, 2019 in Big Data Hadoop by Firoz
3,820 views
0 votes
1 answer

Why do we use job.waitForCompletion(true) ?

The main reason for job.waitForCompletion exists is that ...READ MORE

Jul 22, 2019 in Big Data Hadoop by Kiran
1,212 views
0 votes
1 answer

Running Mapreduce on compressed data

It is very straight forward, no need ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Nanda
1,118 views
0 votes
1 answer

Hadoop input folder not found?

Hey, This is because the user directory not ...READ MORE

Jun 14, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,875 views
+1 vote
1 answer

Sqoop: How to load all tables except one?

You can use the import-all-tables option and along with ...READ MORE

Feb 18, 2019 in Big Data Hadoop by Omkar
• 69,220 points
7,794 views
0 votes
2 answers

What is ElasticSearch Hadoop?

it as a connector that allows data to flow bi-directionaly so ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Dinish
1,426 views
0 votes
1 answer

HDFS: Upload file from local file system to Edureka cloud lab

To upload a file from your local ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Zora
1,656 views
0 votes
1 answer

Hive query: Join tables based on ID

After creating the tables a1 and b1 ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Tarun
1,032 views
0 votes
1 answer

Does Caching stand as the only advantage in Spark compared to Hadoop?

Spark has much lower per job and ...READ MORE

Jul 31, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
744 views
0 votes
1 answer

How to merge two consecutive regions using command line in HBase?

Hey, The Master and RegionServer both participate in ...READ MORE

May 29, 2019 in Big Data Hadoop by Gitika
• 65,770 points
3,444 views
0 votes
1 answer

Error: schemaTool failed

Hey, The error you got because you might ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
• 65,770 points
4,128 views
0 votes
1 answer

Primary keys in apache Spark

from pyspark.sql.functions import monotonically_increasing_id df.withColumn("id", monotonically_increasing_id()).show() Verify the second ...READ MORE

Jul 11, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,580 views
0 votes
1 answer

Index LZO files

You can do it using the following ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Rishi
1,015 views
0 votes
1 answer

Output Splitting problem in Hadoop

When you are loading two different files, ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Sayni
1,354 views
0 votes
1 answer

Hadoop security GroupMappingServiceProvider exception for Spark job via Dataproc API

If you don't want to turn off ...READ MORE

Jul 2, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,962 views
0 votes
1 answer

What are the services running in Hadoop

Below are the services Running in Hadoop Hdfs  yarn mapreduce ozzie zookeeper hive hue hbase impala flume sqoop spark Depending ...READ MORE

Jun 24, 2019 in Big Data Hadoop by deepak
2,321 views
0 votes
1 answer

Pig script not dumping the data correctly

The first column is denoted by $0, ...READ MORE

Jul 15, 2019 in Big Data Hadoop by George
1,374 views