Trending questions in Big Data Hadoop

+1 vote
1 answer
0 votes
1 answer

Hadoop HDFS: How to delete old files from HDFS?

You can use commands like this: hdfs dfs ...READ MORE

Nov 15, 2018 in Big Data Hadoop by Omkar
• 69,220 points
14,213 views
0 votes
1 answer

How to restart failed Namenode?

You need to solve the issue which ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Ishan
3,378 views
0 votes
1 answer

Hadoop: ERROR1070: Could not resolve count using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.]

Hi, I can see the error arose because the count ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,699 views
0 votes
1 answer

What happens when a datanode that is dead becomes active again?

When NameNode notices that it has not ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Rishi
4,770 views
0 votes
1 answer

Spark : java.lang.ClassNotFoundException: org.apache.hadoop.fs.FSDataInputStream

Create a spark-env.cmd file looking like this @echo off set ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
• 69,220 points
12,038 views
0 votes
0 answers
+1 vote
0 answers

Missing Service request

Hello All, need assistance on one issue. ...READ MORE

Sep 17, 2019 in Big Data Hadoop by Hemanth
• 250 points
850 views
0 votes
1 answer

How to unzip a zipped file stored in Hadoop hdfs?

hadoop fs -text /hdfs-path-to-zipped-file.gz | hadoop fs ...READ MORE

Dec 12, 2018 in Big Data Hadoop by Omkar
• 69,220 points
12,895 views
+1 vote
0 answers

hdfs namenode -format not working, not showing anything.

can someone help me with this please, ...READ MORE

Sep 6, 2019 in Big Data Hadoop by nar
1,323 views
0 votes
1 answer

Exception in thread "main" java.lang.NoClassDefFoundError

As far I can make out from ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Arpit
2,506 views
0 votes
1 answer

How to call MapReduce program using a simple Java Program?

Because map and reduce run on different ...READ MORE

Sep 4, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
1,367 views
0 votes
1 answer

Write data into hive table in a parquet

Below is an example query which you ...READ MORE

Jul 26, 2019 in Big Data Hadoop by Sadu
3,047 views
0 votes
1 answer

Granting SELECT privilege in Hive

You can use this command to do ...READ MORE

May 31, 2019 in Big Data Hadoop by Umar
5,454 views
0 votes
1 answer

How can create the dynamic partition table with data in Hive?

Hi, We can see some steps to do ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Gitika
• 65,770 points
4,593 views
0 votes
1 answer

How to delete a column family from table in HBase?

Hey, You can delete a column family from ...READ MORE

Jun 21, 2019 in Big Data Hadoop by Gitika
• 65,770 points
4,532 views
0 votes
1 answer

How to check the size of a file in Hadoop HDFS?

You can use the  hadoop fs -ls command to ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
• 69,220 points
13,620 views
0 votes
1 answer

How to import data to hbase database?

First you have to have the file ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Kiran
2,987 views
0 votes
1 answer

Hive local inpath gives invalid path error

You are using the below command to ...READ MORE

May 23, 2019 in Big Data Hadoop by Jill
5,593 views
0 votes
1 answer

Why we use 'help' command in Hadoop Sqoop?

Hi, The command sqoop help lists the tools ...READ MORE

Feb 4, 2020 in Big Data Hadoop by MD
• 95,460 points
921 views
0 votes
1 answer

Current Date in Hive

Try this instead: select from_unixtime(unix_timestamp()); If you have an ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Tina
2,848 views
0 votes
2 answers

Is there a .NET equivalent to Apache Hadoop?

Hadoop is a Java-based platform. So, to ...READ MORE

Jul 16, 2020 in Big Data Hadoop by Suhana
• 340 points
1,798 views
0 votes
1 answer

Sqoop: Dsqoop.export.records.per.statement option

Dsqoop.export.records.per.statement=1 is as the name suggests how many ...READ MORE

Jul 15, 2019 in Big Data Hadoop by Krish
3,266 views
+1 vote
0 answers

Directory not found while using java -classpath

I'm using command java -classpath  ${HADOOP_CLASSPATH} -d '/home/shravanth/Desktop/wordcount/classes' ...READ MORE

Sep 14, 2019 in Big Data Hadoop by shravanth
633 views
0 votes
1 answer

Use of Group ALL in Pig

Suppose we have a data set as ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Roshan
3,453 views
0 votes
1 answer

Difference between Text and String in Hadoop

The binary representation of a Text object ...READ MORE

Aug 8, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
2,209 views
0 votes
2 answers

What is a container in YARN?

Yarn container are a process space where ...READ MORE

May 2, 2020 in Big Data Hadoop by anonymous
6,844 views
0 votes
0 answers

ava.sql.SQLException: Error while processing statement:

Hi everyone, I am facing one issue ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Hemanth
• 250 points

edited Aug 7, 2019 by Omkar 2,244 views
0 votes
1 answer

Hadoop: error: Cannot lock storage /app/hadoop/tmp/dfs/name. The directory is already locked.

Hi, Check your dfs.name.dir and dfs.data.dir path in hdfs-site.xml. Or ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
• 65,770 points
2,261 views
0 votes
1 answer

Output types of mapper and reducer does not match

job.setOutputValueClass will set the types expected as ...READ MORE

Jul 22, 2019 in Big Data Hadoop by Reena
2,849 views
0 votes
1 answer

how to store images and videos on to HDFS?

HDFS is capable to accept data in ...READ MORE

Jul 16, 2019 in Big Data Hadoop by ravikiran
• 4,620 points
3,113 views
0 votes
1 answer

How to find in incorrect file/records in hive?

A value with a wrong datatype causes ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Ritu
2,717 views
0 votes
3 answers

What are differences between NameNode and Secondary NameNode?

File metadata information is stored by Namenode ...READ MORE

Apr 8, 2019 in Big Data Hadoop by anonymous
15,538 views
0 votes
1 answer

Error: Execution Error, Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. Permission denied:

Hey, The error you are getting because the ...READ MORE

May 15, 2019 in Big Data Hadoop by Gitika
• 65,770 points
5,785 views
0 votes
1 answer

Parquet & Avro File hadling with HIVE

For avro you can follow the format ...READ MORE

Jul 25, 2019 in Big Data Hadoop by Tarun
2,620 views
0 votes
1 answer

Sqoop export not working

The issue that you might be getting ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Tina
2,954 views
0 votes
1 answer

Pig: Difference between inner bag and outer bag

Outer Bag: An outer bag is nothing but ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Firoz
2,894 views
+1 vote
2 answers

Hadoop: Error: Exception in thread “main” java.lang.UnsupportedClassVersionError: a

The reason for this error is because ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Venkita
• 240 points
1,914 views
0 votes
1 answer

Hive: what location should I mention while creating table?

It can be a hdfs path. The ...READ MORE

May 23, 2019 in Big Data Hadoop by Jishan
5,185 views
0 votes
1 answer

Hadoop: ERROR datanode.DataNode: All directories in dfs.data.dir are invalid.

Hi, Try this, first delete all contents from ...READ MORE

Aug 5, 2019 in Big Data Hadoop by Gitika
• 65,770 points
1,940 views
0 votes
2 answers

Sqoop: Could not load mysql driver exception.

I add mysql driver for sqoop and it ...READ MORE

Mar 1, 2020 in Big Data Hadoop by Manh Quang
• 180 points
3,862 views
0 votes
0 answers

HIve query data dates issue

Hello All, I am facing one issue, my ...READ MORE

Aug 22, 2019 in Big Data Hadoop by anonymous

edited Aug 22, 2019 by Omkar 1,238 views
0 votes
1 answer

PIG Error while loading file: -bash: syntax error near unexpected token `('

Since your data is delimited with tabs ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Ritu
2,108 views
0 votes
1 answer

Pig: Remove header line in csv file

Refer to the below file det.txt: Name,Age,Location a,10,chennai b,20,bangalore We will ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Yogi
2,059 views
0 votes
1 answer

Error: ERROR security.UserGroupInformation: PriviledgedActionException as:root (auth:SIMPLE)

Hey, For me, my Hadoop NameNode was in ...READ MORE

Aug 7, 2019 in Big Data Hadoop by Gitika
• 65,770 points
1,729 views
0 votes
1 answer

How can we ignore header line while loading data into Pig?

Suppose you need to load this in ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Kiran
2,942 views