Trending questions in Big Data Hadoop

–1 vote
1 answer

Sqoop split-by problem

Hello. The -m or --num-mappers is just a ...READ MORE

Dec 19, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,363 views
+1 vote
1 answer

How can we list files in HDFS directory as per timestamp?

No, there is no other option to ...READ MORE

May 8, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 11,993 views
0 votes
1 answer

Hbase installation Issue. Cant start HRegionServer and HQuorumPeer

It seems hbase did not start properly ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,005 views
–1 vote
1 answer

How many FSimage files will be created in hard disk?

In Hdfs, data and metadata are decoupled. ...READ MORE

Dec 21, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,282 views
+1 vote
1 answer

How to print data without brackets using PIG Dump?

Please refer to the below commands: student = ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,282 views
0 votes
1 answer

Hue Health issue

The status of Hue is shown in ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 407 views
0 votes
1 answer

Error while creating avrodatafile?

The error you are getting is AvroWrapper class not ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 796 views
0 votes
1 answer

How to read more than one files in Apache Spark?

Try this: val text = sc.wholeTextFiles("student/*") text.collect() ...READ MORE

Dec 11, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,608 views
–1 vote
1 answer

IDE Eclipse: Failed to locate the winutils binary in the hadoop binary path

Try this: First, click on file import appliance. Now ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 1,774 views
0 votes
1 answer

Why is using Combiner function not preferred in shuffling?

Combiner function is not preferred because when ...READ MORE

Jan 23, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 776 views
0 votes
1 answer

Hadoop Java Error: java.lang.NoClassDefFoundError: WordCount (wrong name: org/myorg/WordCount)

Hey, try this code import java.io.IOException; import java.util.Iterator; import java.util.StringTokenizer; import ...READ MORE

Sep 19, 2018 in Big Data Hadoop by slayer
 • 29,370 points • 6,183 views
+1 vote
1 answer

How to get status of hdfs directory using python?

import commands hdir_list = commands.getoutput('hadoop fs -ls hdfs: ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,748 views
–1 vote
1 answer

Not able to run java mapreduce

The error which you are getting i.e ...READ MORE

Jan 11, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,306 views
0 votes
1 answer

Issue in hdfs dfs command

Hadoop has a special file system called ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,402 views
0 votes
1 answer

How does the number of groups affect the cost of the shuffling phase?

Shuffle happens with key-value pairs. So, when ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 745 views
0 votes
1 answer

In Hue, how to to download the script?

You can download the script to your ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,384 views
0 votes
1 answer

UnsupportedClassVersionError while running Mapreduce program.

Seems like the jar file was not ...READ MORE

Jan 18, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 905 views
0 votes
1 answer

ReduceByKey Avereage

You can try the code mentioned below ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 768 views
–1 vote
1 answer

Hdfs command to see available free space in hdfs

Yes, you check the free space using ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 797 views
+1 vote
1 answer

Unable to load data in Hbase table from dataset

Try these steps (make necessary changes): First upload ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,156 views
0 votes
1 answer

How can I access S3/S3n from a local Hadoop 2.6 installation?

For some reason, the jar hadoop-aws-[version].jar which contains the ...READ MORE

Oct 3, 2018 in Big Data Hadoop by digger
 • 26,740 points • 5,426 views
–1 vote
1 answer

Jobtracker and tasktracker is nor running.

Hi. You'll need to run start-mapred.sh if you want the ...READ MORE

Jan 19, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 815 views
0 votes
1 answer

mongo-hadoop connector:how to query data?

You can add more parameters in the ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Frankie
 • 9,830 points • 1,242 views
0 votes
1 answer

Why does one remove or add nodes in a Hadoop cluster frequently?

One of the most attractive features of ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 2,308 views
0 votes
1 answer

Hadoop: Can not start namenode: Unable to load native-hadoop library for your platform

The entries in your .bashrc file looks ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,632 views
0 votes
1 answer

Sqoop creating new file for import evertime

No, you are not doing anything wrong ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,156 views
0 votes
1 answer

Hive table not able to use row format serde

Try this: create table books(isbn string, book_title string, ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 1,504 views
0 votes
1 answer

Sqoop import gives error: org.apache.hadoop.security.AccessControlException: Permission denied

Seems like you are not passing the ...READ MORE

Dec 17, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,069 views
0 votes
1 answer

How to change file format using Sqoop?

For change in the file format, you ...READ MORE

Dec 18, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,061 views
0 votes
1 answer

Hadoop Hive: message:Version information not found in metastore. Unable to instantiate

These are the necessary tables required for metastore that are ...READ MORE

Nov 12, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 3,585 views
0 votes
1 answer

"Cant connect to local mysql server through socket "var/lib/mysql/mysql.sock" .

Seems like mysql.sock does not exist in the ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 1,662 views
0 votes
1 answer

How to connect hive to tableau?

We Can not connect hive to tableau ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Frankie
 • 9,830 points • 1,591 views
0 votes
1 answer

Not able to start/stop hadoop daemons

If you were able to start the ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 1,886 views
0 votes
1 answer

Not able to create Hive table from HDFS file

You dont have to specify the file name ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,531 views
–1 vote
1 answer

How to change the default HUE logs path?

You can change/replace the LOG_DIR variable to ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,143 views
–1 vote
1 answer

Beeline and Hive Query Editor in Embedded mode

Running Hive client tools with embedded servers ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 1,442 views
0 votes
1 answer

Hadoop mapreduce error: apache.hadoop.mapred.FileAlreadyExistsException: Output directory

Seems like the output file already exists. ...READ MORE

Dec 5, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,526 views
0 votes
1 answer

How do I join 2 tables in PIG using 2 fields?

Here, we have two tables: Tab1 having columns ...READ MORE

Dec 13, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,139 views
–1 vote
1 answer

Hive partition tables

Yes, you can create manual partition. Here's ...READ MORE

Jan 3, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,269 views
–1 vote
1 answer

Who will setup multimode and single node modes?

Cluster management is something that is generally ...READ MORE

Jan 21, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 462 views
0 votes
1 answer

How to find the running namenodes and secondary name nodes in hadoop?

Name nodes: hdfs getconf -namenodes Secondary name nodes: hdfs getconf ...READ MORE

Nov 26, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 2,839 views
0 votes
1 answer

Hadoop Mapreduce: Class Not Found Exception

Try adding this Job job = new Job(conf, ...READ MORE

Oct 29, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 4,040 views
–1 vote
1 answer

Beeline vs Hive Query Editor

Hive CLI connects to a remote HiveServer1 ...READ MORE

Dec 31, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 1,348 views
0 votes
1 answer

Cant access the Hadoop Namenode from browser

As mentioned in the error, the nodes ...READ MORE

Dec 20, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 1,775 views
–1 vote
1 answer

Cant open spark-shell webconsole

Seems like you have installed Spark2 but ...READ MORE

Dec 27, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 1,505 views
0 votes
1 answer

Script storage in Hue

You can follow these steps to find ...READ MORE

Jan 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 995 views
–1 vote
1 answer

How we can run spark SQL over hive tables in our cluster?

Open spark-shell. scala> import org.apache.spark.sql.hive._ scala> val hc = ...READ MORE

Dec 26, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 1,531 views
+4 votes
3 answers

Unable to find file error- while Streaming Hadoop

Is python installed running on the slaves that ...READ MORE

Oct 16, 2018 in Big Data Hadoop by Vinith
 • 4,265 views
0 votes
1 answer

What are SUCCESS and part-r-00000 files in Hadoop?

Yes, both the files i.e. SUCCESS and ...READ MORE

Apr 12, 2018 in Big Data Hadoop by nitinrawat895
 • 11,380 points • 12,544 views
–1 vote
1 answer

Serde query understanding

In the query mentioned in your question, ...READ MORE

Dec 29, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 1,336 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.