Trending questions in Big Data Hadoop

0 votes
1 answer

Sqoop - moving data from DB2 to HDFS ( hive partition table)

sqoop import --driver com.ibm.db2.jcc.DB2Driver --connect jdbc:db2://db2.my.com:50000/databaseName --username ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Payal
 • 4,600 views
0 votes
1 answer

Failed to start namenode in hadoop

Change your following properties in hdfs-site.xml <property> ...READ MORE

Jan 12, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 13,585 views
0 votes
1 answer

Hadoop hdfs "permission denied" error when I try to make new directory

This is because you dont have enough ...READ MORE

Nov 22, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 15,720 views
0 votes
10 answers

Difference between single node & pseudo-distributed mode in Hadoop?

Single node is used for debugging the ...READ MORE

Dec 7, 2018 in Big Data Hadoop by Mahisha
 • 19,187 views
0 votes
1 answer

Warning: Unable to load Hadoop Native Library for your platform. [closed]

 I had the same issue. It's solved ...READ MORE

Jun 28, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 6,202 views
0 votes
2 answers

Hadoop error: Input path does not exist

I was able to fix the issue. ...READ MORE

Jan 13, 2019 in Big Data Hadoop by Ponezhil Ramu
 • 14,314 views
0 votes
1 answer

How to resolve corrupted blocks in Hadoop?

You can use hdfs fsck / to ...READ MORE

Jul 5, 2019 in Big Data Hadoop by Nandini
 • 5,757 views
0 votes
1 answer

How setrep command is used and what is the description to this?

Hi, This HDFS command is used to change ...READ MORE

Jun 19, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 6,438 views
+1 vote
0 answers

Class not found exception in wordcount program in mapreduce

import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.Path; import java.io.IOException; import org.apache.hadoop.mapreduce.lib.output.FileOutputFormat; import org.apache.hadoop.mapreduce.*; import org.apache.hadoop.mapreduce.lib.input.FileInputFormat; import ...READ MORE

Oct 3, 2019 in Big Data Hadoop by Tarun
 • 160 points
edited Oct 3, 2019 by Omkar • 1,794 views
0 votes
1 answer

Load data into teradata using sqoop export

The general syntax to do this as ...READ MORE

Aug 9, 2019 in Big Data Hadoop by Kunal
 • 4,156 views
0 votes
1 answer

Command to see the indexes of a table in Hive?

Hey, The command you can use to see ...READ MORE

Jun 26, 2019 in Big Data Hadoop by Gitika
 • 65,770 points
edited Jun 26, 2019 by Gitika • 6,010 views
0 votes
1 answer

How to Access Hive via Python?

The easiest way is to use PyHive. To ...READ MORE

Oct 9, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 17,242 views
0 votes
1 answer

How to import data to hbase database?

There are 3 Ways to Load Data ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Karan Reddy
 • 5,385 views
0 votes
1 answer

Multiple input for MapReduce job

We use MultipleInputs class which supports MapReduce ...READ MORE

Jun 20, 2019 in Big Data Hadoop by Jim
 • 6,209 views
+1 vote
1 answer

sql exception when exporting

Hello @Hemanth, the error String or binary data ...READ MORE

Sep 4, 2019 in Big Data Hadoop by Ramya
 • 2,687 views
+1 vote
1 answer

2 datanodes is slower ,how to get those details .what is your approach as hadoop admin

First, enable the detection of slow nodes. ...READ MORE

Sep 23, 2019 in Big Data Hadoop by Riya
 • 1,734 views
0 votes
1 answer

How to run Hadoop 2.1.0 in Windows System?

Same problem but with recent Hadoop v. ...READ MORE

Sep 11, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 2,112 views
0 votes
1 answer

Why do we use job.waitForCompletion(true)?

The main reason for job.waitForCompletion exists is ...READ MORE

Jul 10, 2019 in Big Data Hadoop by Josh
 • 4,828 views
0 votes
2 answers

How to pass a password to Sqoop import command?

You can directly pass the password in ...READ MORE

May 15, 2019 in Big Data Hadoop by Raj
 • 7,163 views
0 votes
1 answer

Regarding unstructured data handling in hadoop

There are multiple ways to import unstructured ...READ MORE

Jul 9, 2019 in Big Data Hadoop by Jishan
 • 4,749 views
0 votes
1 answer

Different between zkfc and zookeeper

Hey, The key difference between both the components ...READ MORE

Jul 31, 2019 in Big Data Hadoop by Sunny
 1 flag • 3,807 views
0 votes
2 answers

How to see MySql service is running or not using linux command?

Hi, You can simply run the following commands ...READ MORE

Jan 21, 2020 in Big Data Hadoop by anonymous
 • 2,252 views
0 votes
1 answer

Can I run Hadoop with Docker for both DEV and PROD environments?

Hi, Yes, you can run Hadoop with Docker ...READ MORE

Jan 24, 2020 in Big Data Hadoop by MD
 • 95,460 points • 646 views
0 votes
1 answer

How to list files in hdfs that contains a specific string?

Yes, you can do this. You can ...READ MORE

Jan 27, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 11,682 views
0 votes
1 answer

I am receiving a warning which says: Failed to locate the winutils binary in the Hadoop binary path

I see that you are facing multiple ...READ MORE

May 31, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 6,293 views
0 votes
1 answer

which one is better bigdata or devops for career

I think Big Data will be good ...READ MORE

Aug 26, 2019 in Big Data Hadoop by Karan
 • 2,489 views
0 votes
1 answer

How to choose number of Executors and Executor cores?

Refer to the below when you are ...READ MORE

Jul 29, 2019 in Big Data Hadoop by Veer
 • 3,663 views
0 votes
1 answer

why do we need MaPReduce in BigData Hadoop?

Hi, As we know Hadoop provides Hdfs as ...READ MORE

Feb 4, 2020 in Big Data Hadoop by MD
 • 95,460 points • 755 views
+1 vote
1 answer

What are all the Data quality checks we do in our real time Big Data projects.

You can use a checksum to compare ...READ MORE

Sep 4, 2019 in Big Data Hadoop by Tina
 • 1,956 views
0 votes
2 answers

Installing HBase on windows

This procedure worked for me. https://medium.com/@bishupaulose/install ...READ MORE

Aug 16, 2019 in Big Data Hadoop by Sam
 • 6,387 views
0 votes
2 answers

Why we require SSH during hadoop installation?

Hey, SSH setup is required to do different ...READ MORE

Jun 11, 2019 in Big Data Hadoop by Gitika
 • 65,770 points
edited Jun 11, 2019 by Gitika • 5,547 views
0 votes
1 answer

How to retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Yogi
 • 4,254 views
0 votes
2 answers

Explain to me the difference between Name Node and Secondary Name Node

Secondary namenode is just a helper for ...READ MORE

Aug 6, 2019 in Big Data Hadoop by Dhiman
 • 4,074 views
0 votes
1 answer

Secondary Sorting in Hadoop MapReduce

Grouping Comparator Once the data reaches a reducer, ...READ MORE

Sep 5, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 1,813 views
0 votes
1 answer

Command to get status of all running Oozie workflow

Hey, You can use this command to get ...READ MORE

Jun 12, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 5,433 views
0 votes
3 answers

How to connect Spark to a remote Hive server?

JDBC is not required here. Create a hive ...READ MORE

Mar 8, 2019 in Big Data Hadoop by Vijay Dixon
 • 190 points • 12,768 views
0 votes
1 answer

Command to copy file from desktop to hdfs

You can use either of the below ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Firoz
 • 4,163 views
0 votes
1 answer

What is thrift in Hive?

Hey, Thrift comes in the architectural part of ...READ MORE

May 13, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 6,711 views
0 votes
1 answer

Not able to upload files to hdfs: No such file or directory

The reason for this error is that ...READ MORE

Jul 11, 2019 in Big Data Hadoop by Srujan
 • 4,151 views
0 votes
1 answer

How to select partition in Hive?

Follow these steps: A. Create Database ------------------ create database retail123; B. ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 10,319 views
0 votes
2 answers

How to use scoop in a Java Program

There is a trick which worked out ...READ MORE

Sep 4, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 1,689 views
+1 vote
1 answer

Client not able to connect to cluster

There could be multiple reasons: Make sure you ...READ MORE

Sep 23, 2019 in Big Data Hadoop by Rishi
 • 898 views
0 votes
1 answer

How do you handle the failure of Data node?

HDFS has Master Slave architecture in which Master ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
 • 65,770 points
edited Apr 9, 2019 by Gitika • 8,104 views
0 votes
1 answer

Warning: unable to load hadoop native library

Just append word native to your HADOOP_OPTS lik ...READ MORE

Sep 9, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 1,492 views
0 votes
1 answer

Hive: org.apache.hadoop.security.AccessControlException Permission denied: user

This error is generally thrown when the ...READ MORE

Aug 1, 2019 in Big Data Hadoop by Waniku
 • 3,114 views
0 votes
1 answer

Managed Table vs External Table

External table is created for external use ...READ MORE

Dec 14, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 13,029 views
+1 vote
1 answer

Which programming language is most preferable for working Hadoop? Java and Python? and which one is most easy to learn?

Hi, To start with Hadoop I would suggest ...READ MORE

Jul 24, 2019 in Big Data Hadoop by Nitu
 • 3,323 views
0 votes
1 answer

error:- /zookeeper_server.pid: Permission denied FAILED TO WRITE PID

Hey, The default zookeeper installation (tar extract) comes ...READ MORE

May 27, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 5,831 views
0 votes
1 answer

Spark Vs Hive LLAP Question

While Apache Hive and Spark SQL perform ...READ MORE

Jul 16, 2019 in Big Data Hadoop by Karan
 • 3,679 views
0 votes
1 answer

How can we retrieve/get complete HQL hive query from hive,spark and tez?

To get full query running for the ...READ MORE

Jul 23, 2019 in Big Data Hadoop by Lohit
 • 3,367 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.