Trending questions in Big Data Hadoop

0 votes
1 answer

How to save Spark dataframe as dynamic partitioned table in Hive?

Hey, you can try something like this: df.write.partitionBy('year', ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 8,521 views
0 votes
1 answer

How to insert data inside the database in Linux?

First you need to create a table ...READ MORE

Apr 16, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 1,565 views
0 votes
1 answer

Why we use Relation keyword in pig?

Hey, In pig, Relation represents a complete database. ...READ MORE

May 7, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 615 views
0 votes
1 answer

What is Kafka? what is its importance in Big-Data?

Apache Kafka is a tool used in ...READ MORE

Apr 11, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 1,717 views
0 votes
1 answer

Why should we use "distinct" keyword in pig script?

Hey, The "distinct" statement is very simple. It ...READ MORE

May 3, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 775 views
0 votes
1 answer

What are the relational operators available related to loading and storing in pig language?

Hey, For loading data and storing it into ...READ MORE

May 3, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 749 views
0 votes
1 answer

How data distribution is done in Hadoop?

To understand how or what are the process ...READ MORE

Apr 4, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 1,982 views
+1 vote
1 answer

what are the typicall block sizes in HDFS

HDFS is a block structured file system ...READ MORE

Apr 8, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 1,742 views
0 votes
1 answer

Explain to me to download a Hadoop documentation of a particular version.

I'll drop a link here which will ...READ MORE

May 7, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 511 views
0 votes
0 answers

What is the motivation behind developing Hive?

Hey, I am learning Hive in a basic ...READ MORE

May 9, 2019 in Big Data Hadoop by dyna
 • 496 views
0 votes
0 answers

How run wordcount on multi node hadoop using eclipse?

Apr 24, 2019 in Big Data Hadoop by حسين
 • 200 points
recategorized Apr 24, 2019 by Omkar • 1,122 views
0 votes
1 answer

Edge nodes in Hadoop

Namenodes and Datanodes are a part of ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Siri
 • 3,854 views
0 votes
1 answer

How to read multiple files in hdfs?

If you want to read files with ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 4,327 views
0 votes
0 answers

Nutch with hadoop 2.7 error "GC overhead limit exceeded"

I have a small cluster of 5 ...READ MORE

Apr 10, 2019 in Big Data Hadoop by Hafiz
 • 170 points • 1,638 views
–1 vote
1 answer

unable to start hive server

It seems that your hive server is ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 5,865 views
0 votes
1 answer

What is the difference in DistCP command and Sqoop command in Hadoop?

Both the distCP (Distributed copy in Hadoop) ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 1,545 views
0 votes
1 answer

Hey I am install Hadoop on single node and run program that file size is 3.2 GB and the time is 25 mins، Is this true or get less time. Thanks

Not sure what exactly you mean by ...READ MORE

Apr 22, 2019 in Big Data Hadoop by Shaam
 • 1,133 views
0 votes
1 answer

Explain to me the method to transfer data between Azure tables and Hadoop on Azure

this article on HiveStorageHandler will let you create ...READ MORE

May 3, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 602 views
+1 vote
1 answer

Need help Installing Sqoop on Windows.

Download Sqoop from this link: http://www.apache.org/dyn/closer.lua/sqoop/1.4.7 This link is ...READ MORE

Feb 25, 2019 in Big Data Hadoop by Chandu
 • 3,410 views
0 votes
1 answer

How to decide number of mappers?

The number of mapper depends on the ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 4,556 views
0 votes
1 answer

Difference between hive.exec.compress.output=true; and mapreduce.output.fileoutputformat.compress=true;

Hey there! The definition of these two properties ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 5,967 views
0 votes
1 answer

Hey ,I am install Hadoop and on single node and run on one file in HDFS, but I want to run more of file I work upload files but I know to running all

If you are talking about running multiple ...READ MORE

Apr 22, 2019 in Big Data Hadoop by Tina
 • 1,074 views
0 votes
1 answer

How to handle exceptions in Spark and Scala?

There is no particular format to handle ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 4,896 views
0 votes
1 answer

Hadoop Java: org.apache.hadoop.conf.Configuration does not exist error

To solve this error, add hadoop-common to ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 7,541 views
0 votes
1 answer

Deleting directory in Sqoop

You can use the --delete-target-dir : $ sqoop import ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 3,956 views
0 votes
1 answer

Method to schedule the number of Mappers and Reducers in a Hadoop MapReduce Tsk.

The number of Mapper tasks for a ...READ MORE

Apr 25, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 793 views
+1 vote
3 answers

when i tried to run the hdfs namenode -format command...its failed to run..can anyone help me with this???

Hi Suriyaprakash, I guess the path for hadoop ...READ MORE

Jul 23, 2018 in Big Data Hadoop by avi_man_utd
 • 12,265 views
0 votes
1 answer

Can I use Amazon Web Services for free?

If you would like to use AWS ...READ MORE

Apr 25, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 792 views
0 votes
1 answer

Why do we need the FOR EACH operation in Pig Scripts?

The operation FOREACH in Apache Pig is ...READ MORE

Apr 30, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 558 views
0 votes
1 answer

Connect to Hive using Pyhive

Here's how we can connect to Hive ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 5,392 views
0 votes
1 answer

Copy files to all Hadoop DFS directories

Hi @Bhavish. There is no Hadoop command ...READ MORE

Feb 24, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 3,380 views
–1 vote
1 answer

Apache Spark - Nested JSON array to flatten columns

It depends on the structure of your ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 5,653 views
0 votes
1 answer

Why do we need Hadoop framework?

The function of Distributes File System is ...READ MORE

Apr 10, 2019 in Big Data Hadoop by Gitika
 • 65,770 points
edited Apr 12, 2019 by Gitika • 1,400 views
0 votes
0 answers

I was trying to imlement giraph code but difficult to implement I dont know which method I will follow for solution I have already jar files

May 2, 2019 in Big Data Hadoop by anonymous
recategorized May 2, 2019 by Omkar • 450 views
0 votes
1 answer

Writing File into HDFS using spark scala

The reason you are not able to ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 17,335 views
0 votes
1 answer

Why we need to install "ant -Dhadoopversion=23" ? What is the use of this?

Hi, We install ant to build pig, If the ...READ MORE

Apr 26, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 653 views
0 votes
1 answer

Installing Oozie on Linux System

Download Oozie from this link: http://www.apache.org/dyn/closer.lua/oozie/ Extract the files. ...READ MORE

Feb 28, 2019 in Big Data Hadoop by Rajan
 • 3,122 views
0 votes
1 answer

I am install hadoop on signal node and run program but delay time if have dataset size 3.3 GB take time about 2 hours

Hey @Faris! Try increasing the number of reducers. ...READ MORE

Apr 12, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,193 views
0 votes
1 answer

Why sqoop internally generates MapRed code?

By default Sqoop always create 4 Map ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 1,239 views
0 votes
1 answer

Command to establish connection between MySql with linux?

This is the command you can use ...READ MORE

Apr 15, 2019 in Big Data Hadoop by Gitika
 • 65,770 points
edited Apr 18, 2019 by Gitika • 1,023 views
0 votes
1 answer

Elastisearch Hadoop

I will redirect you to a repository ...READ MORE

Apr 24, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 630 views
0 votes
2 answers

Hadoop fs -stat command

hadoop fs -stat is as hadoop command used ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 11,304 views
0 votes
1 answer

How to install Hadoop on Windows system?

First you need to download Hadoop files. ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 3,307 views
–1 vote
1 answer

"main" java.lang.ClassNotFoundException: WordCount

When you are running a jar file ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 4,567 views
0 votes
1 answer

Which MySql command will generate all the list of command for MySql prompt?

The command is very simple, you have ...READ MORE

Apr 15, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 841 views
0 votes
1 answer

How Sqoop import command works internally?

First when client execute Sqoop import commands through ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 1,017 views
0 votes
1 answer

What command is used to install MySql in centos?

You can use this command to install ...READ MORE

Apr 12, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 943 views
0 votes
1 answer

How to create table inside database in MySql in Linux?

We can use this command to create ...READ MORE

Apr 16, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 798 views
0 votes
1 answer

File formats in Hadoop?

File format is just a way to ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
 • 65,770 points
edited Apr 12, 2019 by Gitika • 1,039 views
0 votes
1 answer

What can you do with sqoop in Hadoop ecosystem?

Scoop came into scenario because there were tools ...READ MORE

Apr 8, 2019 in Big Data Hadoop by Gitika
 • 65,770 points
edited Apr 8, 2019 by Gitika • 1,061 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.