Trending questions in Big Data Hadoop

0 votes
1 answer

How to save Spark dataframe as dynamic partitioned table in Hive?

Hey, you can try something like this: df.write.partitionBy('year', ...READ MORE

Nov 6, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 8,526 views
0 votes
1 answer

How to insert data inside the database in Linux?

First you need to create a table ...READ MORE

Apr 16, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 1,575 views
0 votes
1 answer

Why we use Relation keyword in pig?

Hey, In pig, Relation represents a complete database. ...READ MORE

May 7, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 616 views
0 votes
1 answer

What is Kafka? what is its importance in Big-Data?

Apache Kafka is a tool used in ...READ MORE

Apr 11, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 1,720 views
0 votes
1 answer

Why should we use "distinct" keyword in pig script?

Hey, The "distinct" statement is very simple. It ...READ MORE

May 3, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 778 views
0 votes
1 answer

What are the relational operators available related to loading and storing in pig language?

Hey, For loading data and storing it into ...READ MORE

May 3, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 750 views
0 votes
1 answer

How data distribution is done in Hadoop?

To understand how or what are the process ...READ MORE

Apr 4, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 1,986 views
+1 vote
1 answer

what are the typicall block sizes in HDFS

HDFS is a block structured file system ...READ MORE

Apr 8, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 1,744 views
0 votes
1 answer

Explain to me to download a Hadoop documentation of a particular version.

I'll drop a link here which will ...READ MORE

May 7, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 513 views
0 votes
0 answers

What is the motivation behind developing Hive?

Hey, I am learning Hive in a basic ...READ MORE

May 9, 2019 in Big Data Hadoop by dyna
 • 498 views
0 votes
0 answers

How run wordcount on multi node hadoop using eclipse?

Apr 24, 2019 in Big Data Hadoop by حسين
 • 200 points
recategorized Apr 24, 2019 by Omkar • 1,128 views
0 votes
1 answer

Edge nodes in Hadoop

Namenodes and Datanodes are a part of ...READ MORE

Feb 19, 2019 in Big Data Hadoop by Siri
 • 3,862 views
0 votes
1 answer

How to read multiple files in hdfs?

If you want to read files with ...READ MORE

Feb 7, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 4,330 views
0 votes
0 answers

Nutch with hadoop 2.7 error "GC overhead limit exceeded"

I have a small cluster of 5 ...READ MORE

Apr 10, 2019 in Big Data Hadoop by Hafiz
 • 170 points • 1,645 views
–1 vote
1 answer

unable to start hive server

It seems that your hive server is ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 5,870 views
0 votes
1 answer

What is the difference in DistCP command and Sqoop command in Hadoop?

Both the distCP (Distributed copy in Hadoop) ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 1,548 views
0 votes
1 answer

Hey I am install Hadoop on single node and run program that file size is 3.2 GB and the time is 25 mins، Is this true or get less time. Thanks

Not sure what exactly you mean by ...READ MORE

Apr 22, 2019 in Big Data Hadoop by Shaam
 • 1,138 views
0 votes
1 answer

Explain to me the method to transfer data between Azure tables and Hadoop on Azure

this article on HiveStorageHandler will let you create ...READ MORE

May 3, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 604 views
+1 vote
1 answer

Need help Installing Sqoop on Windows.

Download Sqoop from this link: http://www.apache.org/dyn/closer.lua/sqoop/1.4.7 This link is ...READ MORE

Feb 25, 2019 in Big Data Hadoop by Chandu
 • 3,410 views
0 votes
1 answer

How to decide number of mappers?

The number of mapper depends on the ...READ MORE

Jan 31, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 4,559 views
0 votes
1 answer

Difference between hive.exec.compress.output=true; and mapreduce.output.fileoutputformat.compress=true;

Hey there! The definition of these two properties ...READ MORE

Dec 28, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 5,972 views
0 votes
1 answer

Hey ,I am install Hadoop and on single node and run on one file in HDFS, but I want to run more of file I work upload files but I know to running all

If you are talking about running multiple ...READ MORE

Apr 22, 2019 in Big Data Hadoop by Tina
 • 1,077 views
0 votes
1 answer

How to handle exceptions in Spark and Scala?

There is no particular format to handle ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 4,900 views
0 votes
1 answer

Deleting directory in Sqoop

You can use the --delete-target-dir : $ sqoop import ...READ MORE

Feb 11, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 3,963 views
0 votes
1 answer

Hadoop Java: org.apache.hadoop.conf.Configuration does not exist error

To solve this error, add hadoop-common to ...READ MORE

Nov 21, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 7,546 views
+1 vote
3 answers

when i tried to run the hdfs namenode -format command...its failed to run..can anyone help me with this???

Hi Suriyaprakash, I guess the path for hadoop ...READ MORE

Jul 23, 2018 in Big Data Hadoop by avi_man_utd
 • 12,272 views
0 votes
1 answer

Method to schedule the number of Mappers and Reducers in a Hadoop MapReduce Tsk.

The number of Mapper tasks for a ...READ MORE

Apr 25, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 797 views
0 votes
1 answer

Can I use Amazon Web Services for free?

If you would like to use AWS ...READ MORE

Apr 25, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 796 views
0 votes
1 answer

Why do we need the FOR EACH operation in Pig Scripts?

The operation FOREACH in Apache Pig is ...READ MORE

Apr 30, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 561 views
0 votes
1 answer

Connect to Hive using Pyhive

Here's how we can connect to Hive ...READ MORE

Jan 8, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 5,398 views
0 votes
1 answer

Copy files to all Hadoop DFS directories

Hi @Bhavish. There is no Hadoop command ...READ MORE

Feb 24, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 3,390 views
–1 vote
1 answer

Apache Spark - Nested JSON array to flatten columns

It depends on the structure of your ...READ MORE

Jan 2, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 5,659 views
0 votes
1 answer

Why do we need Hadoop framework?

The function of Distributes File System is ...READ MORE

Apr 10, 2019 in Big Data Hadoop by Gitika
 • 65,770 points
edited Apr 12, 2019 by Gitika • 1,403 views
0 votes
1 answer

Writing File into HDFS using spark scala

The reason you are not able to ...READ MORE

Apr 6, 2018 in Big Data Hadoop by kurt_cobain
 • 9,350 points • 17,339 views
0 votes
0 answers

I was trying to imlement giraph code but difficult to implement I dont know which method I will follow for solution I have already jar files

May 2, 2019 in Big Data Hadoop by anonymous
recategorized May 2, 2019 by Omkar • 452 views
0 votes
1 answer

Why we need to install "ant -Dhadoopversion=23" ? What is the use of this?

Hi, We install ant to build pig, If the ...READ MORE

Apr 26, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 659 views
0 votes
1 answer

Installing Oozie on Linux System

Download Oozie from this link: http://www.apache.org/dyn/closer.lua/oozie/ Extract the files. ...READ MORE

Feb 28, 2019 in Big Data Hadoop by Rajan
 • 3,123 views
0 votes
1 answer

I am install hadoop on signal node and run program but delay time if have dataset size 3.3 GB take time about 2 hours

Hey @Faris! Try increasing the number of reducers. ...READ MORE

Apr 12, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 1,196 views
0 votes
1 answer

Why sqoop internally generates MapRed code?

By default Sqoop always create 4 Map ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 1,242 views
0 votes
1 answer

Command to establish connection between MySql with linux?

This is the command you can use ...READ MORE

Apr 15, 2019 in Big Data Hadoop by Gitika
 • 65,770 points
edited Apr 18, 2019 by Gitika • 1,027 views
0 votes
2 answers

Hadoop fs -stat command

hadoop fs -stat is as hadoop command used ...READ MORE

Oct 25, 2018 in Big Data Hadoop by Omkar
 • 69,220 points • 11,315 views
0 votes
1 answer

Elastisearch Hadoop

I will redirect you to a repository ...READ MORE

Apr 24, 2019 in Big Data Hadoop by ravikiran
 • 4,620 points • 631 views
0 votes
1 answer

How to install Hadoop on Windows system?

First you need to download Hadoop files. ...READ MORE

Feb 20, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 3,310 views
–1 vote
1 answer

"main" java.lang.ClassNotFoundException: WordCount

When you are running a jar file ...READ MORE

Jan 22, 2019 in Big Data Hadoop by Omkar
 • 69,220 points • 4,573 views
0 votes
1 answer

Which MySql command will generate all the list of command for MySql prompt?

The command is very simple, you have ...READ MORE

Apr 15, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 842 views
0 votes
1 answer

How Sqoop import command works internally?

First when client execute Sqoop import commands through ...READ MORE

Apr 11, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 1,018 views
0 votes
1 answer

What command is used to install MySql in centos?

You can use this command to install ...READ MORE

Apr 12, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 946 views
0 votes
1 answer

How to create table inside database in MySql in Linux?

We can use this command to create ...READ MORE

Apr 16, 2019 in Big Data Hadoop by Gitika
 • 65,770 points • 800 views
0 votes
1 answer

File formats in Hadoop?

File format is just a way to ...READ MORE

Apr 9, 2019 in Big Data Hadoop by Gitika
 • 65,770 points
edited Apr 12, 2019 by Gitika • 1,045 views
0 votes
1 answer

What can you do with sqoop in Hadoop ecosystem?

Scoop came into scenario because there were tools ...READ MORE

Apr 8, 2019 in Big Data Hadoop by Gitika
 • 65,770 points
edited Apr 8, 2019 by Gitika • 1,063 views
Page:

Most popular tags

"PMP®","PMI®", "PMI-ACP®" and "PMBOK®" are registered marks of the Project Management Institute, Inc. MongoDB®, Mongo and the leaf logo are the registered trademarks of MongoDB, Inc.