What do we exactly mean by Hadoop the definition of Hadoop

Question

It is kind of obvious that we can call HDFS + YARN + MapReduce as Hadoop. But what we call it as when other products in the Hadoop ecosystem combined with each other? for example, HDFS + YARN + Spark and HBASE still Hadoop? I guess we consider HDFS + YARN + Pig Hadoop, since Pig uses MapReduce. Are only the MapReduce tools considered Hadoop, but anything else run on HDFS + YARN(like Spark) is non Hadoop?

score 0 · Answer 1 · Mar 16, 2018

The official definition of Apache Hadoop given by Apache Software Foundation: ( http://hadoop.apache.org/#What+Is+Apache+Hadoop%3F)

The Apache™ Hadoop® project develops open-source software for reliable, scalable, distributed computing.

The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures.

I would say, Hadoop Ecosystem is neither a programming language nor a service, it is a platform or framework which solves big data problems. You can consider it as a suite which encompasses a number of services (ingesting, storing, analyzing and maintaining) inside it.