How to access Hadoop Data using REST service

Question

I am trying to update HDP architecture so data residing in Hive tables can be accessed by REST APIs. What are the best approaches how to expose data from HDP to other services?

This is my initial idea:

I am storing data in Hive tables and I want to expose some of the information through REST API, therefore, I thought that using HCatalog/WebHCat would be the best solution. However, I found out that it allows only to query metadata.

Answer 1

The REST API gateway for the Apache Hadoop Ecosystem is called KNOX

You can very well use WebHDFS which is basically a REST Service over Hadoop.

Please see the documentation below:

https://hadoop.apache.org/docs/r1.0.4/webhdfs.html