Functions of Spark SQL

Question

I am working on a problem of Finance domain and I've 2 GB of data. I want to perform some Sql operations to get the desired result. Can anyone please explain me what all are the functions of Spark SQL?

Thanks in advance!

Answer 1

Spark SQL is capable of:

• Loading data from a variety of structured sources.
• Querying data using SQL statements, both inside a Spark program and from external tools that connect to Spark SQL through standard database connectors (JDBC/ODBC). For instance, using business intelligence tools like Tableau. 
• Providing rich integration between SQL and regular Python/Java/Scala code, including the ability to join RDDs and SQL tables, expose custom functions in SQL, and more.

Hope this helps!