Open Source Insider

Nov 29 2017   8:48AM GMT

Apache Impala, a native analytics database for Hadoop

Adrian Bridgwater Adrian Bridgwater Profile: Adrian Bridgwater

Tags:

The Apache Software Foundation (ASF) has graduated Apache Impala to become a Top-Level Project (TLP).

Apache Impala itself is an analytic database for Apache Hadoop, the open source software framework used for distributed storage and processing of dataset of big data.

This TLP status is intended to signify that the project’s community and products have been well-governed under the ASF’s meritocratic process and principles.

Massively parallel processing

Impala is built with what is known as a massively parallel processing (MPP) SQL query engine. This allows analytical queries on data stored on-premises (in HDFS or Apache Kudu) or in cloud object storage via SQL or business intelligence tools.

“The Impala project has grown a lot since we entered incubation in December 2015,” said Jim Apple, VP of Apache Impala.

In addition to using the same unified storage platform as other Hadoop components, Impala also uses the same metadata, SQL syntax (Apache Hive SQL), ODBC driver and user interface (Impala query UI in Hue) as Hive.

Inspired by Google

Impala was inspired by Google’s F1 database, which also separates query processing from storage management..

“In 2011, we started development of Impala in order to make state-of-the-art SQL analytics available to the user community as open source technology,” said Marcel Kornacker, original founder of the Impala project.

Apache Impala is deployed across a number of industries such as financial services, healthcare and telecommunications — and is in use at companies that include Caterpillar, Cox Automotive and the New York Stock Exchange — in addition, Impala is shipped by Cloudera, MapR and Oracle.

 Comment on this Post

 
There was an error processing your information. Please try again later.
Thanks. We'll let you know when a new response is added.
Send me notifications when other members comment.

Forgot Password

No problem! Submit your e-mail address below. We'll send you an e-mail containing your password.

Your password has been sent to:

Share this item with your network: