Coffee Talk: Java, News, Stories and Opinions

Aug 14 2016   2:26PM GMT

Install and Run Apache Spark 2.x

anishp1313 Profile: anishp1313

Tags:
Uncategorized
1.Objective:

This guide contains step by step documentation of installation and setup procedure of Spark 2.x installation / configuration in standalone mode on Ubuntu OS. Standalone mode in a Spark is setting the system without any existing cluster management software (like Yarn Resource Manager / Mesos).   We have spark master and spark worker who allocate driver and executors for Spark application in Standalone mode. Once the installation is done you can process the data via creating RDD (Resilient Distributed Dataset) and running transformation and action operations.

 
2. Platform
2.1. Platform Requirements
Operating system: Ubuntu 14.04 or later, we can also use other Linux flavors like: CentOS, Redhat, etc.

 Comment on this Post

 
There was an error processing your information. Please try again later.
Thanks. We'll let you know when a new response is added.
Send me notifications when other members comment.

Forgot Password

No problem! Submit your e-mail address below. We'll send you an e-mail containing your password.

Your password has been sent to:

Share this item with your network: