MapR 5.1 is at End of Life (EOL) and no longer supported. Please see the latest documentation. This documentation is not being updated.

5.1 Ecosystem
This guide contains a section for each open source project that MapR supports. You can learn how to install, configure, use, and integrate each project within the context of a MapR cluster.
- AsyncHBase
- Cascading
- Drill
- Flume
- HBase
- HCatalog
- Hive
- HttpFS
- Hue
- Impala
- Mahout
- Myriad
- Oozie
- Pig
- OpenStack Sahara (Mitaka)
- Sentry
- Spark
  - Spark Feature Support
    MapR supports most Spark features. However, there a few exceptions.
  - Spark Standalone
  - Spark on YARN
    - Installing Spark on YARN
    - Upgrading Spark on YARN
    - Configuring Spark on YARN
      - Configure MapR Client Node to Run Spark Applications
        When Spark runs on YARN, MapR client nodes require the hadoop-yarn-server-web-proxy JAR file to run Spark applications. A MapR client node (a node with the mapr-client package, but without mapr-core packages) is also known as an edge node.
      - Configure Spark JAR Location
      - Configure Spark with the NodeManager Local Directory Set to MapR-FS
      - Security for Spark on YARN
    - Using Spark on YARN
      This section includes information about using Spark on YARN in a MapR cluster.
  - Integrating Spark
  - Spark 2.0.0 Developer Preview
    Apache Spark is an open-source processing engine that you can use to process Hadoop data. Although MapR does not yet ship a Spark 2.0.0 package, you can install and use Spark 2.0.0 on a non-secure MapR 5.1 cluster or on a secure MapR 5.1 cluster that uses MapR-SASL authentication.
- Sqoop
- Storm
- Third Party Solutions

Configure Spark JAR Location

About this task

By default, Spark on YARN uses a Spark JAR file that is installed locally. The Spark JAR file can also be added to a world-readable location on MapR-FS. When you add the JAR file to a world-readable location, YARN can cache it on nodes to avoid distributing it each time an application runs. Complete the following steps to add the Spark JAR file to a world-readable location on MapR-FS:

Procedure

Copy the following JAR file from the local file system to a world-readable location on MapR-FS: Substitute your Spark version and specific JAR file name in the command.
```
/opt/mapr/spark/spark-<version>/lib/spark-assembly-<version>-hadoop<version>-mapr-<version>.jar
```
Set the spark.yarn.jar property in the spark-defaults.conf file to point to the world-readable location where you added the Spark JAR file. For example:
```
spark.yarn.jar      maprfs:///<path to jar>
```