Submitting Jobs and Applications to the Cluster

You can submit MapReduce v1 jobs and YARN applications (MapReduce v2 and other applications that run on YARN) to the same cluster. A job or an application can be submitted to the cluster in the following ways:

• The hadoop jar command submits a MapReduce v1 job or MapReduce v2 application.
• The yarn jar command submits an application.
• An external application submits a MapReduce v1 job or an application.
• An ecosystem component generates and submits an application or a MapReduce v1 job.
• The hadoop job command submits a MapReduce v1 job or MapReduce v2 application.
• The mapred job command submits a MapReduce v2 application.

When you submit a MapReduce v1 job or MapReduce v2 application to the cluster, it is important to be aware of the MapReduce mode that will be used.

When you submit a non-MapReduce job or application to the cluster, such a Spark application, the application is automatically processed using yarn mode (ResourceManager, NodeManager, and MapReduce ApplicationMaster).