Classpath Construction for MapReduce
The classpath that is used to run a MapReduce program is constructed based on how the program is submitted.
When you submit a job or application from the command line, the classpath used to process the program is based on the following items in this order of priority:
- JARs in the program’s classpath, such as the hadoop 1.x, hadoop 2.x, or yarn classpath.
- JARs specified with the
-libjar
parameter which can be appended tohadoop jar
oryarn jar
commands.
If an external application submits the job or application, the classpath that is used to process the jar file is based on the following items in this order of priority:
- JARs in the classpath of the external application.
- JARs in the program’s classpath, such as the hadoop 1.x, hadoop 2.x, or yarn classpath.
- JARs specified with
-libjar
parameter which can be appended tohadoop jar
oryarn jar
commands.