JobTracker Directories
When changing any parameters in this section, a JobTracker restart is required.
Volume path = mapred.system.dir/../
|
Parameter |
Description |
|---|---|
|
mapred.system.dir |
The shared directory where MapReduce stores control files. Default value: |
|
mapred.job.tracker.persist.jobstatus.dir |
The directory where the job status information is persisted in a file system to be available after it drops of the memory queue and between JobTracker restarts. Default value:
|
|
mapreduce.jobtracker.staging.root.dir |
The root of the staging area for users' job files In practice, this should be the directory where users' home directories are located (usually /user) Default value: |
|
mapreduce.job.split.metainfo.maxsize |
The maximum permissible size of the split metainfo file. The JobTracker won't attempt to read split metainfo files bigger than the configured value. No limits if set to -1. Default value: |
|
mapreduce.maprfs.use.compression |
Set this property's value to False to disable the use of MapR-FS compression for shuffle data by MapReduce. Default value: |
|
mapred.jobtracker.retiredjobs.cache.size |
The number of retired job status to keep in the cache. Default value: |
|
mapred.job.tracker.history.completed.location |
The completed job history files are stored at this single well known location. If nothing is specified, the files are stored at ${hadoop.job.history.location}/done in local filesystem. Default value:
|
|
hadoop.job.history.location |
If job tracker is static the history files are stored in this single well known place on local filesystem. If No value is set here, by default, it is in the local file system at ${hadoop.log.dir}/history. History files are moved to mapred.jobtracker.history.completed.location which is on MapRFs JobTracker volume. |
|
mapred.jobtracker.jobhistory.lru.cache.size |
The number of job history files loaded in memory. The jobs are loaded when they are first accessed. The cache is cleared based on LRU. Default value: |