Resource Allocation for Jobs and Applications
Warden determines the percentage of resources available for MapReduce v1 jobs and
applications based on the warden.conf file. Applications include MapReduce v2 and
non-MapReduce applications such as Spark. Note: If you modify the values in warden.conf,
you must restart Warden.
The percent of resources allocated for YARN and MapReduce v1 jobs is based on the values of
the following parameters in warden.conf:
| Parameter | Default | Description |
|---|---|---|
mr1.memory.percent
|
50 | The percentage of memory allocated to MapReduce v1 jobs.The remaining memory is allocated to applications. |
mr1.cpu.percent
|
50 | The percentage of CPUs allocated to MapReduce v1 jobs.The remaining CPUs are allocated to applications. |
mr1.disk.percent
|
50 | The percentage of disks allocated to MapReduce v1 jobs.The remaining disks are allocated to applications. |
These values only apply when TaskTracker and NodeManager roles
are installed on a node. For example, if TaskTracker is not
installed on the node, NodeManager will get 100% of the resources
available to process applications regardless of the
warden.conf settings. Similarly, if NodeManager is not
installed on the node, TaskTracker will get 100% of the resources
available to process MapReduce jobs regardless of the
warden.conf settings.
This section includes the following topics: