MapR 5.1 is at End of Life (EOL) and no longer supported. Please see the latest documentation. This documentation is not being updated.

Home
5.1 Administration
This section contains administration information such as managing your cluster, data, users, jobs and security information such as configuring your security environment and auditing.
Administrator Guide
Cluster Resource Allocation
Resource Allocation for Jobs and Applications
MapReduce v1 Job Resource Allocation

MapR 5.1 Documentation

5.1 Administration
This section contains administration information such as managing your cluster, data, users, jobs and security information such as configuring your security environment and auditing.
- Administrator Guide
  - Managing Users and Groups
  - Managing Licenses
  - Managing the Cluster
  - Managing Data with Volumes
  - Monitoring the Cluster
  - Cluster Resource Allocation
    - Memory Allocation for Nodes
    - Resource Allocation for Jobs and Applications
      - YARN Container Resources
      - MapReduce v1 Job Resource Allocation
        Criteria for Map Slot Calculation
        Criteria for Reduce Slot Calculation
        Example Map and Reduce Slot Calculation
        Customizing the MapReduce v1 Slot Calculation Parameters
        In general, you should not need to customize the number of map and reduce slots because Warden determines these value based on the resource available on the node. However, you can override the number of slots by adding one or more of these parameters to mapred-site.xml. The mapred-site.xml file for MapReduce v1 jobs is in the following location: /opt/mapr/hadoop/hadoop-0.20.2/conf/mapred-site.xml.
  - Managing the MapReduce Mode
  - Managing Jobs and Applications
  - Maintenance Schedule
  - YARN Cgroups
  - JobTracker High Availability
  - Node Manager Restart
  - ResourceManager High Availability
  - Performance Tuning
  - Troubleshooting Cluster Administration
- Security Guide

MapReduce v1 Job Resource Allocation

When a MapReduce v1 job is submitted to JobTracker, JobTracker determines which TaskTracker nodes can process the map and reduce tasks based on the available map and reduce slots. Map and reduce slots are allocated based on the memory available to process MapReduce V1 jobs, and the number of CPUs and Disks available to MapR-FS.

In general, you should not need to customize the number of map and reduce slots. However, you can configure the parameters that are used to calculate the values. For more information, see Customizing the MapReduce v1 Slot Calculation Parameters.

The following sections provide additional information about map and reduce slot calculation: