MapR 5.1 is at End of Life (EOL) and no longer supported. Please see the latest documentation. This documentation is not being updated.

Home
5.1 Administration
This section contains administration information such as managing your cluster, data, users, jobs and security information such as configuring your security environment and auditing.
Administrator Guide
Cluster Resource Allocation
Resource Allocation for Jobs and Applications
MapReduce v1 Job Resource Allocation
Criteria for Map Slot Calculation

MapR 5.1 Documentation

5.1 Administration
This section contains administration information such as managing your cluster, data, users, jobs and security information such as configuring your security environment and auditing.
- Administrator Guide
  - Managing Users and Groups
  - Managing Licenses
  - Managing the Cluster
  - Managing Data with Volumes
  - Monitoring the Cluster
  - Cluster Resource Allocation
    - Memory Allocation for Nodes
    - Resource Allocation for Jobs and Applications
      - YARN Container Resources
      - MapReduce v1 Job Resource Allocation
        Criteria for Map Slot Calculation
        Criteria for Reduce Slot Calculation
        Example Map and Reduce Slot Calculation
        Customizing the MapReduce v1 Slot Calculation Parameters
        In general, you should not need to customize the number of map and reduce slots because Warden determines these value based on the resource available on the node. However, you can override the number of slots by adding one or more of these parameters to mapred-site.xml. The mapred-site.xml file for MapReduce v1 jobs is in the following location: /opt/mapr/hadoop/hadoop-0.20.2/conf/mapred-site.xml.
  - Managing the MapReduce Mode
  - Managing Jobs and Applications
  - Maintenance Schedule
  - YARN Cgroups
  - JobTracker High Availability
  - Node Manager Restart
  - ResourceManager High Availability
  - Performance Tuning
  - Troubleshooting Cluster Administration
- Security Guide

Criteria for Map Slot Calculation

MapR Hadoop sets the number of map slots to the lowest value that results from the following memory, CPU, and disk calculations:

Memory calculation = (0.4* memory available to process MapReduce v1 tasks)/ memory for each map slot
CPU calculation:
- If # CPUs on the node > 2, then CPU calculation is = number of CPU on the node – the number of CPUs assigned to MapR-FS. Note: The number of CPUs available to the MapR-FS is 4 for an Enterprise Database Edition installation. Otherwise, the value is 2.
- If # CPUs on the node <= 2, the CPU calculation = 1.
Disk calculation= 2 * the number of disks available to MapR-FS