Default YARN Parameters
| Parameter | Description |
| mapreduce.job.hdfs-servers | Default value: ${fs.defaultFS} Default source: yarn-default.xml |
| yarn.acl.enable | Indicates whether ACLs are enabled. Default value: FALSE Default source: yarn-default.xml |
| yarn.admin.acl | ACL of who can be admin of the YARN cluster. Default value: * Default source: yarn-default.xml |
| yarn.am.liveness-monitor.expiry-interval-ms | The expiry interval for application master reporting. Default value: 600000 Default source: yarn-default.xml |
| yarn.client.application-client-protocol.poll-interval-ms | The interval that the yarn client library uses to poll the completion status of the asynchronous API of application client protocol. Default value: 200 Default source: yarn-default.xml |
| yarn.client.failover-proxy-provider |
When HA is enabled, the class to be used by Clients, AMs and NMs to failover to the Active RM. It should extend org.apache.hadoop.yarn.client.RMFailoverProxyProvider. Default value: org.apache.hadoop.yarn.client.ConfiguredRMFailoverProxyProvider Default source: yarn-default.xml When you configure failover configure.sh may change the default value by adding a value for this parameter in yarn-site.xml. For more information, see ResourceManager Configuration Properties. |
| yarn.client.failover-retries | When HA is enabled, the number of retries per attempt to connect to a ResourceManager. In other words, it is the ipc.client.connect.max.retries to be used during failover attempts. Default value: 0 Default source: yarn-default.xml |
| yarn.client.failover-retries-on-socket-timeouts | When HA is enabled, the number of retries per attempt to connect to a ResourceManager on socket timeouts. In other words, it is the ipc.client.connect.max.retries.on.timeouts to be used during failover attempts. Default value: 0 Default source: yarn-default.xml |
| yarn.client.max-nodemanagers-proxies | Maximum number of proxy connections for node manager. It should always be more than 1. NMClient and MRAppMaster will use this to cache connection with node manager. There will be at max one connection per node manager. Ex. configuring it to a value of 5 will make sure that client will at max have 5 connections cached with 5 different node managers. These connections will be timed out if idle for more than system wide idle timeout period. The token if used for authentication then it will be used only at connection creation time. If new token is received then earlier connection should be closed in order to use newer token. This and (yarn.client.nodemanager-client-async.thread-pool-max-size) are related and should be sync (no need for them to be equal). Default value: 0 Default source: yarn-default.xml |
| yarn.client.nodemanager-client-async.thread-pool-max-size | Max number of threads in NMClientAsync to process container management events. Default value: 500 Default source: yarn-default.xml |
| yarn.client.nodemanager-connect.max-wait-ms | Default value: 900000 Default source: yarn-default.xml |
| yarn.client.nodemanager-connect.retry-interval-ms | Default value: 10000 Default source: yarn-default.xml |
| yarn.dfs-logging.dir-glob | Default value: maprfs:////var/mapr/local/*/logs/yarn/userlogs Default source: Code |
| yarn.dfs-logging.handler-class | Default value:com.mapr.hadoop.yarn.util.MapRFSLoggingHandler Default source: Code |
| yarn.external.token.manager | Default value: com.mapr.hadoop.yarn.security.MapRTicketManager Default source: Code |
| yarn.http.policy | Configures the HTTP endpoint for YARN Daemons.The following values are supported: -HTTP_ONLY : Service is provided only on http -HTTPS_ONLY : Service is provided only on https Default value: HTTP_ONLY Default source: yarn-default.xml |
| yarn.ipc.rpc.class |
RPC class implementation. Default value: org.apache.hadoop.yarn.ipc.HadoopYarnProtoRPC Default source: yarn-default.xml |
| yarn.log-aggregation.retain-check-interval-seconds |
How long to wait between aggregated log retention checks. If set to 0 or a negative value, then the value is computed as one-tenth of the aggregated log retention time. Default value: -1 Default source: yarn-default.xml See YARN Log Aggregation. |
| yarn.log-aggregation.retain-seconds |
How long to keep aggregation logs before deleting them. -1 disables. Default value: 2592000 Default source: code See YARN Log Aggregation. |
| yarn.log-aggregation-enable |
Whether to enable log aggregation. Default value: FALSE Default source: yarn-default.xml See YARN Log Aggregation. |
| yarn.mapr.ticket.expiration | Default value: 604800000 Default source: code |
| yarn.nm.liveness-monitor.expiry-interval-ms | How long to wait until a NodeManager is considered dead. Default value: 600000 Default source: yarn-default.xml |
| yarn.nodemanager.address | The address of the container manager in the NM. Default value: ${yarn.nodemanager.hostname}:0 Default source: yarn-default.xml |
| yarn.nodemanager.admin-env | Environment variables that should be forwarded from the NodeManager's environment to the container's environment. Default value: MALLOC_ARENA_MAX=$MALLOC_ARENA_MAX Default source: yarn-default.xml |
| yarn.nodemanager.aux-services | The valid service name should only contain a-zA-Z0-9_ and can not start with numbers Default value: mapreduce_shuffle,mapr_direct_shuffle Default source: code |
| yarn.nodemanager.aux-services.mapr_direct_shuffle.class | Default value: com.mapr.hadoop.mapred.LocalVolumeAuxService Default source: code |
| yarn.nodemanager.aux-services.mapreduce_shuffle.class |
Default value: org.apache.hadoop.mapred.ShuffleHandler Default source: yarn-default.xml |
| yarn.nodemanager.container-executor.class | Identifies who will execute (launch) the containers. Default value: org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor Default source: code |
| yarn.nodemanager.container-manager.thread-count | Number of threads the container manager uses. Default value: 20 Default source:yarn-default.xml |
| yarn.nodemanager.container-monitor.interval-ms | How often to monitor containers. Default value: 3000 Default source: yarn-default.xml |
| yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled | Default value: FALSE Default source: yarn-default.xml |
| yarn.nodemanager.delete.debug-delay-sec | Number of seconds after an application finishes before the NodeManager's DeletionService will delete the application's localized file directory and log directory. To diagnose Yarn application problems, set this property's value large enough (for example, to 600 = 10 minutes) to permit examination of these directories. After changing the property's value, you must restart the NodeManager in order for it to have an effect. The roots of Yarn applications' work directories are configurable with the yarn.nodemanager.local-dirs property (see below), and the roots of the Yarn applications' log directories is configurable with the yarn.nodemanager.log-dirs property (see also below). Default value: 0 Default source: yarn-default.xml |
| yarn.nodemanager.delete.thread-count | Number of threads used in cleanup. Default value: 4 Default source: yarn-default.xml |
| yarn.nodemanager.disk-health-checker.interval-ms | Frequency of running disk health checker code. Default value: 1200000 Default source: yarn-default.xml |
| yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage | Default value: 90 Default source: yarn-default.xml |
| yarn.nodemanager.disk-health-checker.min-free-space-per-disk-mb | Default value: 0 Default source: yarn-default.xml |
| yarn.nodemanager.disk-health-checker.min-healthy-disks |
The minimum fraction of number of disks to be healthy for the nodemanager to launch new containers. This correspond to both yarn-nodemanager.local-dirs and yarn.nodemanager.log-dirs. i.e. If there are less number of healthy local-dirs (or log-dirs) available, then new containers will not be launched on this node. Default value: 0.25 Default source: yarn-default.xml |
| yarn.nodemanager.docker-container-executor.exec-name | Default value: /usr/bin/docker Default source: yarn-default.xml |
| yarn.nodemanager.env-whitelist |
Environment variables that containers may override rather than use NodeManager's default. Default value: JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,HADOOP_YARN_HOME Default source: yarn-default.xml |
| yarn.nodemanager.external.token.localizer | Default value: com.mapr.hadoop.yarn.nodemanager.MapRTicketLocalizer Default source: code |
| yarn.nodemanager.health-checker.interval-ms | Frequency of running node health script. Default value: 600000 Default source: yarn-default.xml |
| yarn.nodemanager.health-checker.script.timeout-ms | Script time out period. Default value: 1200000 Default source: yarn-default.xml |
| yarn.nodemanager.hostname | The hostname of the NM. Default value: 0.0.0.0 Default source: yarn-default.xml |
| yarn.nodemanager.keytab | Keytab for NM. Default value: /etc/krb5.keytab Default source: yarn-default.xml |
| yarn.nodemanager.linux-container-executor.cgroups.hierarchy | The cgroups hierarchy under which to place YARN proccesses (cannot contain commas). If yarn.nodemanager.linux-container-executor.cgroups.mount is false (that is, if cgroups have been pre-configured), then this cgroups hierarchy must already exist and be writable by the NodeManager user, otherwise the NodeManager may fail. Only used when the LCE resources handler is set to the CgroupsLCEResourcesHandler. Default value: /hadoop-yarn Default source: yarn-default.xml |
| yarn.nodemanager.linux-container-executor.cgroups.mount | Whether the LCE should attempt to mount cgroups if not found. Only used when the LCE resources handler is set to the CgroupsLCEResourcesHandler. Default value: false Default source: yarn-default.xml |
| yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usage | Default value: FALSE Default source: yarn-default.xml |
| yarn.nodemanager.linux-container-executor.nonsecure-mode.limit-users | Default value: TRUE Default source: yarn-default.xml |
| yarn.nodemanager.linux-container-executor.nonsecure-mode.local-user | Default value: nobody Default source: yarn-default.xml |
| yarn.nodemanager.linux-container-executor.nonsecure-mode.user-pattern | The allowed pattern for UNIX user names enforced by Linux-container-executor when used in nonsecure mode (use case for this is using cgroups). The default value is taken from /usr/sbin/adduser. Default value: ^[_.A-Za-z0-9][-@_.A-Za-z0-9]{0,255}?[$]?$ Default source: yarn-default.xml |
| yarn.nodemanager.linux-container-executor.resources-handler.class | The class which should help the LCE handle resources. Default value: org.apache.hadoop.yarn.server.nodemanager.util.DefaultLCEResourcesHandler Default source: yarn-default.xml |
| yarn.nodemanager.local-cache.max-files-per-directory | It limits the maximum number of files which will be localized in a single local directory. If the limit is reached then sub-directories will be created and new files will be localized in them. If it is set to a value less than or equal to 36 [which are sub-directories (0-9 and then a-z)] then NodeManager will fail to start. For example; [for public cache] if this is configured with a value of 40 ( 4 files + 36 sub-directories) and the local-dir is /tmp/local-dir1, then it will allow 4 files to be created directly inside /tmp/local-dir1/filecache. For files that are localized further, it will create a sub-directory "0" inside /tmp/local-dir1/filecache and will localize files inside it until it becomes full. If a file is removed from a sub-directory that is marked full, then that sub-directory will be used back again to localize files. Default value: 8192 Default source: yarn-default.xml |
| yarn.nodemanager.local-dirs | List of directories to store localized files in. An application's localized file directory will be found in: ${yarn.nodemanager.local-dirs}/usercache/${user}/appcache/application_${appid}. Individual containers' work directories, called container_${contid}, will be subdirectories of this. Default value: ${hadoop.tmp.dir}/nm-local-dir Default source: yarn-default.xml |
| yarn.nodemanager.localizer.address | Address where the localizer IPC is. Default value: ${yarn.nodemanager.hostname}:8040 |
| yarn.nodemanager.localizer.cache.cleanup.interval-ms | Interval in between cache cleanups. Default value: 60000 Default source: yarn-default.xml |
| yarn.nodemanager.localizer.cache.target-size-mb | Target size of localizer cache in MB, per local directory. Default value: 10240 Default source: yarn-default.xml |
| yarn.nodemanager.localizer.client.thread-count | Number of threads to handle localization requests. Default value: 5 Default source: yarn-default.xml |
| yarn.nodemanager.localizer.fetch.thread-count | Number of threads to use for localization fetching. Default value: 4 Default source: yarn-default.xml |
| yarn.nodemanager.log.retain-seconds | Time in seconds to retain user logs. Only applicable if log aggregation is disabled. Default value: 10800 Default source: yarn-default.xml |
| yarn.nodemanager.log-aggregation.compression-type | T-file compression types used to compress aggregated logs. Default value: none Default source: yarn-default.xml |
| yarn.nodemanager.log-aggregation.roll-monitoring-interval-seconds | Default value: -1 Default source: yarn-default.xml |
| yarn.nodemanager.log-dirs | Where to store container logs. An application's localized log directory will be found in ${yarn.nodemanager.log-dirs}/application_${appid}. Individual containers' log directories will be below this, in directories named container_{$contid}. Each container directory will contain the files stderr, stdin, and syslog generated by that container. Default value: ${yarn.log.dir}/userlogs Default source: yarn-default.xml |
| yarn.nodemanager.pmem-check-enabled | Whether physical memory limits will be enforced for containers. Default value: true Default source: yarn-default.xml |
| yarn.nodemanager.process-kill-wait.ms | Max time to wait for a process to come up when trying to cleanup a container. Default value: 2000 Default source: yarn-default.xml |
| yarn.nodemanager.recovery.enabled | Default value: FALSE Default source: yarn-default.xml |
| yarn.nodemanager.remote-app-log-dir | Where to aggregate logs to. Default value: /tmp/logs Default source: yarn-default.xml |
| yarn.nodemanager.remote-app-log-dir-suffix | The remote log dir will be created at {yarn.nodemanager.remote-app-log-dir}/${user}/{thisParam} Default value: logs Default source: yarn-default.xml |
| yarn.nodemanager.resource.cpu-vcores |
Number of CPU cores that can be allocated for containers. Default value: ${nodemanager.resource.cpu-vcores} Default source: code |
| yarn.nodemanager.resource.io-spindles | Default value: ${nodemanager.resource.io-spindles} Default source: code |
| yarn.nodemanager.resource.memory-mb |
Amount of physical memory, in MB, that can be allocated for containers. Default value: ${nodemanager.resource.memory-mb} Default source: code |
| yarn.nodemanager.resource.percentage-physical-cpu-limit | Default value: 100 Default source: yarn-default.xml |
| yarn.nodemanager.resourcemanager.minimum.version | The minimum allowed version of a resourcemanager that a nodemanager will connect to. The valid values are NONE (no version checking), EqualToNM (the resourcemanager's version is equal to or greater than the NM version), or a Version String. Default value: NONE Default source: yarn-default.xml |
| yarn.nodemanager.sleep-delay-before-sigkill.ms | Number of ms to wait between sending a SIGTERM and SIGKILL to a container. Default value: 250 Default source: yarn-default.xml |
| yarn.nodemanager.vmem-check-enabled | Whether virtual memory limits will be enforced for containers. Default value: false Default source: yarn-default.xml |
| yarn.nodemanager.vmem-pmem-ratio | Ratio between virtual memory to physical memory when setting memory limits for containers. Container allocations are expressed in terms of physical memory, and virtual memory usage is allowed to exceed this allocation by this ratio. Default value: 2.1 Default source: yarn-default.xml |
| yarn.nodemanager.webapp.address | NM Webapp address. Default value: ${yarn.nodemanager.hostname}:8042 Default source: yarn-default.xml |
| yarn.nodemanager.windows-container.cpu-limit.enabled | Default value: FALSE Default source: yarn-default.xml |
| yarn.nodemanager.windows-container.memory-limit.enabled | Default value: FALSE Default source: yarn-default.xml |
| yarn.resourcemanager.address |
The address of the applications manager interface in the ResourceManager. Default value: ${yarn.resourcemanager.hostname}:8032 Default source: yarn-default.xml When you configure failover configure.sh may change the default value by adding a value for this parameter in yarn-site.xml. For more information, see ResourceManager Configuration Properties. |
| yarn.resourcemanager.admin.address |
The address of the ResourceManager admin interface. Default value: ${yarn.resourcemanager.hostname}:8033 Default source: yarn-default.xml When you configure failover configure.sh may change the default value by adding a value for this parameter in yarn-site.xml. For more information, see ResourceManager Configuration Properties. |
| yarn.resourcemanager.admin.client.thread-count | Number of threads used to handle the ResourceManager admin interface. Default value: 1 Default source: yarn-default.xml |
| yarn.resourcemanager.am.max-attempts | The maximum number of application attempts. This is a global setting for all ApplicationMasters. Each ApplicationMaster can specify its individual maximum number of application attempts via the API, but the individual number cannot be more than the global upper bound. If it is, the ResourceManager will override it. The default number is set to 2, to allow at least one retry for the ApplicationMaster. Default value: 2 Default source: yarn-default.xml |
| yarn.resourcemanager.application-tokens.master-key-rolling-interval-secs | Interval for the roll over for the master key used to generate application tokens. Default value: 86400 Default source: yarn-default.xml |
| yarn.resourcemanager.aux-services | Default value: RMVolumeManager Default source: code |
| yarn.resourcemanager.aux-services.HSVolumeManager.class | Default value: com.mapr.hadoop.yarn.resourcemanager.RMVolumeManager Default source: code |
| yarn.resourcemanager.aux-services.RMVolumeManager.class | Default value: com.mapr.hadoop.yarn.resourcemanager.RMVolumeManager Default source: code |
| yarn.resourcemanager.client.thread-count | The number of threads used to handle applications manager requests. Default value: 50 Default source: yarn-default.xml |
| yarn.resourcemanager.configuration.provider-class | Default value: org.apache.hadoop.yarn.LocalConfigurationProvider Default source: yarn-default.xml |
| yarn.resourcemanager.connect.max-wait.ms | Maximum time to wait to establish connection to the ResourceManager. Default value: 900000 Default source: yarn-default.xml |
| yarn.resourcemanager.connect.retry-interval.ms | How often to retry connecting to the ResourceManager. Default value: 30000 Default source: yarn-default.xml |
| yarn.resourcemanager.container.liveness-monitor.interval-ms | How often to check that containers are still alive. Default value: 600000 Default source: yarn-default.xml |
| yarn.resourcemanager.container-tokens.master-key-rolling-interval-secs | Interval for the roll over for the master key used to generate container tokens. It is expected to be much greater than yarn.nm.liveness-monitor.expiry-interval-ms and yarn.rm.container-allocation.expiry-interval-ms. Otherwise the behavior is undefined. Default value: 86400 Default source: yarn-default.xml |
| yarn.resourcemanager.delayed.delegation-token.removal-interval-ms | Interval at which the delayed token removal thread runs. Default value: 30000 Default source: yarn-default.xml |
| yarn.resourcemanager.dir | Default value: /var/mapr/cluster/yarn/rm Default source: code |
| yarn.resourcemanager.fs.state-store.num-retries | Default value: 0 Default source: yarn-default.xml |
| yarn.resourcemanager.fs.state-store.retry-interval-ms | Default value: 1000 Default source: yarn-default.xml |
| yarn.resourcemanager.fs.state-store.retry-policy-spec | hdfs client retry policy specification. hdfs client retry is always enabled. Specified in pairs of sleep-time and number-of-retries and (t0, n0), (t1, n1), ..., the first n0 retries sleep t0 milliseconds on average, the following n1 retries sleep t1 milliseconds on average, and so on. Default value: 2000, 500 Default source: yarn-default.xml |
| yarn.resourcemanager.fs.state-store.uri | URI pointing to the location of the FileSystem path where RM state will be stored. This must be supplied when using org.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStore as the value for yarn.resourcemanager.store.class Default value: /var/mapr/cluster/yarn/rm/system Default source: code |
| yarn.resourcemanager.ha.automatic-failover.embedded | Enable embedded automatic failover. The embedded elector relies on the RM state store to handle fencing, and is primarily intended to be used in conjunction with ZKRMStateStore. Default value: TRUE Default source: yarn-default.xml |
| yarn.resourcemanager.ha.automatic-failover.enabled | Enable automatic failover. Default value: TRUE Default source: yarn-default.xml |
| yarn.resourcemanager.ha.automatic-failover.zk-base-path | The base znode path to use for storing leader information, when using ZooKeeper based leader election. Default value: /yarn-leader-election Default source: yarn-default.xml |
| yarn.resourcemanager.ha.custom-ha-rmaddressfinder | Default value: org.apache.hadoop.yarn.client.MapRZKBasedRMAddressFinder Default source: code |
| yarn.resourcemanager.ha.enabled | Enable RM high-availability. When enabled, (1) The RM starts in the Standby mode by default, and transitions to the Active mode when prompted to. (2) The nodes in the RM ensemble are listed in yarn.resourcemanager.ha.rm-ids (3) The id of each RM comes from yarn.resourcemanager.ha.id (4) The actual physical addresses come from the configs of the pattern - {rpc-config}.{id} Default value: false Default source: yarn-default.xml |
| yarn.resourcemanager.hostname | The hostname of the ResourceManager. Default value: 0.0.0.0 Default source: yarn-default.xml |
| yarn.resourcemanager.keytab | The keytab for the ResourceManager. Default value: /etc/krb5.keytab Default source: yarn-default.xml |
| yarn.resourcemanager.leveldb-state-store.path | Default value: ${hadoop.tmp.dir}/yarn/system/rmstore Default source: yarn-default.xml |
| yarn.resourcemanager.max-completed-applications | The maximum number of completed applications RM keeps. Default value: 10000 Default source: yarn-default.xml |
| yarn.resourcemanager.nodemanager.minimum.version | The minimum allowed version of a connecting nodemanager. The valid values are NONE (no version checking), EqualToRM (the nodemanager's version is equal to or greater than the RM version), or a Version String. Default value: NONE Default source: yarn-default.xml |
| yarn.resourcemanager.nodemanagers.heartbeat-interval-ms |
The heart-beat interval in milliseconds for every NodeManager in the cluster. Default value: 1000 Default source: yarn-default.xml |
| yarn.resourcemanager.principal |
The Kerberos principal for the ResourceManager. Default value:mapr Default source: code |
| yarn.resourcemanager.proxy-user-privileges.enabled | Default value: FALSE Default source: yarn-default.xml |
| yarn.resourcemanager.recovery.enabled |
Enable RM to recover state after starting. If true, then yarn.resourcemanager.store.class must be specified. Default value: false When you configure failover configure.sh may change the default value by adding a value for this parameter in yarn-site.xml. For more information, see ResourceManager Configuration Properties. |
| yarn.resourcemanager.resource-tracker.address |
Default value: ${yarn.resourcemanager.hostname}:8031 Default source: yarn-default.xml When you configure failover configure.sh may change the default value by adding a value for this parameter in yarn-site.xml. For more information, see ResourceManager Configuration Properties. |
| yarn.resourcemanager.resource-tracker.client.thread-count |
Number of threads to handle resource tracker calls. Default value: 50 Default source: yarn-default.xml |
| yarn.resourcemanager.scheduler.address |
The address of the scheduler interface.] Default value: ${yarn.resourcemanager.hostname}:8030 Default source: yarn-default.xml When you configure failover configure.sh may change the default value by adding a value for this parameter in yarn-site.xml. For more information, see ResourceManager Configuration Properties. |
| yarn.resourcemanager.scheduler.class |
The class to use as the resource scheduler. Default value: org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler Default source: code |
| yarn.resourcemanager.scheduler.client.thread-count |
Number of threads to handle scheduler interface. Default value: 50 Default source: yarn-default.xml |
| yarn.resourcemanager.scheduler.monitor.enable |
Enable a set of periodic monitors (specified in yarn.resourcemanager.scheduler.monitor.policies) that affect the scheduler. Default value: false Default source: yarn-default.xml |
| yarn.resourcemanager.scheduler.monitor.policies |
The list of SchedulingEditPolicy classes that interact with the scheduler. A particular module may be incompatible with the scheduler, other policies, or a configuration of either. Default value: org.apache.hadoop.yarn.server.resourcemanager.monitor.capacity.ProportionalCapacityPreemptionPolicy Default source: yarn-default.xml |
| yarn.resourcemanager.staging | Default value: /var/mapr/cluster/yarn/rm/staging Default source: code |
| yarn.resourcemanager.state-store.max-completed-applications |
The maximum number of completed applications RM state store keeps, less than or equals to ${yarn.resourcemanager.max-completed-applications}. By default, it equals to ${yarn.resourcemanager.max-completed-applications}. This ensures that the applications kept in the state store are consistent with the applications remembered in RM memory. Any values larger than ${yarn.resourcemanager.max-completed-applications} will be reset to ${yarn.resourcemanager.max-completed-applications}. Note that this value impacts the RM recovery performance.Typically, a smaller value indicates better performance on RM recovery. Default value: ${yarn.resourcemanager.max-completed-applications} Default source: yarn-default.xml |
| yarn.resourcemanager.store.class |
The class to use as the persistent store. If org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore is used, the store is implicitly fenced; meaning a single ResourceManager is able to use the store at any point in time. More details on this implicit fencing, along with setting up appropriate ACLs is discussed under yarn.resourcemanager.zk-state-store.root-node.acl. Default value: org.apache.hadoop.yarn.server.resourcemanager.recovery.FileSystemRMStateStore Default source: yarn-default.xml |
| yarn.resourcemanager.system | Default value: /var/mapr/cluster/yarn/rm/system Default source: code |
| yarn.resourcemanager.system-metrics-publisher.dispatcher.pool-size | Default value: 10 Default source: yarn-default.xml |
| yarn.resourcemanager.system-metrics-publisher.enabled | Default value: FALSE Default source: yarn-default.xml |
| yarn.resourcemanager.webapp.address |
The http address of the ResourceManager web application. Default value: ${yarn.resourcemanager.hostname}:8088 Default source: yarn-default.xml When you configure failover configure.sh may change the default value by adding a value for this parameter in yarn-site.xml. For more information, see ResourceManager Configuration Properties. |
| yarn.resourcemanager.webapp.delegation-token-auth-filter.enabled | Default value: TRUE Default source: yarn-default.xml |
| yarn.resourcemanager.webapp.https.address |
The https adddress of the ResourceManager web application. Default value: ${yarn.resourcemanager.hostname}:8090 Default source: yarn-default.xml When you configure failover configure.sh may change the default value by adding a value for this parameter in yarn-site.xml. For more information, see ResourceManager Configuration Properties. |
| yarn.resourcemanager.work-preserving-recovery.enabled | Default value: TRUE Default source: yarn-default.xml |
| yarn.resourcemanager.work-preserving-recovery.scheduling-wait-ms | Default value: 10000 Default source: yarn-default.xml |
| yarn.resourcemanager.zk-acl |
ACL's to be used for ZooKeeper znodes. Default value: world:anyone:rwcda Default source: yarn-default.xml |
| yarn.resourcemanager.zk-num-retries |
Number of times RM tries to connect to ZooKeeper. Default value: 1000 Default source: yarn-default.xml |
| yarn.resourcemanager.zk-retry-interval-ms |
Retry interval in milliseconds when connecting to ZooKeeper. Default value: 1000 Default source: yarn-default.xml |
| yarn.resourcemanager.zk-state-store.parent-path |
Full path of the ZooKeeper znode where RM state will be stored. This must be supplied when using org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore as the value for yarn.resourcemanager.store.class Default value: /rmstore Default source: yarn-default.xml |
| yarn.resourcemanager.zk-timeout-ms |
ZooKeeper session timeout in milliseconds. Session expiration is managed by the ZooKeeper cluster itself, not by the client. This value is used by the cluster to determine when the client's session expires. Expirations happens when the cluster does not hear from the client within the specified session timeout period (i.e. no heartbeat). Default value: 10000 Default source: yarn-default.xml |
| yarn.scheduler.maximum-allocation-mb |
The maximum allocation for every container request at the RM, in MBs. Memory requests higher than this won't take effect, and will get capped to this value. Default value: 8192 Default source: yarn-default.xml |
| yarn.scheduler.maximum-allocation-vcores |
The maximum allocation for every container request at the RM, in terms of virtual CPU cores. Requests higher than this won't take effect, and will get capped to this value. Default value: 32 Default source: yarn-default.xml |
| yarn.scheduler.minimum-allocation-mb |
The minimum allocation for every container request at the RM, in MBs. Memory requests lower than this won't take effect, and the specified value will get allocated at minimum. Default value: 1024 Default source: yarn-default.xml |
| yarn.scheduler.minimum-allocation-vcores |
The minimum allocation for every container request at the RM, in terms of virtual CPU cores. Requests lower than this won't take effect, and the specified value will get allocated the minimum. Default value: 1 Default source: yarn-default.xml |
| yarn.resourcemanager.zk-timeout-ms | Default value: 10000 Default source: yarn-default.xml |
| yarn.scheduler.maximum-allocation-mb | Default value: 8192 Default source: yarn-default.xml |
| yarn.scheduler.maximum-allocation-vcores | Default value: 32 Default source: yarn-default.xml |
| yarn.scheduler.minimum-allocation-mb | Default value: 1024 Default source: yarn-default.xml |
| yarn.scheduler.minimum-allocation-vcores | Default value: 1 Default source: yarn-default.xml |
| yarn.sharedcache.admin.address | Default value: 0.0.0.0:8047 Default source: yarn-default.xml |
| yarn.sharedcache.admin.thread-count | Default value: 1 Default source: yarn-default.xml |
| yarn.sharedcache.app-checker.class | Default value: org.apache.hadoop.yarn.server.sharedcachemanager.RemoteAppChecker Default source: yarn-default.xml |
| yarn.sharedcache.checksum.algo.impl | Default value: org.apache.hadoop.yarn.sharedcache.ChecksumSHA256Impl Default source: yarn-default.xml |
| yarn.sharedcache.cleaner.initial-delay-mins | Default value: 10 Default source: yarn-default.xml |
| yarn.sharedcache.cleaner.period-mins | Default value: 1440 Default source: yarn-default.xml |
| yarn.sharedcache.cleaner.resource-sleep-ms | Default value: 0 Default source: yarn-default.xml |
| yarn.sharedcache.client-server.address | Default value: 0.0.0.0:8045 Default source: yarn-default.xml |
| yarn.sharedcache.client-server.thread-count | Default value: 50 Default source: yarn-default.xml |
| yarn.sharedcache.enabled | Default value: FALSE Default source: yarn-default.xml |
| yarn.sharedcache.nested-level | Default value: 3 Default source: yarn-default.xml |
| yarn.sharedcache.nm.uploader.replication.factor | Default value: 10 Default source: yarn-default.xml |
| yarn.sharedcache.nm.uploader.thread-count | Default value: 20 Default source: yarn-default.xml |
| yarn.sharedcache.root-dir | Default value: /sharedcache Default source: yarn-default.xml |
| yarn.sharedcache.store.class | Default value: org.apache.hadoop.yarn.server.sharedcachemanager.store.InMemorySCMStore Default source: yarn-default.xml |
| yarn.sharedcache.store.in-memory.check-period-mins | Default value: 720 Default source: yarn-default.xml |
| yarn.sharedcache.store.in-memory.initial-delay-mins | Default value: 10 Default source: yarn-default.xml |
| yarn.sharedcache.store.in-memory.staleness-period-mins | Default value: 10080 Default source: yarn-default.xml |
| yarn.sharedcache.uploader.server.address | Default value: 0.0.0.0:8046 Default source: yarn-default.xml |
| yarn.sharedcache.uploader.server.thread-count | Default value: 50 Default source: yarn-default.xml |
| yarn.sharedcache.webapp.address | Default value: 0.0.0.0:8788 Default source: yarn-default.xml |
| yarn.timeline-service.address | Default value: ${yarn.timeline-service.hostname}:10200 Default source: yarn-default.xml |
| yarn.timeline-service.client.best-effort | Default value: FALSE Default source: yarn-default.xml |
| yarn.timeline-service.client.max-retries | Default value: 30 Default source: yarn-default.xml |
| yarn.timeline-service.client.retry-interval-ms | Default value: 1000 Default source: yarn-default.xml |
| yarn.timeline-service.enabled | Default value: FALSE Default source: yarn-default.xml |
| yarn.timeline-service.generic-application-history.aux-services | Default value: HSVolumeManager Default source: code |
| yarn.timeline-service.handler-thread-count | Default value: 10 Default source: yarn-default.xml |
| yarn.timeline-service.hostname | Default value: 0.0.0.0 Default source: yarn-default.xml |
| yarn.timeline-service.http-authentication.simple.anonymous.allowed | Default value: TRUE Default source: yarn-default.xml |
| yarn.timeline-service.http-authentication.type | Default value: simple Default source: yarn-default.xml |
| yarn.timeline-service.keytab | Default value: /etc/krb5.keytab Default source: yarn-default.xml |
| yarn.timeline-service.leveldb-state-store.path | Default value: ${hadoop.tmp.dir}/yarn/timeline Default source: yarn-default.xml |
| yarn.timeline-service.leveldb-timeline-store.path | Default value: ${hadoop.tmp.dir}/yarn/timeline Default source: yarn-default.xml |
| yarn.timeline-service.leveldb-timeline-store.read-cache-size | Default value: 104857600 Default source: yarn-default.xml |
| yarn.timeline-service.leveldb-timeline-store.start-time-read-cache-size | Default value: 10000 Default source: yarn-default.xml |
| yarn.timeline-service.leveldb-timeline-store.start-time-write-cache-size | Default value: 10000 Default source: yarn-default.xml |
| yarn.timeline-service.leveldb-timeline-store.ttl-interval-ms | Default value: 300000 Default source: yarn-default.xml |
| yarn.timeline-service.recovery.enabled | Default value: FALSE Default source: yarn-default.xml |
| yarn.timeline-service.state-store-class | Default value: org.apache.hadoop.yarn.server.timeline.recovery.LeveldbTimelineStateStore Default source: yarn-default.xml |
| yarn.timeline-service.store-class | Default value: org.apache.hadoop.yarn.server.timeline.LeveldbTimelineStore Default source: yarn-default.xml |
| yarn.timeline-service.ttl-enable | Default value: TRUE Default source: yarn-default.xml |
| yarn.timeline-service.ttl-ms | Default value: 604800000 Default source: yarn-default.xml |
| yarn.timeline-service.webapp.address | Default value: ${yarn.timeline-service.hostname}:8188 Default source: yarn-default.xml |
| yarn.timeline-service.webapp.https.address | Default value: ${yarn.timeline-service.hostname}:8190 Default source: yarn-default.xml |
| yarn.use-central-logging-for-mapreduce-only | Default value: FALSE Default source: code |
| yarn.timeline-service.ttl-ms | Default value: 604800000 Default source: yarn-default.xml |