Job and Application Logs

You can use logs to view the status and analyze the execution of jobs and applications in a cluster.

To view the status or to access logs for running jobs or applications, you can use the user interface associated with the MapReduce or YARN framework.

  • For MapReduce v1 jobs, access the JobTracker user interface from the MapR Control System (MCS) to view the status and logs for a particular job.
  • For MapReduce v2 or non-MapReduce applications, access the ResourceManager user interface from the MCS to view the status and logs for a particular application.

For completed jobs and applications, the distributed nature of the MapReduce and YARN frameworks can make analyzing the execution of jobs and applications difficult because tasks and containers are scattered throughout the cluster. Without centralized or aggregated logging, you must manually access all the log files for a completed job or application by merging the log details for a particular job across multiple nodes in the cluster. With centralized or aggregated logging, you can can access all the logs for a completed job or application in a centralized location. However, the steps to access logs for completed jobs or applications differ based on the configured logging option.