About Release 7.7.0
This site contains documentation for HPE Ezmeral Data Fabric release 7.7.0, including installation, configuration, administration, and reference content, as well as content for the associated ecosystem components and drivers.
7.7.0 Installation
This section contains information about installing and upgrading HPE Ezmeral Data Fabric software. It also contains information about how to migrate data and applications from an Apache Hadoop cluster to a HPE Ezmeral Data Fabric cluster.
7.7.0 Data Fabric
HPE Ezmeral Data Fabric is the industry-leading data platform for AI and analytics that solves enterprise business needs.
7.7.0 Administration
This section describes how to manage the nodes and services that make up a cluster.
- Administering Users and Clusters
  Lists topics that help manage a data-fabric cluster.
- Administering Nodes
  Provides a synopsis of managing nodes in a cluster.
  - Managing Nodes
    Describes the Nodes page on the Control System.
  - Managing Roles
    Describes how to manage roles on a node.
  - Managing Services
    Synopsis on managing services.
  - Managing Disks
    Provides a brief overview of adding and removing disks from the HPE Ezmeral Data Fabric file system.
    - Viewing the List of Disks
      Explains how to view the disks on a node using either the Control System or the CLI.
    - Setting Up Disks for HPE Ezmeral Data Fabric
      This section describes how to set up disks during the normal installation process. Go to the ReferenceGuide/disksetup.html command page for information about other uses of this command.
      - Determine if a disk or partition is ready for use by HPE Ezmeral Data Fabric
        Explains the procedure to determine whether a disk or partition is ready for use by HPE Ezmeral Data Fabric.
      - Specify disks or partitions for use by HPE Ezmeral Data Fabric
        Describes the use of the disksetup script to format disks.
      - Evaluate HPE Ezmeral Data Fabric using a flat storage file instead of formatting disks
        For evaluation, you can use a flat storage file instead of formatting disks.
    - Adding Disks to file system
      Describes how to add disks using either the Control System or the CLI.
    - Removing Disks from the File System
      Explains how to remove disks using either the Control System or the CLI.
    - Determining the Amount of Free Disk From the Command-Line
      Lists the command to display the amount of free disk space.
    - Tolerating Slow Disks
      Explains how to tune disk response timeouts.
    - Formatting Disks on a Node From the Command-line
      Provides an overview of the disksetup script to format disks from the command line.
    - Handling Disk Failures
      Explains how to handle disk failures.
    - Designating NICs for HPE Ezmeral Data Fabric
      Explains how to assign IP address blocks for HPE Ezmeral Data Fabric.
    - Working with a Logical Volume Manager
      Explains the role and usage of a Logical Volume Manager.
    - Tuning for SSDs
      Lists the parameters to tune for optimal SSD performance.
- Administering Volumes
  This section provide information about how to organize and manage data using volumes, a unique feature of HPE Ezmeral Data Fabric clusters.
- Administering Files and Directories
- Administering Tables
  Administration of the HPE Ezmeral Data Fabric Database is done primarily via the command line (maprcli) or with the Managed Control System (MCS). Regardless of whether the HPE Ezmeral Data Fabric Database table is used for binary files or JSON documents, the same types of commands are used with slightly different parameter options. HPE Ezmeral Data Fabric Database administration is associated with tables, columns and column families, and table regions.
- Administering Streams
- Administering Data Fabric Gateways
  A HPE Ezmeral Data Fabric gateway mediates one-way communication between a source HPE Ezmeral Data Fabric cluster and a destination cluster. You can replicate HPE Ezmeral Data Fabric Database tables (binary and JSON) and HPE Ezmeral Data Fabric Streams streams. HPE Ezmeral Data Fabric gateways also apply updates from JSON tables to their secondary indexes and propagate Change Data Capture (CDC) logs.
- Administering Services
- Monitoring the Cluster
  This section describes how to monitor the health and performance of a MapR cluster.
- Configuring Security
  Describes how to configure security and manage secure clusters.
- Managing Secure Clusters
  Provides procedures that will enable you to use MapR clusters securely.
- Administering the Data Access Gateway
  The HPE Ezmeral Data Fabric Data Access Gateway is a service that acts as a proxy and gateway for translating requests between lightweight client applications and the HPE Ezmeral Data Fabric cluster. This section describes considerations when upgrading the service, how to modify configuration settings, and how to administer and manage the service.
- Planning for High Availability
- Administrator's Reference
  This section contains in-depth reference information for the administrator.
- Troubleshooting Cluster Administration
  Lists the common errors and their solutions.
- Best Practices for Backing Up HPE Ezmeral Data Fabric Information
  Lists the best practices and performance considerations to follow when backing up HPE Ezmeral Data Fabric information.
- IPv6 Support in Data Fabric
  Describes the IPv6 support feature for Data Fabric.
7.7.0 Development
This section contains information related to application development for Ezmeral ecosystem components and HPE Ezmeral Data Fabric products, including the file system, Database (Key-Value and JSON), and Event Streams.
Other Docs
This section contains release-independent information, including: Installer documentation, Ecosystem release notes, interoperability matrices, security vulnerabilities, and links to other data-fabric version documentation.
Glossary
Definitions for commonly used terms in MapR Converged Data Platform environments.

Setting Up Disks for HPE Ezmeral Data Fabric

This section describes how to set up disks during the normal installation process. Go to the disksetup command page for information about other uses of this command.

HPE Ezmeral Data Fabric formats and uses disks for the Lockless Storage Services layer (file system), and records these disks in the disktab file. In a production environment, or when testing performance, HPE Ezmeral Data Fabric should be configured to use physical hard drives and partitions. In some cases, it is necessary to reinstall the operating system on a node so that the physical hard drives are available for direct use by HPE Ezmeral Data Fabric. Reinstalling the operating system provides an unrestricted opportunity to configure the hard drives. If the installation procedure assigns hard drives to be managed by the Linux Logical Volume Manager(LVM) by default, you should explicitly remove the drives you plan to use with HPE Ezmeral Data Fabric from the LVM configuration. It is common to let LVM manage one physical drive containing the operating system partition(s) and to leave the rest unmanaged by LVM for use with HPE Ezmeral Data Fabric.

NOTE It is not necessary to set up RAID (Redundant Array of Independent Disks) on disks used by file system. HPE Ezmeral Data Fabric uses the disksetup script to set up storage pools. In most cases, you should let HPE Ezmeral Data Fabric calculate storage pools using the default stripe width of two or three disks. If you anticipate a high volume of random-access I/O, you can use the -W option with disksetup to specify larger storage pools of up to 8 disks each.

NOTICE For more information on setting up disks, see Drive Configuration.

The following procedures are intended for use on physical clusters or Amazon EC2 instances. On EC2 instances, EBS volumes can be used as HPE Ezmeral Data Fabric storage, although performance will be slow.

NOTE If you are using HPE Ezmeral Data Fabric on Amazon EMR, you do not have to use this procedure; the disks are set up for you automatically.