About Release 7.6.1
This site contains documentation for HPE Ezmeral Data Fabric release 7.6.1, including installation, configuration, administration, and reference content, as well as content for the associated ecosystem components and drivers.
7.6.1 Installation
This section contains information about installing and upgrading HPE Ezmeral Data Fabric software. It also contains information about how to migrate data and applications from an Apache Hadoop cluster to a HPE Ezmeral Data Fabric cluster.
7.6.1 Data Fabric
HPE Ezmeral Data Fabric is the industry-leading data platform for AI and analytics that solves enterprise business needs.
7.6.1 Administration
This section describes how to manage the nodes and services that make up a cluster.
7.6.1 Development
This section contains information related to application development for Ezmeral ecosystem components and HPE Ezmeral Data Fabric products, including the file system, Database (Key-Value and JSON), and Event Streams.
- Application Development Process
  Before you start developing applications on the HPE Ezmeral Data Fabric platform, consider how you will get the data into the platform, the storage format of the data, the type of processing or modeling that is required, and how the data will be accessed.
  - Step 1: Select a Data Storage Format
    Consider the data format options and determine how you want to use to store your data.
  - Step 2: Write Data to HPE Ezmeral Data Fabric
    Depending on your use case, move existing data onto the HPE Ezmeral Data Fabric platform or write data directly to the platform.
  - Step 3: Explore Ways to Work With the Data
    Once the data is in the HPE Ezmeral Data Fabric platform, explore the various features and components available on the platform and determine your path. You may want to access data in its initial format or perform some data modeling or processing prior to accessing the data.
  - Step 4: Set Up the Development Environment
    Before you start building the application, figure out how your the application will connect to the cluster and what the library dependencies and installation requirements are.
    - Connect to the Cluster
      Application are often run on nodes that are not part of the Data Fabric cluster. There are many methods to connect to a Data Fabric cluster; this section briefly describes each option.
      - Using the File System JAR to Connect to the Cluster
        The file system JAR file includes the Data Fabric client libraries required to connect to the cluster. While this is strongly discouraged, application developers can bundle the file system JAR file in Data Fabric file system, HPE Ezmeral Data Fabric Database, and HPE Ezmeral Data Fabric Streams applications instead of installing the Data Fabric client on the edge node (node that runs the application). Applications should not bundle the file system JAR file unless the application meets certain requirements.
    - HPE Ezmeral Data Fabric Database JSON Application Requirements
      The following tables include the minimal node requirements for building and running HPE Ezmeral Data Fabric Database JSON table applications.
    - HPE Ezmeral Data Fabric Database Binary Application Requirements
      The following tables include the minimal node requirements for building and running HPE Ezmeral Data Fabric Database binary table applications.
    - HPE Ezmeral Data Fabric Streams Application Requirements
      The following tables include the minimal node requirements for building and running HPE Ezmeral Data Fabric Streams consumer and producer applications.
    - File System Application Requirements
      The following tables include the minimal node requirements for building and running file system applications.
    - YARN Application Requirements
      The following tables include the minimal node requirements for building and running YARN applications.
  - Step 5: Build the Application
    Start building an application! This section lists a few of the sample applications available in HPE Ezmeral Data Fabric.
- File Store and Apps
  The following sections provide information about accessing the File Store with C and Java applications.
- HPE Ezmeral Data Fabric Database and Apps
  This section contains information about developing client applications for JSON and key-value tables.
- Apache Kafka Wire Protocol Service
  HPE Ezmeral Data Fabric Streams supports Apache Kafka Wire Protocol Service. Apache Kafka Wire Protocol Service is a TCP/IP service that emulates a Kafka cluster backed by HPE Ezmeral Data Fabric Streams. The service makes it possible for Apache Kafka clients written in any programming language to access topics in HPE Ezmeral Data Fabric Streams.
- HPE Ezmeral Data Fabric Streams and Apps
  HPE Ezmeral Data Fabric Streams brings integrated publish and subscribe messaging to HPE Ezmeral Data Fabric.
- MapReduce and Apps
  This section contains information associated with developing YARN applications.
- Kubernetes Interfaces for Data Fabric
  This section describes how to leverage the capabilities of the Kubernetes Interfaces for Data Fabric.
- Ecosystem Components
  The following sections provide information about each open-source project that is supported by the HPE Ezmeral Data Fabric.
- Maven and the HPE Ezmeral Data Fabric
  This section discusses topics associated with Maven and the HPE Ezmeral Data Fabric.
- Developer's Reference
  This section contains in-depth information for the developer.
- API Documentation
  HPE Ezmeral Data Fabric supports public APIs for file system, HPE Ezmeral Data Fabric Database, and HPE Ezmeral Data Fabric Streams. These APIs are available for application-development purposes.
Other Docs
This section contains release-independent information, including: Installer documentation, Ecosystem release notes, interoperability matrices, security vulnerabilities, and links to other data-fabric version documentation.
Glossary
Definitions for commonly used terms in MapR Converged Data Platform environments.

Connect to the Cluster

Application are often run on nodes that are not part of the Data Fabric cluster. There are many methods to connect to a Data Fabric cluster; this section briefly describes each option.

Data Fabric Client: The Data Fabric client includes the libraries and utilities required on an edge node to perform the following: connect to the cluster, submit MapReduce applications, submit YARN applications, run hadoop fs commands, and run hadoop mfs commands. However, to run applications that access data from HPE Ezmeral Data Fabric Database or HPE Ezmeral Data Fabric Streams, you must configure additional dependencies. For more information about the Data Fabric client, see HPE Ezmeral Data Fabric Client and How Data Fabric Clients Connect to the Cluster.
NOTE Although it is not recommended, you can include the file system JAR file in the application instead of installing the Data Fabric client. However, there are caveats and specific requirements to make this work. For information, see Using the File System JAR to Connect to the Cluster.
Data Fabric POSIX Clients: Data Fabric POSIX clients enable app servers, web servers, and other client nodes and applications to read and write directly and securely to the file system. For more information about the POSIX clients, see POSIX Clients and POSIX Clients.
Data Fabric NFS Clients: You can mount the cluster itself via NFS so that your applications can read and write data directly. For more information, see Managing the HPE Ezmeral Data Fabric NFS Service.