Integrate Flume with MapR Streams
Integrate Flume 1.6 with MapR Streams when you want to write Flume source data to a MapR Streams topic or when you want to write MapR Streams topics to a Flume sink.
You can use Flume and MapR Streams for many different use cases; however, here are a few
examples:
- Write MapR Streams topics to file on the MapR-FS
- To write MapR Streams topics to the MapR-FS, create an agent with a Kafka source and a HDFS sinks.
- Write MapR Streams topics to HBase or MapR-DB
- To write MapR Streams topics to HBase or MapR-DB, create an agent with a Kafka source and an HBase sink.
- Write data from any supported Flume source to MapR Streams topics
- To write data from any supported Flume source to MapR Streams topics, create an agent with the appropriate Flume source type and a Kafka sink or Kafka channel. For example, you can use a syslogs source to turn logs into a MapR stream topic.
NOTE: Before you integrate Flume with MapR Streams, verify that the Streams Client is
installed on all Flume nodes. For more information, see Installing Flume