Determining Topic Partitions

The default number of partitions for MapR-DB streams and topics can impact performance. Depending on the volume of messages being published to a topic, the default number of partitions might be increased for efficient consumption.

When there is a high volume of messages being published to a topic:
  • Multiple consumers, in consumer groups, reading from multiple partitions are handled more efficiently.
  • Individual consumers each reading from a single partition are handled less efficiently.
When creating or editing a stream, a default number of partitions can be specified for that stream's topics. Topics inherit the stream's partition default, however, topics can also override the stream's partition default by setting the number of partitions to be used.

For More Information

  • See the maprcli stream create for information about creating streams with the -defaultpartitions parameter..
  • See the maprcli stream edit for information about editing streams with the -defaultpartitions parameter.
  • See the maprcli stream topic create for information about creating topics with the -partitions parameter.
  • See the maprcli stream topic edit for information about modifying topics with the -partitions parameter.
  • See the MapR-ES Java API Library for the methods used to create and edit streams and to create and edit topics.