Kafka Queue - Retrieving multiple messages

Kafka Queue - Retrieving multiple messages

Comments

  • I would like some assistance with reading messages from a kafka queue.

    I have created a simple flow that is reading from a queue that has an queue Handler attached to it. When I run the flow I can successfully retrieve one message from the topic.

    However I would like to receive all the unread messages at once. Is that a configuration for the queue handler or would I have to run a loop in my flow to retrieve messages until there’s nothing left to retrieve?

    Could you please point me to the right direction or link me relevant documentation?

  • A Kafka Message Handler should get messages one at a time and run a flow for each one automatically. The Get Message step will retrieve a single message.

    There currently isnt a single step/configuration that will read all available Kafka messages and return an array of them. So I think you are on the right track with building a loop in your flow.

    Unfortunately, there isnt a lot of documentation yet in regards to more in-depth message handling what we have I will link below, however.

    https://documentation.decisions.com/docs/setting-messaging-overview

    https://documentation.decisions.com/docs/apache-kafka

Sign In or Register to comment.