Async & Batch Processing

Unknown

Async & Batch Processing

Unknown

Im using an interval job which checks the database every five minutes for new records. If new records are available, it kicks off an async flow which will fetch data from numerous tables in the database and store them as Entities in Decisions.

Im curious what happens if there is a large volume of data - would the async Flow handle it adequately or is it advisable to build some Batch Processing into the Flow ourselves?

Unknown

With the Job running every 5 minutes, I’d expect the load to be small and short-lived, rather than a big data import. Async Flows will work fine for this.

Unknown

Thanks!

For future reference, would you recommend the best way to process in batches to be with the Batch Insert Entities Auto Queue & Save Pending steps?

Unknown

If it is a background task, I would go with Async. Beyond that, it is more down to your individual process.

Unknown

Fair enough. Thanks for the help.