Data Balancer Module

Definition

The "Data Balancer" tool module, a default module of the platform for use in any flow, efficiently divides large datasets into smaller parts.

This module is ideal for situations where a target API has data reception limitations, as the "Data Balancer" splits the original data, ensuring each processed segment stays within the established limits and prevents overloads.

Configuring the Data Balancer Module

The "Data Balancer" module is available under the Tools option when editing a flow. After clicking to add it, the configuration modal will be displayed.

Settings

Select and fill in the following fields:

  • Type: Choose between Array Items, Line or Character.

  • Quantity: Enter the amount of data to be processed at a time.

  • Data to Balance: Input the data manually or use an SMOP.

Additionally, there is a "Test" button and "Input" and "Output" tabs to monitor data entry and testing.

Data Balancer configuration screen

To finish configuring the module, click on "Save".

Use example

The "Data Balancer" module requires another module to be connected to it. So, we built our flow as follows:

Example of a flow using the Data Balancer Module

Imagine a scenario where a store has many simultaneous sales. To avoid overloading the order processing system, we used the "Data Balancer" to send 2 orders at a time. The module was configured as follows:

Example of Data Balancer settings

After saving the configuration, we execute the flow. Notice that the logger shows the orders were sent according to the configuration, in batches of 2 orders at a time:

Last updated