Lookup tables - retrieve limited records

Hi Brent,

Yes the Lookup Tables approach should work for your case.

Like you describe, store the info into a lookup table. Should be best to use a keygroup starting with “temp_” so the records will automatically be purged from the database after 60 days.

Then build a custom polling trigger that uses the Keyvalue Storage - Select module to fetch all records from the lookup table.

The trick to having the polling trigger only trickle out so many new records is to set this value in the Trigger - Emit New Items module to the desired value:

In this example, the polling trigger would only emit up to 5 new records each time the polling automation is run. Records that are not emitted would then be emitted the next time the polling automation is scheduled to run.

In that manner, you should get the desired slow trickle of records to be processed.

Let us know if you have any trouble getting it working as needed!

Robert