GitHub user CatalyseRichard added a comment to the discussion: How to iterate on same transform to fetch data in batches
Diego's answer is the correct one - but it points to several different methods by which you could achieve this. We have had a similar requirement and used a pipeline executor to set up a repeating control loop. This contained some control logic and a pipeline that executed the REST API call and extracted not just the data set but also the page info and nextpage url. This is fed back as variables into the control loop to evaluate whether a further loop is required or not. GitHub link: https://github.com/apache/hop/discussions/5627#discussioncomment-14151446 ---- This is an automatically sent email for users@hop.apache.org. To unsubscribe, please send an email to: users-unsubscr...@hop.apache.org
