GitHub user gertwieland edited a discussion: Question regarding Metadata Injection (MDI)
I'm starting to wrap my head around MDI, and I got it somehow to work. I'm just not sure if I'm using it as intended. My goal is to iterate dynamically through a list of tables in a SQL DB, extract a couple of columns, and write the results into a consolidated target table. The source column names are mostly identical except for one or two. So I'm reading from different tables, but I'm writing into one and the same target table. I got it somehow to work, but I'm not sure if I'm using it as intended. Currently there are two tables I want to read from, so I created this pipeline that shows all the relevant values, including the dynamic SQL code <img width="1312" alt="image" src="https://github.com/user-attachments/assets/45872270-9f29-431b-9bed-84ac475ce4ca"; /> I didn't find a way to pass every row to the MDI, so I use a Pipeline Executor. I'm passing these variables. <img width="244" alt="image" src="https://github.com/user-attachments/assets/718a10a6-59ed-4909-b4ce-a8f7ba5484cc"; /> The template pipeline looks like this. <img width="1282" alt="image" src="https://github.com/user-attachments/assets/e33a7961-3e43-46f8-a063-8bf1a6978278"; /> Here's how I pass the variables. <img width="1482" alt="image" src="https://github.com/user-attachments/assets/36157761-6c7a-49eb-838e-6fb9d1afdea2"; /> It does work though, but I'm not sure if I'm using it properly. So here are my questions. Do I really need the pipeline executor to iterate through each line, ie each table? Should or could I have made use of these fields? <img width="836" alt="image" src="https://github.com/user-attachments/assets/bec78795-8b33-49b9-9424-333868e32496"; /> GitHub link: https://github.com/apache/hop/discussions/5486 ---- This is an automatically sent email for users@hop.apache.org. To unsubscribe, please send an email to: users-unsubscr...@hop.apache.org
