Hi: There are two tasks in my program. Task one caches data locally to the device node where the current session is located (not hdfs). Task two will read the data cached by task one when submitted, so I need to submit both task one and task two To the same device node. now using livy, I submit both task one and task two to the same session. Can I ensure that these two tasks are scheduled to the same running node and get the cached data?
- Livy:Task submission scheduling problem in yarn mode ipconfig