vinothchandar commented on issue #768: No Space Left On Device for upsert URL: https://github.com/apache/incubator-hudi/issues/768#issuecomment-511544979 the /tmp is more for spark, to shuffle the data. Hudi only writes to the `basePath` you configure. One place that we do use the /tmp folder is to spill merge.. you can try changing this path and see if it helps (will only help if Hudi's writing is the issue. not for scaling spark shuffles) ``` public static final String SPILLABLE_MAP_BASE_PATH_PROP = "hoodie.memory.spillable.map.path"; // Default file path prefix for spillable file public static final String DEFAULT_SPILLABLE_MAP_BASE_PATH = "/tmp/"; ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
