[GitHub] [spark] Stove-hust commented on pull request #40412: [SPARK-42784] should still create subDir when the number of subDir in merge dir is less than conf

Stove-hust commented on PR #40412: URL: https://github.com/apache/spark/pull/40412#issuecomment-1550984254 > So to make sure I understand the issue here @Stove-hust - we have a container started on a node, and got immediately killed (pre-empted/etc) while it was in the process of creating

[GitHub] [spark] Stove-hust commented on pull request #40412: [SPARK-42784] should still create subDir when the number of subDir in merge dir is less than conf

Stove-hust commented on PR #40412: URL: https://github.com/apache/spark/pull/40412#issuecomment-1550978743 > yep -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] Stove-hust commented on pull request #40412: [SPARK-42784] should still create subDir when the number of subDir in merge dir is less than conf

Stove-hust commented on PR #40412: URL: https://github.com/apache/spark/pull/40412#issuecomment-1547331364 @mridulm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] Stove-hust commented on pull request #40412: [SPARK-42784] should still create subDir when the number of subDir in merge dir is less than conf

Stove-hust commented on PR #40412: URL: https://github.com/apache/spark/pull/40412#issuecomment-1537894454 @cloud-fan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] Stove-hust commented on pull request #40412: [SPARK-42784] should still create subDir when the number of subDir in merge dir is less than conf

Stove-hust commented on PR #40412: URL: https://github.com/apache/spark/pull/40412#issuecomment-1534022451 @mridulm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] Stove-hust commented on pull request #40412: [SPARK-42784] should still create subDir when the number of subDir in merge dir is less than conf

Stove-hust commented on PR #40412: URL: https://github.com/apache/spark/pull/40412#issuecomment-1478854808 @zhouyejoe I I kept the accident scene, should be able to help you。（In our clustered machine environment，11 HDD，creating 11 * 64 subdirectories would take longer to create）

[GitHub] [spark] Stove-hust commented on pull request #40412: [SPARK-42784] should still create subDir when the number of subDir in merge dir is less than conf

Stove-hust commented on PR #40412: URL: https://github.com/apache/spark/pull/40412#issuecomment-1469223693 @mridulm Hello, can you recruit someone to help review this pr。I would appreciate for your help -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] Stove-hust commented on pull request #40412: [SPARK-42784] should still create subDir when the number of subDir in merge dir is less than conf

Stove-hust commented on PR #40412: URL: https://github.com/apache/spark/pull/40412#issuecomment-1467724593 @zhouyejoe can you review this PR? i would be very grateful! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use