jerqi commented on issue #378: URL: https://github.com/apache/incubator-uniffle/issues/378#issuecomment-1343904586
> > I mean that we can write multiple files at the same time. > > We can tryLock the file lock, we have multiple locks, if we succeed to tryLock, we can write the file. If we fail to tryLock, we will retry another file lock. > > Got it. It's an optional solution, the flush speed could improve based on (HDFS speed) * (file number). > I feel that it's necessary. Because it will be too slow that the server only use single thread to flush a large partition although we have multiple servers. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@uniffle.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
