[
https://issues.apache.org/jira/browse/CASSANALYTICS-107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yifan Cai updated CASSANALYTICS-107:
------------------------------------
Status: Ready to Commit (was: Review In Progress)
> Fix race condition in DirectStreamSession#onSSTablesProduced and
> SortedSStableWriter#close
> ------------------------------------------------------------------------------------------
>
> Key: CASSANALYTICS-107
> URL: https://issues.apache.org/jira/browse/CASSANALYTICS-107
> Project: Apache Cassandra Analytics
> Issue Type: Bug
> Components: Writer
> Reporter: Yifan Cai
> Assignee: Yifan Cai
> Priority: Normal
> Time Spent: 1h
> Remaining Estimate: 0h
>
> onSSTablesProduced will trigger a task in the executor service (single
> threaded).
> and sstableWriter.close called in StreamSession#finalizeStreamAsync is in a
> different thread.
> {code:java}
> Caused by: java.nio.file.NoSuchFileException:
> /var/folders/rh/qt9nhp2n5_93kx9ccbtydlxm0000gp/T/d63327d6-5eb2-48c0-8efc-7f47c40d1174/0/0/0/0-0-e58317c7-b1a9-4384-93a4-9c79fcc094a9/nb-3-big-Data.db
> at
> java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:92)
> at
> java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)
> at
> java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116)
> at
> java.base/sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55)
> at
> java.base/sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:149)
> at java.base/java.nio.file.Files.readAttributes(Files.java:1764)
> at java.base/java.nio.file.Files.size(Files.java:2381)
> at
> org.apache.cassandra.spark.bulkwriter.SortedSSTableWriter.calculatedTotalSize(SortedSSTableWriter.java:319)
> at
> org.apache.cassandra.spark.bulkwriter.SortedSSTableWriter.close(SortedSSTableWriter.java:233)
> at
> org.apache.cassandra.spark.bulkwriter.StreamSession.finalizeStreamAsync(StreamSession.java:142)
> at
> org.apache.cassandra.spark.bulkwriter.RecordWriter.flushAsync(RecordWriter.java:481)
> at
> org.apache.cassandra.spark.bulkwriter.RecordWriter.write(RecordWriter.java:201)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
