[
https://issues.apache.org/jira/browse/CASSANDRA-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13155282#comment-13155282
]
Peter Velas commented on CASSANDRA-3521:
----------------------------------------
progress line is updating and bitrate is changing but it never ends. And my CF
is still empty.
{noformat}
sstableloader-cassandra_2/bin/sstableloader --debug Impressions_compressed
Starting client (and waiting 30 seconds for gossip) ...
Streaming revelant part of Impressions_compressed/Hid-hb-9-Data.db
Impressions_compressed/Impression-hb-11-Data.db
Impressions_compressed/HidSaid-hb-9-Data.db to [/10.20.30.135]
progress: [/10.20.30.135 0/3 (3851)] [total: 3851 - 7MB/s (avg: 6MB/s)]
{noformat}
{noformat}
[default@Impressions_compressed] list Impression;
Using default limit of 100
0 Row Returned.
{noformat}
When I tried to list files from OS point of view (loading only one CF right now)
Its looks like some loop . Streaming data to file and when it reach 200 MB
start with new file and increase by 1.
{noformat}
[root@cass101 Impressions_compressed]# ls -sh1
total 193M
28K Impression-tmp-hb-59-CompressionInfo.db
193M Impression-tmp-hb-59-Data.db
0 Impression-tmp-hb-59-Index.db
[root@cass101 Impressions_compressed]# ls -sh1
total 2.0M
4.0K Impression-tmp-hb-60-CompressionInfo.db
2.0M Impression-tmp-hb-60-Data.db
0 Impression-tmp-hb-60-Index.db
{noformat}
Hope now its better described .
> sstableloader throwing exceptions when loading snapshot data from compressed
> CFs
> --------------------------------------------------------------------------------
>
> Key: CASSANDRA-3521
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3521
> Project: Cassandra
> Issue Type: Bug
> Environment: One node cluster (same problem with 4 nodes ) and
> dedicated machine for sstable loader.
> node and loader running jdk1.6.0_29 and cassandra-1.0.3
> Reporter: Peter Velas
>
> Loaded data from snapshot then enabled `sstable_compression:
> org.apache.cassandra.io.compress.SnappyCompressor`
> Then flush, scrub and compact. I can see actual CompressionRatio in JMX
> Console and access my data without problems..
> Now I snapshot compressed keyspace and when trying to load snapshot to
> another single node or different Keyspace (the same super CF structure with
> compression options enabled, even try to truncate snapshoted CFs.) I cant
> load any data.
> sstableloader command with debug mode dont throw any errors and shows its
> streaming
> {quote}
> sstableloader-cassandra_2/bin/sstableloader --debug Impressions_compressed/
> {quote}
> Node logs contains repeating the errors bellow.
> {quote}
> ERROR [Thread-319] 2011-11-22 09:56:01,931 AbstractCassandraDaemon.java (line
> 133) Fatal exception in thread Thread[Thread-319,5,main]
> java.lang.AssertionError: attempted to delete non-existing file
> HidSaid-tmp-hb-260-Data.db
> at
> org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49)
> at
> org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170)
> at
> org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
> at
> org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184)
> at
> org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81)
> INFO [Thread-320] 2011-11-22 09:56:02,492 StreamInSession.java (line 120)
> Streaming of file Impressions_compressed/HidSaid-hb-9-Data.db sections=1
> progress=0/5616749 - 0% from
> org.apache.cassandra.streaming.StreamInSession@3cc62c07 failed: requesting a
> retry.
> ERROR [Thread-320] 2011-11-22 09:56:02,493 AbstractCassandraDaemon.java (line
> 133) Fatal exception in thread Thread[Thread-320,5,main]
> java.lang.AssertionError: attempted to delete non-existing file
> HidSaid-tmp-hb-261-Data.db
> at
> org.apache.cassandra.io.util.FileUtils.deleteWithConfirm(FileUtils.java:49)
> at
> org.apache.cassandra.streaming.IncomingStreamReader.retry(IncomingStreamReader.java:170)
> at
> org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
> at
> org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:184)
> at
> org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:81)
> {quote}
> Hope its enough if you need more info just tell me what you need to reproduce
> this bug.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira