[jira] [Commented] (CASSANDRA-14224) Failed to create merkel tree
[ https://issues.apache.org/jira/browse/CASSANDRA-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16788605#comment-16788605 ] Igor Zubchenok commented on CASSANDRA-14224: Hi, I don't know the cause, but we bootstrapped a new datacenter. > Failed to create merkel tree > > > Key: CASSANDRA-14224 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14224 > Project: Cassandra > Issue Type: Bug > Components: Consistency/Repair >Reporter: Igor Zubchenok >Priority: Major > > While repairing a node with nodetool -full -pr -dcpar, another node throws an > AssertionError and failed to create merkel tree. > There is no information what is wrong and how to fix in logs. > > {code:java} > DEBUG [ValidationExecutor:25] 2018-02-08 21:31:42,581 SSTableReader.java:503 > - Opening > /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-35-big > (1.876KiB) > DEBUG [ValidationExecutor:39] 2018-02-08 21:31:42,581 SSTableReader.java:503 > - Opening > /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-35-big > (1.876KiB) > DEBUG [ValidationExecutor:39] 2018-02-08 21:31:42,586 SSTableReader.java:503 > - Opening > /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-36-big > (0.688KiB) > ERROR [ValidationExecutor:25] 2018-02-08 21:31:42,586 Validator.java:268 - > Failed creating a merkle tree for [repair > #69803961-0d17-11e8-950c-37c5a1498597 on prod/invoices, > [(-4165282778092010776,-4162024061639141985]]], /88.99.35.178 (see log for > details) > ERROR [ValidationExecutor:25] 2018-02-08 21:31:42,587 > CassandraDaemon.java:228 - Exception in thread > Thread[ValidationExecutor:25,1,main] > java.lang.AssertionError: null > at > org.apache.cassandra.io.sstable.format.SSTableReader$GlobalTidy.get(SSTableReader.java:2313) > ~[apache-cassandra-3.11.1.jar:3.11.1] > at > org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier.setup(SSTableReader.java:2138) > ~[apache-cassandra-3.11.1.jar:3.11.1] > at > org.apache.cassandra.io.sstable.format.SSTableReader.setup(SSTableReader.java:2081) > ~[apache-cassandra-3.11.1.jar:3.11.1] > at > org.apache.cassandra.io.sstable.format.SSTableReader.open(SSTableReader.java:519) > ~[apache-cassandra-3.11.1.jar:3.11.1] > at > org.apache.cassandra.db.ColumnFamilyStore.getSnapshotSSTableReader(ColumnFamilyStore.java:1901) > ~[apache-cassandra-3.11.1.jar:3.11.1] > at > org.apache.cassandra.db.compaction.CompactionManager.doValidationCompaction(CompactionManager.java:1335) > ~[apache-cassandra-3.11.1.jar:3.11.1] > at > org.apache.cassandra.db.compaction.CompactionManager.access$700(CompactionManager.java:86) > ~[apache-cassandra-3.11.1.jar:3.11.1] > at > org.apache.cassandra.db.compaction.CompactionManager$13.call(CompactionManager.java:942) > ~[apache-cassandra-3.11.1.jar:3.11.1] > at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_151] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[na:1.8.0_151] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > [na:1.8.0_151] > at > org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81) > [apache-cassandra-3.11.1.jar:3.11.1] > at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_151] > DEBUG [ValidationExecutor:39] 2018-02-08 21:31:42,588 SSTableReader.java:503 > - Opening > /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-33-big > (9.891MiB) > ERROR [NonPeriodicTasks:1] 2018-02-08 21:31:42,589 CassandraDaemon.java:228 - > Exception in thread Thread[NonPeriodicTasks:1,5,main] > java.lang.NullPointerException: null > at > org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier$1.run(SSTableReader.java:2192) > ~[apache-cassandra-3.11.1.jar:3.11.1] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > ~[na:1.8.0_151] > at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_151] > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) > ~[na:1.8.0_151] > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) > ~[na:1.8.0_151] > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > ~[na:1.8.0_151] > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > [na:1.8.0_151] > at >
[jira] [Updated] (CASSANDRA-14917) Nodetool netstats displays incorrect information on streaming
[ https://issues.apache.org/jira/browse/CASSANDRA-14917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-14917: --- Reproduced In: 3.11.3, 3.11.2 (was: 3.11.2) > Nodetool netstats displays incorrect information on streaming > - > > Key: CASSANDRA-14917 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14917 > Project: Cassandra > Issue Type: Bug > Components: Streaming and Messaging >Reporter: Igor Zubchenok >Assignee: Dinesh Joshi >Priority: Minor > > nodetool netstats command displays 'Sending 0 files' and non-zero 'bytes > total' during node decommission. > {code:java} > Sending 0 files, 198933290919 bytes total. Already sent 0 files, 0 bytes total > {code} > Complete notetool netstats response > {code:java} > # nodetool netstats | grep -v 100% > Mode: LEAVING > Unbootstrap 67096090-f604-11e8--03532290668f > /X.X.X.X > Sending 8039 files, 174905861575 bytes total. Already sent 3147 > files, 39883605552 bytes total > > /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100884-big-Data.db > 1866267759/8275615307 bytes(22%) sent to idx:0/5.9.54.111 > /X.X.X.X > Sending 5475 files, 167399940563 bytes total. Already sent 2416 > files, 49417386715 bytes total > > /var/lib/cassandra/data/app_tracks/tracks-bd8310f086b711e7b6cbfd84ea9f1f78/mc-459374-big-Data.db > 10192112/17529144 bytes(58%) sent to idx:0/5.9.59.101 > /X.X.X.X > Sending 5843 files, 181124719187 bytes total. Already sent 2613 > files, 57001466824 bytes total > > /var/lib/cassandra/data/app_tracks/tracks-bd8310f086b711e7b6cbfd84ea9f1f78/mc-461873-big-Data.db > 1439600/93308008 bytes(1%) sent to idx:0/46.4.31.97 > /X.X.X.X > Sending 7303 files, 213976795121 bytes total. Already sent 1811 > files, 28956350780 bytes total > > /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100465-big-Data.db > 3719051/37149976 bytes(10%) sent to idx:0/144.76.85.237 > /X.X.X.X > Sending 7893 files, 204271020294 bytes total. Already sent 2397 > files, 36086600359 bytes total > > /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100197-big-Data.db > 646314/8291439 bytes(7%) sent to idx:0/144.76.29.39 > /X.X.X.X > Sending 0 files, 198933290919 bytes total. Already sent 0 files, 0 > bytes total > /X.X.X.X > Sending 6159 files, 187102577561 bytes total. Already sent 1526 > files, 26019708822 bytes total > > /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100685-big-Data.db > 52211410/67213497 bytes(77%) sent to idx:0/144.76.85.182 > /X.X.X.X > Sending 6534 files, 193239644509 bytes total. Already sent 2367 > files, 48105187871 bytes total > > /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100884-big-Data.db > 5907583715/10068538729 bytes(58%) sent to idx:0/5.9.48.222 > /X.X.X.X > Sending 5923 files, 213438389441 bytes total. Already sent 1663 > files, 32469866925 bytes total > Read Repair Statistics: > Attempted: 3537331 > Mismatch (Blocking): 2193 > Mismatch (Background): 4326 > Pool NameActive Pending Completed Dropped > Large messages n/a18 87460 746 > Small messages n/a 8 9837560424 12410 > Gossip messages n/a 87666199 84717 > {code} > -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-14917) Nodetool netstats displays incorrect information on streaming
[ https://issues.apache.org/jira/browse/CASSANDRA-14917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711373#comment-16711373 ] Igor Zubchenok commented on CASSANDRA-14917: I bootstrap a new node to this cluster and there is the real 'screenshots' of the process with number of already sent files that isn't always increasing: 5>6>5>5>6 7>7>6>6>6 6>7>6>6>6 12>12>12>12>12 - ok 13>14>13>13>13 and number of files doesn't grow until bootstrap is finished. {code:java} -- Every 2.0s: nodetool netstats | grep -v 100% a13: Thu Dec 6 12:17:51 2018 Mode: JOINING Bootstrap 0d6aaca0-f943-11e8-b165-13c227abbdd3 /X.X.X.X Receiving 2144 files, 678588356474 bytes total. Already received 5 files, 593625256 bytes total app_tracks/metered_tracks 267601306/340975156 bytes(78%) received from idx:0/X.X.X.X /X.X.X.X Receiving 2791 files, 894961971209 bytes total. Already received 7 files, 977844994 bytes total /X.X.X.X Receiving 2448 files, 670153883888 bytes total. Already received 6 files, 288703706 bytes total app_tracks/metered_tracks 195338482/248380217 bytes(78%) received from idx:0/X.X.X.X /X.X.X.X Receiving 1771 files, 169619035230 bytes total. Already received 12 files, 4199353175 bytes total app_tracks/tracks 3611426622/4476905035 bytes(80%) received from idx:0/X.X.X.X /X.X.X.X Receiving 1606 files, 140966853868 bytes total. Already received 13 files, 186857054 bytes total app_tracks/tracks 6551929/346313177 bytes(1%) received from idx:0/X.X.X.X Read Repair Statistics: Attempted: 0 Mismatch (Blocking): 0 Mismatch (Background): 0 Pool Name Active Pending Completed Dropped Large messages n/a 1 0 1 Small messages n/a 3 37259963 1 Gossip messages n/a 8 19574 453 -- Every 2.0s: nodetool netstats | grep -v 100% a13: Thu Dec 6 12:18:11 2018 Mode: JOINING Bootstrap 0d6aaca0-f943-11e8-b165-13c227abbdd3 /X.X.X.X Receiving 2144 files, 678588356474 bytes total. Already received 6 files, 492152491 bytes total /X.X.X.X Receiving 2791 files, 894961971209 bytes total. Already received 7 files, 1195998824 bytes total /X.X.X.X Receiving 2448 files, 670153883888 bytes total. Already received 7 files, 303546968 bytes total /X.X.X.X Receiving 1771 files, 169619035230 bytes total. Already received 12 files, 4555465168 bytes total app_tracks/tracks 3967538615/4476905035 bytes(88%) received from idx:0/X.X.X.X /X.X.X.X Receiving 1606 files, 140966853868 bytes total. Already received 14 files, 526618302 bytes total Read Repair Statistics: Attempted: 0 Mismatch (Blocking): 0 Mismatch (Background): 0 Pool Name Active Pending Completed Dropped Large messages n/a 1 0 1 Small messages n/a 1 37385384 1 Gossip messages n/a 6 19640 455 -- Every 2.0s: nodetool netstats | grep -v 100% a13: Thu Dec 6 12:18:39 2018 Mode: JOINING Bootstrap 0d6aaca0-f943-11e8-b165-13c227abbdd3 /X.X.X.X Receiving 2144 files, 678588356474 bytes total. Already received 5 files, 679191606 bytes total app_tracks/metered_tracks 353167656/392570476 bytes(89%) received from idx:0/X.X.X.X /X.X.X.X Receiving 2791 files, 894961971209 bytes total. Already received 6 files, 961464028 bytes total app_tracks/metered_tracks 62614009/456870721 bytes(13%) received from idx:0/X.X.X.X /X.X.X.X Receiving 2448 files, 670153883888 bytes total. Already received 6 files, 278650726 bytes total app_tracks/metered_tracks 186554977/275613755 bytes(67%) received from idx:0/X.X.X.X /X.X.X.X Receiving 1771 files, 169619035230 bytes total. Already received 12 files, 5043265900 bytes total app_tracks/tracks 4455339347/4476905035 bytes(99%) received from idx:0/X.X.X.X /X.X.X.X Receiving 1606 files, 140966853868 bytes total. Already received 13 files, 315366847 bytes total app_tracks/tracks 135061722/222430762 bytes(60%) received from idx:0/X.X.X.X Read Repair Statistics: Attempted: 0 Mismatch (Blocking): 0 Mismatch (Background): 0 Pool Name Active Pending Completed Dropped Large messages n/a 1 0 1 Small messages n/a 2 37556944 1 Gossip messages n/a 1 19727 462 -- Every 2.0s: nodetool netstats | grep -v 100% a13: Thu Dec 6 12:18:50 2018 Mode: JOINING Bootstrap 0d6aaca0-f943-11e8-b165-13c227abbdd3 /X.X.X.X Receiving 2144 files, 678588356474 bytes total. Already received 5 files, 386382661 bytes total app_tracks/metered_tracks 60358711/326869568 bytes(18%) received from idx:0/X.X.X.X /X.X.X.X Receiving 2791 files, 894961971209 bytes total. Already received 6 files, 1146490391 bytes total app_tracks/metered_tracks 247640372/456870721 bytes(54%) received from idx:0/X.X.X.X
[jira] [Commented] (CASSANDRA-14917) Nodetool netstats displays incorrect information on streaming
[ https://issues.apache.org/jira/browse/CASSANDRA-14917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707520#comment-16707520 ] Igor Zubchenok commented on CASSANDRA-14917: I noticed that "0 files" node has been unexpectedly rebooted during decommission of the current node. At the end of decommission I got a decommission exception at the current node. So I retried decommission, and then the current node successfully streamed all data only to "0 files" node and decommission finally succeeded. P.S. While I bootstrapped a new node in this cluster, there was incorrect display of progress also: At some moment I noticed that nodetool status shows alternately "12 files sent" or "13 files sent" and again "12 files sent", then "13 files sent", etc. [sample] I saw it like this: {code:java} Sending 7893 files, 204271020294 bytes total. Already sent 12 files, XXX bytes total {code} after next file is streamed, it changed to 13 files {code:java} Sending 7893 files, 204271020294 bytes total. Already sent 13 files, XXX bytes total{code} and later it showed again 12 files: {code:java} Sending 7893 files, 204271020294 bytes total. Already sent 12 files, XXX bytes total{code} etc. > Nodetool netstats displays incorrect information on streaming > - > > Key: CASSANDRA-14917 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14917 > Project: Cassandra > Issue Type: Bug > Components: Streaming and Messaging >Reporter: Igor Zubchenok >Assignee: Dinesh Joshi >Priority: Minor > > nodetool netstats command displays 'Sending 0 files' and non-zero 'bytes > total' during node decommission. > {code:java} > Sending 0 files, 198933290919 bytes total. Already sent 0 files, 0 bytes total > {code} > Complete notetool netstats response > {code:java} > # nodetool netstats | grep -v 100% > Mode: LEAVING > Unbootstrap 67096090-f604-11e8--03532290668f > /X.X.X.X > Sending 8039 files, 174905861575 bytes total. Already sent 3147 > files, 39883605552 bytes total > > /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100884-big-Data.db > 1866267759/8275615307 bytes(22%) sent to idx:0/5.9.54.111 > /X.X.X.X > Sending 5475 files, 167399940563 bytes total. Already sent 2416 > files, 49417386715 bytes total > > /var/lib/cassandra/data/app_tracks/tracks-bd8310f086b711e7b6cbfd84ea9f1f78/mc-459374-big-Data.db > 10192112/17529144 bytes(58%) sent to idx:0/5.9.59.101 > /X.X.X.X > Sending 5843 files, 181124719187 bytes total. Already sent 2613 > files, 57001466824 bytes total > > /var/lib/cassandra/data/app_tracks/tracks-bd8310f086b711e7b6cbfd84ea9f1f78/mc-461873-big-Data.db > 1439600/93308008 bytes(1%) sent to idx:0/46.4.31.97 > /X.X.X.X > Sending 7303 files, 213976795121 bytes total. Already sent 1811 > files, 28956350780 bytes total > > /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100465-big-Data.db > 3719051/37149976 bytes(10%) sent to idx:0/144.76.85.237 > /X.X.X.X > Sending 7893 files, 204271020294 bytes total. Already sent 2397 > files, 36086600359 bytes total > > /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100197-big-Data.db > 646314/8291439 bytes(7%) sent to idx:0/144.76.29.39 > /X.X.X.X > Sending 0 files, 198933290919 bytes total. Already sent 0 files, 0 > bytes total > /X.X.X.X > Sending 6159 files, 187102577561 bytes total. Already sent 1526 > files, 26019708822 bytes total > > /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100685-big-Data.db > 52211410/67213497 bytes(77%) sent to idx:0/144.76.85.182 > /X.X.X.X > Sending 6534 files, 193239644509 bytes total. Already sent 2367 > files, 48105187871 bytes total > > /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100884-big-Data.db > 5907583715/10068538729 bytes(58%) sent to idx:0/5.9.48.222 > /X.X.X.X > Sending 5923 files, 213438389441 bytes total. Already sent 1663 > files, 32469866925 bytes total > Read Repair Statistics: > Attempted: 3537331 > Mismatch (Blocking): 2193 > Mismatch (Background): 4326 > Pool NameActive Pending Completed Dropped > Large messages n/a18 87460 746 > Small messages n/a 8 9837560424 12410 > Gossip messages n/a 87666199 84717 > {code} > -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail:
[jira] [Created] (CASSANDRA-14917) Nodetool netstats displays incorrect information on streaming
Igor Zubchenok created CASSANDRA-14917: -- Summary: Nodetool netstats displays incorrect information on streaming Key: CASSANDRA-14917 URL: https://issues.apache.org/jira/browse/CASSANDRA-14917 Project: Cassandra Issue Type: Bug Components: Streaming and Messaging Reporter: Igor Zubchenok nodetool netstats command displays 'Sending 0 files' and non-zero 'bytes total' during node decommission. {code:java} Sending 0 files, 198933290919 bytes total. Already sent 0 files, 0 bytes total {code} Complete notetool netstats response {code:java} # nodetool netstats | grep -v 100% Mode: LEAVING Unbootstrap 67096090-f604-11e8--03532290668f /X.X.X.X Sending 8039 files, 174905861575 bytes total. Already sent 3147 files, 39883605552 bytes total /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100884-big-Data.db 1866267759/8275615307 bytes(22%) sent to idx:0/5.9.54.111 /X.X.X.X Sending 5475 files, 167399940563 bytes total. Already sent 2416 files, 49417386715 bytes total /var/lib/cassandra/data/app_tracks/tracks-bd8310f086b711e7b6cbfd84ea9f1f78/mc-459374-big-Data.db 10192112/17529144 bytes(58%) sent to idx:0/5.9.59.101 /X.X.X.X Sending 5843 files, 181124719187 bytes total. Already sent 2613 files, 57001466824 bytes total /var/lib/cassandra/data/app_tracks/tracks-bd8310f086b711e7b6cbfd84ea9f1f78/mc-461873-big-Data.db 1439600/93308008 bytes(1%) sent to idx:0/46.4.31.97 /X.X.X.X Sending 7303 files, 213976795121 bytes total. Already sent 1811 files, 28956350780 bytes total /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100465-big-Data.db 3719051/37149976 bytes(10%) sent to idx:0/144.76.85.237 /X.X.X.X Sending 7893 files, 204271020294 bytes total. Already sent 2397 files, 36086600359 bytes total /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100197-big-Data.db 646314/8291439 bytes(7%) sent to idx:0/144.76.29.39 /X.X.X.X Sending 0 files, 198933290919 bytes total. Already sent 0 files, 0 bytes total /X.X.X.X Sending 6159 files, 187102577561 bytes total. Already sent 1526 files, 26019708822 bytes total /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100685-big-Data.db 52211410/67213497 bytes(77%) sent to idx:0/144.76.85.182 /X.X.X.X Sending 6534 files, 193239644509 bytes total. Already sent 2367 files, 48105187871 bytes total /var/lib/cassandra/data/app_tracks/tracks-bfd4a21086b711e7b6cbfd84ea9f1f78/mc-100884-big-Data.db 5907583715/10068538729 bytes(58%) sent to idx:0/5.9.48.222 /X.X.X.X Sending 5923 files, 213438389441 bytes total. Already sent 1663 files, 32469866925 bytes total Read Repair Statistics: Attempted: 3537331 Mismatch (Blocking): 2193 Mismatch (Background): 4326 Pool NameActive Pending Completed Dropped Large messages n/a18 87460 746 Small messages n/a 8 9837560424 12410 Gossip messages n/a 87666199 84717 {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Updated] (CASSANDRA-14224) Failed to create merkel tree
[ https://issues.apache.org/jira/browse/CASSANDRA-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-14224: --- Description: While repairing a node with nodetool -full -pr -dcpar, another node throws an AssertionError and failed to create merkel tree. There is no information what is wrong and how to fix in logs. {code:java} DEBUG [ValidationExecutor:25] 2018-02-08 21:31:42,581 SSTableReader.java:503 - Opening /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-35-big (1.876KiB) DEBUG [ValidationExecutor:39] 2018-02-08 21:31:42,581 SSTableReader.java:503 - Opening /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-35-big (1.876KiB) DEBUG [ValidationExecutor:39] 2018-02-08 21:31:42,586 SSTableReader.java:503 - Opening /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-36-big (0.688KiB) ERROR [ValidationExecutor:25] 2018-02-08 21:31:42,586 Validator.java:268 - Failed creating a merkle tree for [repair #69803961-0d17-11e8-950c-37c5a1498597 on prod/invoices, [(-4165282778092010776,-4162024061639141985]]], /88.99.35.178 (see log for details) ERROR [ValidationExecutor:25] 2018-02-08 21:31:42,587 CassandraDaemon.java:228 - Exception in thread Thread[ValidationExecutor:25,1,main] java.lang.AssertionError: null at org.apache.cassandra.io.sstable.format.SSTableReader$GlobalTidy.get(SSTableReader.java:2313) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier.setup(SSTableReader.java:2138) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.io.sstable.format.SSTableReader.setup(SSTableReader.java:2081) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.io.sstable.format.SSTableReader.open(SSTableReader.java:519) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.db.ColumnFamilyStore.getSnapshotSSTableReader(ColumnFamilyStore.java:1901) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.db.compaction.CompactionManager.doValidationCompaction(CompactionManager.java:1335) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.db.compaction.CompactionManager.access$700(CompactionManager.java:86) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.db.compaction.CompactionManager$13.call(CompactionManager.java:942) ~[apache-cassandra-3.11.1.jar:3.11.1] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_151] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_151] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_151] at org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81) [apache-cassandra-3.11.1.jar:3.11.1] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_151] DEBUG [ValidationExecutor:39] 2018-02-08 21:31:42,588 SSTableReader.java:503 - Opening /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-33-big (9.891MiB) ERROR [NonPeriodicTasks:1] 2018-02-08 21:31:42,589 CassandraDaemon.java:228 - Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.NullPointerException: null at org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier$1.run(SSTableReader.java:2192) ~[apache-cassandra-3.11.1.jar:3.11.1] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_151] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_151] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_151] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[na:1.8.0_151] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_151] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_151] at org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81) [apache-cassandra-3.11.1.jar:3.11.1] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_151]{code} was: While repairing a node with nodetool -full -pr -dcpar, another node throws an assertion exception and failed to create merkel tree: {code:java} DEBUG [ValidationExecutor:25] 2018-02-08 21:31:42,581 SSTableReader.java:503 - Opening /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-35-big (1.876KiB) DEBUG [ValidationExecutor:39] 2018-02-08 21:31:42,581 SSTableReader.java:503 - Opening
[jira] [Updated] (CASSANDRA-14224) Failed to create merkel tree
[ https://issues.apache.org/jira/browse/CASSANDRA-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-14224: --- Description: While repairing a node with nodetool -full -pr -dcpar, another node throws an assertion exception and failed to create merkel tree: {code:java} DEBUG [ValidationExecutor:25] 2018-02-08 21:31:42,581 SSTableReader.java:503 - Opening /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-35-big (1.876KiB) DEBUG [ValidationExecutor:39] 2018-02-08 21:31:42,581 SSTableReader.java:503 - Opening /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-35-big (1.876KiB) DEBUG [ValidationExecutor:39] 2018-02-08 21:31:42,586 SSTableReader.java:503 - Opening /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-36-big (0.688KiB) ERROR [ValidationExecutor:25] 2018-02-08 21:31:42,586 Validator.java:268 - Failed creating a merkle tree for [repair #69803961-0d17-11e8-950c-37c5a1498597 on prod/invoices, [(-4165282778092010776,-4162024061639141985]]], /88.99.35.178 (see log for details) ERROR [ValidationExecutor:25] 2018-02-08 21:31:42,587 CassandraDaemon.java:228 - Exception in thread Thread[ValidationExecutor:25,1,main] java.lang.AssertionError: null at org.apache.cassandra.io.sstable.format.SSTableReader$GlobalTidy.get(SSTableReader.java:2313) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier.setup(SSTableReader.java:2138) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.io.sstable.format.SSTableReader.setup(SSTableReader.java:2081) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.io.sstable.format.SSTableReader.open(SSTableReader.java:519) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.db.ColumnFamilyStore.getSnapshotSSTableReader(ColumnFamilyStore.java:1901) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.db.compaction.CompactionManager.doValidationCompaction(CompactionManager.java:1335) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.db.compaction.CompactionManager.access$700(CompactionManager.java:86) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.db.compaction.CompactionManager$13.call(CompactionManager.java:942) ~[apache-cassandra-3.11.1.jar:3.11.1] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_151] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_151] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_151] at org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81) [apache-cassandra-3.11.1.jar:3.11.1] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_151] DEBUG [ValidationExecutor:39] 2018-02-08 21:31:42,588 SSTableReader.java:503 - Opening /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-33-big (9.891MiB) ERROR [NonPeriodicTasks:1] 2018-02-08 21:31:42,589 CassandraDaemon.java:228 - Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.NullPointerException: null at org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier$1.run(SSTableReader.java:2192) ~[apache-cassandra-3.11.1.jar:3.11.1] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_151] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_151] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_151] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[na:1.8.0_151] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_151] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_151] at org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81) [apache-cassandra-3.11.1.jar:3.11.1] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_151]{code} was: While repairing a node with nodetool -full -pr -dcpar, another node throws an assertion exception and failed to create merkel tree: {code:java} DEBUG [ValidationExecutor:25] 2018-02-08 21:31:42,581 SSTableReader.java:503 - Opening /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-35-big (1.876KiB) DEBUG [ValidationExecutor:39] 2018-02-08 21:31:42,581 SSTableReader.java:503 - Opening
[jira] [Created] (CASSANDRA-14224) Failed to create merkel tree
Igor Zubchenok created CASSANDRA-14224: -- Summary: Failed to create merkel tree Key: CASSANDRA-14224 URL: https://issues.apache.org/jira/browse/CASSANDRA-14224 Project: Cassandra Issue Type: Bug Components: Repair Reporter: Igor Zubchenok While repairing a node with nodetool -full -pr -dcpar, another node throws an assertion exception and failed to create merkel tree: {code:java} DEBUG [ValidationExecutor:25] 2018-02-08 21:31:42,581 SSTableReader.java:503 - Opening /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-35-big (1.876KiB) DEBUG [ValidationExecutor:39] 2018-02-08 21:31:42,581 SSTableReader.java:503 - Opening /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-35-big (1.876KiB) DEBUG [ValidationExecutor:39] 2018-02-08 21:31:42,586 SSTableReader.java:503 - Opening /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-36-big (0.688KiB) ERROR [ValidationExecutor:25] 2018-02-08 21:31:42,586 Validator.java:268 - Failed creating a merkle tree for [repair #69803961-0d17-11e8-950c-37c5a1498597 on prod/invoices, [(-4165282778092010776,-4162024061639141985]]], /88.99.35.178 (see log for details) ERROR [ValidationExecutor:25] 2018-02-08 21:31:42,587 CassandraDaemon.java:228 - Exception in thread Thread[ValidationExecutor:25,1,main] java.lang.AssertionError: null at org.apache.cassandra.io.sstable.format.SSTableReader$GlobalTidy.get(SSTableReader.java:2313) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier.setup(SSTableReader.java:2138) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.io.sstable.format.SSTableReader.setup(SSTableReader.java:2081) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.io.sstable.format.SSTableReader.open(SSTableReader.java:519) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.db.ColumnFamilyStore.getSnapshotSSTableReader(ColumnFamilyStore.java:1901) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.db.compaction.CompactionManager.doValidationCompaction(CompactionManager.java:1335) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.db.compaction.CompactionManager.access$700(CompactionManager.java:86) ~[apache-cassandra-3.11.1.jar:3.11.1] at org.apache.cassandra.db.compaction.CompactionManager$13.call(CompactionManager.java:942) ~[apache-cassandra-3.11.1.jar:3.11.1] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_151] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_151] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_151] at org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81) [apache-cassandra-3.11.1.jar:3.11.1] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_151] DEBUG [ValidationExecutor:39] 2018-02-08 21:31:42,588 SSTableReader.java:503 - Opening /var/lib/cassandra/data/prod/invoices-a8454000c10711e4896155ab730ce02d/snapshots/689d7a80-0d17-11e8-950c-37c5a1498597/mc-33-big (9.891MiB) ERROR [NonPeriodicTasks:1] 2018-02-08 21:31:42,589 CassandraDaemon.java:228 - Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.NullPointerException: null at org.apache.cassandra.io.sstable.format.SSTableReader$InstanceTidier$1.run(SSTableReader.java:2192) ~[apache-cassandra-3.11.1.jar:3.11.1] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_151] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_151] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[na:1.8.0_151] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[na:1.8.0_151] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_151] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_151] at org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81) [apache-cassandra-3.11.1.jar:3.11.1] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_151] {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Issue Comment Deleted] (CASSANDRA-10368) Support Restricting non-PK Cols in Materialized View Select Statements
[ https://issues.apache.org/jira/browse/CASSANDRA-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-10368: --- Comment: was deleted (was: This does not work for me in Cassandra 3.11.1, I get error: `Non-primary key columns cannot be restricted in the SELECT statement used for materialized view creation (got restrictions on: amount)` {code:java} CREATE TABLE cc_transactions ( userid text, year int, month int, day int, id int, amount int, card text, status text, PRIMARY KEY ((userid, year), month, day, id) ); CREATE MATERIALIZED VIEW suspicious_transactions AS SELECT userid, year, month, day, id, amount, card, status FROM cc_transactions WHERE userid IS NOT NULL AND year IS NOT NULL AND month IS NOT NULL AND day IS NOT NULL AND id IS NOT NULL AND amount > 1000 PRIMARY KEY ((userid, year), month, day, id); InvalidRequest: Error from server: code=2200 [Invalid query] message="Non-primary key columns cannot be restricted in the SELECT statement used for materialized view creation (got restrictions on: amount)" {code} Is it a bug? ) > Support Restricting non-PK Cols in Materialized View Select Statements > -- > > Key: CASSANDRA-10368 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10368 > Project: Cassandra > Issue Type: Improvement > Components: CQL, Materialized Views >Reporter: Tyler Hobbs >Assignee: Jochen Niebuhr >Priority: Minor > Fix For: 3.10 > > Attachments: 10368-3.8.txt > > > CASSANDRA-9664 allows materialized views to restrict primary key columns in > the select statement. Due to CASSANDRA-10261, the patch did not include > support for restricting non-PK columns. Now that the timestamp issue has > been resolved, we can add support for this. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-10368) Support Restricting non-PK Cols in Materialized View Select Statements
[ https://issues.apache.org/jira/browse/CASSANDRA-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351564#comment-16351564 ] Igor Zubchenok commented on CASSANDRA-10368: This does not work for me in Cassandra 3.11.1, I get error: `Non-primary key columns cannot be restricted in the SELECT statement used for materialized view creation (got restrictions on: amount)` {code:java} CREATE TABLE cc_transactions ( userid text, year int, month int, day int, id int, amount int, card text, status text, PRIMARY KEY ((userid, year), month, day, id) ); CREATE MATERIALIZED VIEW suspicious_transactions AS SELECT userid, year, month, day, id, amount, card, status FROM cc_transactions WHERE userid IS NOT NULL AND year IS NOT NULL AND month IS NOT NULL AND day IS NOT NULL AND id IS NOT NULL AND amount > 1000 PRIMARY KEY ((userid, year), month, day, id); InvalidRequest: Error from server: code=2200 [Invalid query] message="Non-primary key columns cannot be restricted in the SELECT statement used for materialized view creation (got restrictions on: amount)" {code} Is it a bug? > Support Restricting non-PK Cols in Materialized View Select Statements > -- > > Key: CASSANDRA-10368 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10368 > Project: Cassandra > Issue Type: Improvement > Components: CQL, Materialized Views >Reporter: Tyler Hobbs >Assignee: Jochen Niebuhr >Priority: Minor > Fix For: 3.10 > > Attachments: 10368-3.8.txt > > > CASSANDRA-9664 allows materialized views to restrict primary key columns in > the select statement. Due to CASSANDRA-10261, the patch did not include > support for restricting non-PK columns. Now that the timestamp issue has > been resolved, we can add support for this. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Comment Edited] (CASSANDRA-10050) Secondary Index Performance Dependent on TokenRange Searched in Analytics
[ https://issues.apache.org/jira/browse/CASSANDRA-10050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128163#comment-16128163 ] Igor Zubchenok edited comment on CASSANDRA-10050 at 8/16/17 12:53 AM: -- Is there any chance to have it resolved in coming releases? >From my point of view it looks like -architecture design- implementation >problem, cause if indexes are sorted by token, why you cannot just use the >binary search to find start token? was (Author: geagle): Is there any chance to have it resolved in coming releases? >From my point of view it looks like architecture design problem, cause if >indexes are sorted by token, why you cannot just use the binary search to find >start token? > Secondary Index Performance Dependent on TokenRange Searched in Analytics > - > > Key: CASSANDRA-10050 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10050 > Project: Cassandra > Issue Type: Improvement > Components: Secondary Indexes > Environment: Single node, macbook, 2.1.8 >Reporter: Russell Spitzer > Fix For: 4.x > > > In doing some test work on the Spark Cassandra Connector I saw some odd > performance when pushing down range queries with Secondary Index filters. > When running the queries we see huge amount of time when the C* server is not > doing any work and the query seem to be hanging. This investigation led to > the work in this document > https://docs.google.com/spreadsheets/d/1aJg3KX7nPnY77RJ9ZT-IfaYADgJh0A--nAxItvC6hb4/edit#gid=0 > The Spark Cassandra Connector builds up token range specific queries and > allows the user to pushdown relevant fields to C*. Here we have two indexed > fields (size) and (color) being pushed down to C*. > {code} > SELECT count(*) FROM ks.tab WHERE token("store") > $min AND token("store") <= > $max AND color = 'red' AND size = 'P' ALLOW FILTERING;{code} > These queries will have different token ranges inserted and executed as > separate spark tasks. Spark tasks with token ranges near the Min(token) end > up executing much faster than those near Max(token) which also happen to > through errors. > {code} > Coordinator node timed out waiting for replica nodes' responses] > message="Operation timed out - received only 0 responses." > info={'received_responses': 0, 'required_responses': 1, 'consistency': 'ONE'} > {code} > I took the queries and ran them through CQLSH to see the difference in time. > A linear relationship is seen based on where the tokenRange being queried is > starting with only 2 second for queries near the beginning of the full token > spectrum and over 12 seconds at the end of the spectrum. > The question is, can this behavior be improved? or should we not recommend > using secondary indexes with Analytics workloads? -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Comment Edited] (CASSANDRA-10050) Secondary Index Performance Dependent on TokenRange Searched in Analytics
[ https://issues.apache.org/jira/browse/CASSANDRA-10050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128163#comment-16128163 ] Igor Zubchenok edited comment on CASSANDRA-10050 at 8/16/17 12:53 AM: -- Is there any chance to have it resolved in coming releases? >From my point of view it looks like -architecture design- implementation >problem, cause if indexes are sorted by token, why you cannot just use the >binary search to find start token? was (Author: geagle): Is there any chance to have it resolved in coming releases? >From my point of view it looks like -architecture design- implementation >problem, cause if indexes are sorted by token, why you cannot just use the >binary search to find start token? > Secondary Index Performance Dependent on TokenRange Searched in Analytics > - > > Key: CASSANDRA-10050 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10050 > Project: Cassandra > Issue Type: Improvement > Components: Secondary Indexes > Environment: Single node, macbook, 2.1.8 >Reporter: Russell Spitzer > Fix For: 4.x > > > In doing some test work on the Spark Cassandra Connector I saw some odd > performance when pushing down range queries with Secondary Index filters. > When running the queries we see huge amount of time when the C* server is not > doing any work and the query seem to be hanging. This investigation led to > the work in this document > https://docs.google.com/spreadsheets/d/1aJg3KX7nPnY77RJ9ZT-IfaYADgJh0A--nAxItvC6hb4/edit#gid=0 > The Spark Cassandra Connector builds up token range specific queries and > allows the user to pushdown relevant fields to C*. Here we have two indexed > fields (size) and (color) being pushed down to C*. > {code} > SELECT count(*) FROM ks.tab WHERE token("store") > $min AND token("store") <= > $max AND color = 'red' AND size = 'P' ALLOW FILTERING;{code} > These queries will have different token ranges inserted and executed as > separate spark tasks. Spark tasks with token ranges near the Min(token) end > up executing much faster than those near Max(token) which also happen to > through errors. > {code} > Coordinator node timed out waiting for replica nodes' responses] > message="Operation timed out - received only 0 responses." > info={'received_responses': 0, 'required_responses': 1, 'consistency': 'ONE'} > {code} > I took the queries and ran them through CQLSH to see the difference in time. > A linear relationship is seen based on where the tokenRange being queried is > starting with only 2 second for queries near the beginning of the full token > spectrum and over 12 seconds at the end of the spectrum. > The question is, can this behavior be improved? or should we not recommend > using secondary indexes with Analytics workloads? -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-10050) Secondary Index Performance Dependent on TokenRange Searched in Analytics
[ https://issues.apache.org/jira/browse/CASSANDRA-10050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128163#comment-16128163 ] Igor Zubchenok commented on CASSANDRA-10050: Is there any chance to have it resolved in coming releases? >From my point of view it looks like architecture design problem, cause if >indexes are sorted by token, why you cannot just use the binary search to find >start token? > Secondary Index Performance Dependent on TokenRange Searched in Analytics > - > > Key: CASSANDRA-10050 > URL: https://issues.apache.org/jira/browse/CASSANDRA-10050 > Project: Cassandra > Issue Type: Improvement > Components: Secondary Indexes > Environment: Single node, macbook, 2.1.8 >Reporter: Russell Spitzer > Fix For: 4.x > > > In doing some test work on the Spark Cassandra Connector I saw some odd > performance when pushing down range queries with Secondary Index filters. > When running the queries we see huge amount of time when the C* server is not > doing any work and the query seem to be hanging. This investigation led to > the work in this document > https://docs.google.com/spreadsheets/d/1aJg3KX7nPnY77RJ9ZT-IfaYADgJh0A--nAxItvC6hb4/edit#gid=0 > The Spark Cassandra Connector builds up token range specific queries and > allows the user to pushdown relevant fields to C*. Here we have two indexed > fields (size) and (color) being pushed down to C*. > {code} > SELECT count(*) FROM ks.tab WHERE token("store") > $min AND token("store") <= > $max AND color = 'red' AND size = 'P' ALLOW FILTERING;{code} > These queries will have different token ranges inserted and executed as > separate spark tasks. Spark tasks with token ranges near the Min(token) end > up executing much faster than those near Max(token) which also happen to > through errors. > {code} > Coordinator node timed out waiting for replica nodes' responses] > message="Operation timed out - received only 0 responses." > info={'received_responses': 0, 'required_responses': 1, 'consistency': 'ONE'} > {code} > I took the queries and ran them through CQLSH to see the difference in time. > A linear relationship is seen based on where the tokenRange being queried is > starting with only 2 second for queries near the beginning of the full token > spectrum and over 12 seconds at the end of the spectrum. > The question is, can this behavior be improved? or should we not recommend > using secondary indexes with Analytics workloads? -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Comment Edited] (CASSANDRA-6246) EPaxos
[ https://issues.apache.org/jira/browse/CASSANDRA-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128159#comment-16128159 ] Igor Zubchenok edited comment on CASSANDRA-6246 at 8/16/17 12:45 AM: - I would like to try, but I'm not familiar with Cassandra source code. :( Isn't it easier to implement the patch again, but without rebase from 4 year old code? BTW, I'm looking for a solution to implement a *reference counter based on Cassandra*. My first reference counter implementation has been made on counter columns, but unfortunately it had been ruined with tombstones issue - when a counter get back to zero, I cannot delete nor compact it. My guess was that the lightweight Cassandra transactions can do a very good job for my task. I was so naive and now I have an issue with WriteTimeoutException and inconsistent state. The only workaround I came up with today is to do an exclusive lock that can be easily made with LWT with TTL, and subsequent change of a value, but it will have much more greater performance hit. I'm still looking for a good solution on that with Cassandra. Currently I'm naive again and expecting that EPaxos will help me, but seems it will never-never be merged and released. Dear community, do you have any idea? P.S. Huge thanks and warm hugs to everyone who answers me! was (Author: geagle): I would like to try, but I'm not familiar with Cassandra source code. :( Isn't it easier to implement the patch again, but without rebase from 4 year old code? BTW, I'm looking for a solution to implement a *reference counter based on Cassandra*. My first reference counter implementation has been made on counter columns, but unfortunately it had been ruined with tombstones issue - when a counter get back to zero, I cannot delete nor compact it. My guess was that the lightweight Cassandra transactions can do a very good job for my task. I was so naive and now I have an issue with WriteTimeoutException and inconsistent state. The only workaround I came up with today is to do an exclusive lock that can be easily made with LWT with TTL, and subsequent change of a value, but it will have much more greater performance hit. I'm still looking for a good solution on that with Cassandra. Currently I'm naive again and expecting that EPaxos will help me, but seems it will never-never be merged and released. Dear community, do you have any idea? Huge thanks to everyone who answers me. > EPaxos > -- > > Key: CASSANDRA-6246 > URL: https://issues.apache.org/jira/browse/CASSANDRA-6246 > Project: Cassandra > Issue Type: Improvement >Reporter: Jonathan Ellis >Assignee: Blake Eggleston > Labels: messaging-service-bump-required > Fix For: 4.x > > > One reason we haven't optimized our Paxos implementation with Multi-paxos is > that Multi-paxos requires leader election and hence, a period of > unavailability when the leader dies. > EPaxos is a Paxos variant that requires (1) less messages than multi-paxos, > (2) is particularly useful across multiple datacenters, and (3) allows any > node to act as coordinator: > http://sigops.org/sosp/sosp13/papers/p358-moraru.pdf > However, there is substantial additional complexity involved if we choose to > implement it. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Comment Edited] (CASSANDRA-6246) EPaxos
[ https://issues.apache.org/jira/browse/CASSANDRA-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128159#comment-16128159 ] Igor Zubchenok edited comment on CASSANDRA-6246 at 8/16/17 12:45 AM: - I would like to try, but I'm not familiar with Cassandra source code. :( Isn't it easier to implement the patch again, but without rebase from 4 year old code? BTW, I'm looking for a solution to implement a *reference counter based on Cassandra*. My first reference counter implementation has been made on counter columns, but unfortunately it had been ruined with tombstones issue - when a counter get back to zero, I cannot delete nor compact it. My guess was that the lightweight Cassandra transactions can do a very good job for my task. I was so naive and now I have an issue with WriteTimeoutException and inconsistent state. The only workaround I came up with today is to do an exclusive lock that can be easily made with LWT with TTL, and subsequent change of a value, but it will have much more greater performance hit. I'm still looking for a good solution on that with Cassandra. Currently I'm naive again and expecting that EPaxos will help me, but seems it will never-never be merged and released. Dear community, do you have any idea? P.S. Huge thanks and warm hugs to everyone who answers to me! was (Author: geagle): I would like to try, but I'm not familiar with Cassandra source code. :( Isn't it easier to implement the patch again, but without rebase from 4 year old code? BTW, I'm looking for a solution to implement a *reference counter based on Cassandra*. My first reference counter implementation has been made on counter columns, but unfortunately it had been ruined with tombstones issue - when a counter get back to zero, I cannot delete nor compact it. My guess was that the lightweight Cassandra transactions can do a very good job for my task. I was so naive and now I have an issue with WriteTimeoutException and inconsistent state. The only workaround I came up with today is to do an exclusive lock that can be easily made with LWT with TTL, and subsequent change of a value, but it will have much more greater performance hit. I'm still looking for a good solution on that with Cassandra. Currently I'm naive again and expecting that EPaxos will help me, but seems it will never-never be merged and released. Dear community, do you have any idea? P.S. Huge thanks and warm hugs to everyone who answers me! > EPaxos > -- > > Key: CASSANDRA-6246 > URL: https://issues.apache.org/jira/browse/CASSANDRA-6246 > Project: Cassandra > Issue Type: Improvement >Reporter: Jonathan Ellis >Assignee: Blake Eggleston > Labels: messaging-service-bump-required > Fix For: 4.x > > > One reason we haven't optimized our Paxos implementation with Multi-paxos is > that Multi-paxos requires leader election and hence, a period of > unavailability when the leader dies. > EPaxos is a Paxos variant that requires (1) less messages than multi-paxos, > (2) is particularly useful across multiple datacenters, and (3) allows any > node to act as coordinator: > http://sigops.org/sosp/sosp13/papers/p358-moraru.pdf > However, there is substantial additional complexity involved if we choose to > implement it. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Comment Edited] (CASSANDRA-6246) EPaxos
[ https://issues.apache.org/jira/browse/CASSANDRA-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128159#comment-16128159 ] Igor Zubchenok edited comment on CASSANDRA-6246 at 8/16/17 12:44 AM: - I would like to try, but I'm not familiar with Cassandra source code. :( Isn't it easier to implement the patch again, but without rebase from 4 year old code? BTW, I'm looking for a solution to implement a *reference counter based on Cassandra*. My first reference counter implementation has been made on counter columns, but unfortunately it had been ruined with tombstones issue - when a counter get back to zero, I cannot delete nor compact it. My guess was that the lightweight Cassandra transactions can do a very good job for my task. I was so naive and now I have an issue with WriteTimeoutException and inconsistent state. The only workaround I came up with today is to do an exclusive lock that can be easily made with LWT with TTL, and subsequent change of a value, but it will have much more greater performance hit. I'm still looking for a good solution on that with Cassandra. Currently I'm naive again and expecting that EPaxos will help me, but seems it will never-never be merged and released. Dear community, do you have any idea? Huge thanks to everyone who answers me. was (Author: geagle): I would like to try, but I'm not familiar with Cassandra source code. :( Isn't it easier to implement the patch again, but without rebase from 4 year old code? BTW, I'm looking for a solution to implement a *reference counter based on Cassandra*. My first reference counter implementation has been made on counter columns, but unfortunately it had been ruined with tombstones issue - when a counter get back to zero, I cannot delete nor compact it. My guess was that the lightweight Cassandra transactions can do a very good job for my task. I was so naive and now I have an issue with WriteTimeoutException and inconsistent state. The only workaround I came up with today is to do an exclusive lock that can be easily made with LWT with TTL, and subsequent change of a value, but it will have much more greater performance hit. I'm still looking for a good solution on that with Cassandra. Currently I'm naive again and expecting that EPaxos will help me, but seems it will never-never be merged and released. Dear community, do you have any idea? Huge thanks to everyone who answer me. > EPaxos > -- > > Key: CASSANDRA-6246 > URL: https://issues.apache.org/jira/browse/CASSANDRA-6246 > Project: Cassandra > Issue Type: Improvement >Reporter: Jonathan Ellis >Assignee: Blake Eggleston > Labels: messaging-service-bump-required > Fix For: 4.x > > > One reason we haven't optimized our Paxos implementation with Multi-paxos is > that Multi-paxos requires leader election and hence, a period of > unavailability when the leader dies. > EPaxos is a Paxos variant that requires (1) less messages than multi-paxos, > (2) is particularly useful across multiple datacenters, and (3) allows any > node to act as coordinator: > http://sigops.org/sosp/sosp13/papers/p358-moraru.pdf > However, there is substantial additional complexity involved if we choose to > implement it. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Comment Edited] (CASSANDRA-6246) EPaxos
[ https://issues.apache.org/jira/browse/CASSANDRA-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128159#comment-16128159 ] Igor Zubchenok edited comment on CASSANDRA-6246 at 8/16/17 12:44 AM: - I would like to try, but I'm not familiar with Cassandra source code. :( Isn't it easier to implement the patch again, but without rebase from 4 year old code? BTW, I'm looking for a solution to implement a *reference counter based on Cassandra*. My first reference counter implementation has been made on counter columns, but unfortunately it had been ruined with tombstones issue - when a counter get back to zero, I cannot delete nor compact it. My guess was that the lightweight Cassandra transactions can do a very good job for my task. I was so naive and now I have an issue with WriteTimeoutException and inconsistent state. The only workaround I came up with today is to do an exclusive lock that can be easily made with LWT with TTL, and subsequent change of a value, but it will have much more greater performance hit. I'm still looking for a good solution on that with Cassandra. Currently I'm naive again and expecting that EPaxos will help me, but seems it will never-never be merged and released. Dear community, do you have any idea? Huge thanks to everyone who answer me. was (Author: geagle): I would like to try, but I'm not familiar with Cassandra source code. :( Isn't it easier to implement the patch again, but without rebase from 4 year old code? BTW, I'm looking for a solution to implement a *reference counter based on Cassandra*. My first reference counter implementation has been made on counter columns, but unfortunately it had been ruined with tombstones issue - when a counter get back to zero, I cannot delete nor compact it. My guess was that the lightweight Cassandra transactions can do a very good job for my task. I was so naive and now I have an issue with WriteTimeoutException and inconsistent state. The only workaround I came up with today is to do an exclusive lock that can be easily made with LWT with TLL, and subsequent change of a value, but it will have much more greater performance hit. I'm still looking for a good solution on that with Cassandra. Currently I'm naive again and expecting that EPaxos will help me, but seems it will never-never be merged and released. Dear community, do you have any idea? Huge thanks to everyone who answer me. > EPaxos > -- > > Key: CASSANDRA-6246 > URL: https://issues.apache.org/jira/browse/CASSANDRA-6246 > Project: Cassandra > Issue Type: Improvement >Reporter: Jonathan Ellis >Assignee: Blake Eggleston > Labels: messaging-service-bump-required > Fix For: 4.x > > > One reason we haven't optimized our Paxos implementation with Multi-paxos is > that Multi-paxos requires leader election and hence, a period of > unavailability when the leader dies. > EPaxos is a Paxos variant that requires (1) less messages than multi-paxos, > (2) is particularly useful across multiple datacenters, and (3) allows any > node to act as coordinator: > http://sigops.org/sosp/sosp13/papers/p358-moraru.pdf > However, there is substantial additional complexity involved if we choose to > implement it. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-6246) EPaxos
[ https://issues.apache.org/jira/browse/CASSANDRA-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128159#comment-16128159 ] Igor Zubchenok commented on CASSANDRA-6246: --- I would like to try, but I'm not familiar with Cassandra source code. :( Isn't it easier to implement the patch again, but without rebase from 4 year old code? BTW, I'm looking for a solution to implement a *reference counter based on Cassandra*. My first reference counter implementation has been made on counter columns, but unfortunately it had been ruined with tombstones issue - when a counter get back to zero, I cannot delete nor compact it. My guess was that the lightweight Cassandra transactions can do a very good job for my task. I was so naive and now I have an issue with WriteTimeoutException and inconsistent state. The only workaround I came up with today is to do an exclusive lock that can be easily made with LWT with TLL, and subsequent change of a value, but it will have much more greater performance hit. I'm still looking for a good solution on that with Cassandra. Currently I'm naive again and expecting that EPaxos will help me, but seems it will never-never be merged and released. Dear community, do you have any idea? Huge thanks to everyone who answer me. > EPaxos > -- > > Key: CASSANDRA-6246 > URL: https://issues.apache.org/jira/browse/CASSANDRA-6246 > Project: Cassandra > Issue Type: Improvement >Reporter: Jonathan Ellis >Assignee: Blake Eggleston > Labels: messaging-service-bump-required > Fix For: 4.x > > > One reason we haven't optimized our Paxos implementation with Multi-paxos is > that Multi-paxos requires leader election and hence, a period of > unavailability when the leader dies. > EPaxos is a Paxos variant that requires (1) less messages than multi-paxos, > (2) is particularly useful across multiple datacenters, and (3) allows any > node to act as coordinator: > http://sigops.org/sosp/sosp13/papers/p358-moraru.pdf > However, there is substantial additional complexity involved if we choose to > implement it. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-6246) EPaxos
[ https://issues.apache.org/jira/browse/CASSANDRA-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127713#comment-16127713 ] Igor Zubchenok commented on CASSANDRA-6246: --- It is a pity that these lightweight transactions can not be used at full strength due to the delay in merging this improvement. I refer to CASSANDRA-9328. I would set the highest priority for the merging. > EPaxos > -- > > Key: CASSANDRA-6246 > URL: https://issues.apache.org/jira/browse/CASSANDRA-6246 > Project: Cassandra > Issue Type: Improvement >Reporter: Jonathan Ellis >Assignee: Blake Eggleston > Labels: messaging-service-bump-required > Fix For: 4.x > > > One reason we haven't optimized our Paxos implementation with Multi-paxos is > that Multi-paxos requires leader election and hence, a period of > unavailability when the leader dies. > EPaxos is a Paxos variant that requires (1) less messages than multi-paxos, > (2) is particularly useful across multiple datacenters, and (3) allows any > node to act as coordinator: > http://sigops.org/sosp/sosp13/papers/p358-moraru.pdf > However, there is substantial additional complexity involved if we choose to > implement it. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-6246) EPaxos
[ https://issues.apache.org/jira/browse/CASSANDRA-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126756#comment-16126756 ] Igor Zubchenok commented on CASSANDRA-6246: --- Any update when this can be released? > EPaxos > -- > > Key: CASSANDRA-6246 > URL: https://issues.apache.org/jira/browse/CASSANDRA-6246 > Project: Cassandra > Issue Type: Improvement >Reporter: Jonathan Ellis >Assignee: Blake Eggleston > Labels: messaging-service-bump-required > Fix For: 4.x > > > One reason we haven't optimized our Paxos implementation with Multi-paxos is > that Multi-paxos requires leader election and hence, a period of > unavailability when the leader dies. > EPaxos is a Paxos variant that requires (1) less messages than multi-paxos, > (2) is particularly useful across multiple datacenters, and (3) allows any > node to act as coordinator: > http://sigops.org/sosp/sosp13/papers/p358-moraru.pdf > However, there is substantial additional complexity involved if we choose to > implement it. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Comment Edited] (CASSANDRA-9328) WriteTimeoutException thrown when LWT concurrency > 1, despite the query duration taking MUCH less than cas_contention_timeout_in_ms
[ https://issues.apache.org/jira/browse/CASSANDRA-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126736#comment-16126736 ] Igor Zubchenok edited comment on CASSANDRA-9328 at 8/15/17 2:27 AM: I completely discouraged. Is there any workaround on this? If LWT and CAS can not be actually used on non-idempotent operations, what is a real use case of the current implementation? was (Author: geagle): I completely discouraged. Is there any workaround on this? If CAS can not be actually used on non-idempotent operations, what is a real use of current LWT implementation? > WriteTimeoutException thrown when LWT concurrency > 1, despite the query > duration taking MUCH less than cas_contention_timeout_in_ms > > > Key: CASSANDRA-9328 > URL: https://issues.apache.org/jira/browse/CASSANDRA-9328 > Project: Cassandra > Issue Type: Bug > Components: Coordination >Reporter: Aaron Whiteside > Attachments: CassandraLWTTest2.java, CassandraLWTTest.java > > > WriteTimeoutException thrown when LWT concurrency > 1, despite the query > duration taking MUCH less than cas_contention_timeout_in_ms. > Unit test attached, run against a 3 node cluster running 2.1.5. > If you reduce the threadCount to 1, you never see a WriteTimeoutException. If > the WTE is due to not being able to communicate with other nodes, why does > the concurrency >1 cause inter-node communication to fail? -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-9328) WriteTimeoutException thrown when LWT concurrency > 1, despite the query duration taking MUCH less than cas_contention_timeout_in_ms
[ https://issues.apache.org/jira/browse/CASSANDRA-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126736#comment-16126736 ] Igor Zubchenok commented on CASSANDRA-9328: --- I completely discouraged. Is there any workaround on this? If CAS can not be actually used on non-idempotent operations, what is a real use of current LWT implementation? > WriteTimeoutException thrown when LWT concurrency > 1, despite the query > duration taking MUCH less than cas_contention_timeout_in_ms > > > Key: CASSANDRA-9328 > URL: https://issues.apache.org/jira/browse/CASSANDRA-9328 > Project: Cassandra > Issue Type: Bug > Components: Coordination >Reporter: Aaron Whiteside > Attachments: CassandraLWTTest2.java, CassandraLWTTest.java > > > WriteTimeoutException thrown when LWT concurrency > 1, despite the query > duration taking MUCH less than cas_contention_timeout_in_ms. > Unit test attached, run against a 3 node cluster running 2.1.5. > If you reduce the threadCount to 1, you never see a WriteTimeoutException. If > the WTE is due to not being able to communicate with other nodes, why does > the concurrency >1 cause inter-node communication to fail? -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org
[jira] [Commented] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped (description updated)
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121934#comment-14121934 ] Igor Zubchenok commented on CASSANDRA-7828: --- Could anyone comment on this? Thanks New node cannot be joined if a value in composite type column is dropped (description updated) -- Key: CASSANDRA-7828 URL: https://issues.apache.org/jira/browse/CASSANDRA-7828 Project: Cassandra Issue Type: Bug Components: Core Reporter: Igor Zubchenok I get a *RuntimeException* at new node system.log on bootstrapping a new DC: {code:title=system.out - RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a RuntimeException at new node system.log on bootstrapping a new DC: {code:title=RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a RuntimeException at new node system.log on bootstrapping a new DC: {code:title=RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a RuntimeException at new node system.log on bootstrapping a new DC: {code:title=RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Attachment: (was: java.lang.RuntimeException.txt) New node cannot be joined if a value in composite type column is dropped Key: CASSANDRA-7828 URL: https://issues.apache.org/jira/browse/CASSANDRA-7828 Project: Cassandra Issue Type: Bug Components: Core Reporter: Igor Zubchenok I get a RuntimeException at new node system.log on bootstrapping a new DC: {code:title=RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409)
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Attachment: (was: mycolumnfamily.txt) New node cannot be joined if a value in composite type column is dropped Key: CASSANDRA-7828 URL: https://issues.apache.org/jira/browse/CASSANDRA-7828 Project: Cassandra Issue Type: Bug Components: Core Reporter: Igor Zubchenok I get a RuntimeException at new node system.log on bootstrapping a new DC: {code:title=RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a RuntimeException at new node system.log on bootstrapping a new DC: {code:title=RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a *RuntimeException* at new node system.log on bootstrapping a new DC: {code:title=system.out - RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61)
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a *RuntimeException* at new node system.log on bootstrapping a new DC: {code:title=system.out - RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61)
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a *RuntimeException* at new node system.log on bootstrapping a new DC: {code:title=system.out - RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61)
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a *RuntimeException* at new node system.log on bootstrapping a new DC: {code:title=system.out - RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61)
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a *RuntimeException* at new node system.log on bootstrapping a new DC: {code:title=system.out - RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61)
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped (description updated)
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Summary: New node cannot be joined if a value in composite type column is dropped (description updated) (was: New node cannot be joined if a value in composite type column is dropped) New node cannot be joined if a value in composite type column is dropped (description updated) -- Key: CASSANDRA-7828 URL: https://issues.apache.org/jira/browse/CASSANDRA-7828 Project: Cassandra Issue Type: Bug Components: Core Reporter: Igor Zubchenok I get a *RuntimeException* at new node system.log on bootstrapping a new DC: {code:title=system.out - RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at
[jira] [Commented] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped (description updated)
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110763#comment-14110763 ] Igor Zubchenok commented on CASSANDRA-7828: --- As a workaround I found that it works if I use BytesType validation class for the column (aka blob). But still no way to have it working with CompositeType. New node cannot be joined if a value in composite type column is dropped (description updated) -- Key: CASSANDRA-7828 URL: https://issues.apache.org/jira/browse/CASSANDRA-7828 Project: Cassandra Issue Type: Bug Components: Core Reporter: Igor Zubchenok I get a *RuntimeException* at new node system.log on bootstrapping a new DC: {code:title=system.out - RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped (description updated)
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a *RuntimeException* at new node system.log on bootstrapping a new DC: {code:title=system.out - RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61)
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped (description updated)
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a *RuntimeException* at new node system.log on bootstrapping a new DC: {code:title=system.out - RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} INFO [NonPeriodicTasks:1] 2014-08-26 15:43:01,030 SecondaryIndexManager.java (line 137) Submitting index build of [myColumnFamily.myColumnFamily_myColumn] for data in SSTableReader(path='/var/lib/cassandra/data/testbug/myColumnFamily/testbug-myColumnFamily-jb-1-Data.db') ERROR [CompactionExecutor:2] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[CompactionExecutor:2,1,main] java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:727) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:789) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) ERROR [NonPeriodicTasks:1] 2014-08-26 15:43:01,035 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61)
[jira] [Created] (CASSANDRA-7828) New node cannot be added if a composite column was dropped
Igor Zubchenok created CASSANDRA-7828: - Summary: New node cannot be added if a composite column was dropped Key: CASSANDRA-7828 URL: https://issues.apache.org/jira/browse/CASSANDRA-7828 Project: Cassandra Issue Type: Bug Components: Core Reporter: Igor Zubchenok Attachments: java.lang.RuntimeException.txt, mycolumnfamily.txt I get a RuntimeException at new node system.log on bootstrapping a new DC: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:804) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) ... 3 more The exception stacktrace is attached (see java.lang.RuntimeException.txt). My steps to reproduce (cassandra 2.0.9): 1. Create a CF with a secondary index on a CompositeType(Int32Type, UUIDType) column in DC1, one node, NetworkTopologyStrategy, options DC1=1, DC2=1. (see mycolumnfamily.txt) 2. Create secondary index on the column of CompositeType. 3. Write any composite value to a row. 4. Drop the value. 5. Write another composite value to another row. 6. Drop second value. 7. Bootstrap add a new DC2. The similar issue I got on indexed composite column in a single 3 nodes DC with SimpleStrategy and replication_factor=3 (cassandra 1.2.18). -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (CASSANDRA-7828) New node cannot be added if a composite column was dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a RuntimeException at new node system.log on bootstrapping a new DC: {code:title=RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:804) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) ... 3 more {code} The exception stacktrace is attached (see java.lang.RuntimeException.txt). My steps to reproduce (cassandra 2.0.9): # Create a CF with a secondary index on a CompositeType(Int32Type, UUIDType) column in DC1, one node, NetworkTopologyStrategy, options DC1=1, DC2=1. (see mycolumnfamily.txt) # Create secondary index on the column of CompositeType. # Write any composite value to a row. # Drop the value. # Write another composite value to another row. # Drop second value. # Bootstrap add a new DC2. The similar issue I got on indexed composite column in a single 3 nodes DC with SimpleStrategy and replication_factor=3 (cassandra 1.2.18). was: I get a RuntimeException at new node system.log on bootstrapping a new DC: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Reproduced In: 2.0.9, 1.2.18 (was: 1.2.18, 2.0.9) Summary: New node cannot be joined if a value in composite type column is dropped (was: New node cannot be added if a composite column was dropped) New node cannot be joined if a value in composite type column is dropped Key: CASSANDRA-7828 URL: https://issues.apache.org/jira/browse/CASSANDRA-7828 Project: Cassandra Issue Type: Bug Components: Core Reporter: Igor Zubchenok Attachments: java.lang.RuntimeException.txt, mycolumnfamily.txt I get a RuntimeException at new node system.log on bootstrapping a new DC: {code:title=RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:804) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) ... 3 more {code} The exception stacktrace is attached (see java.lang.RuntimeException.txt). My steps to reproduce (cassandra 2.0.9): # Create a CF with a secondary index on a CompositeType(Int32Type, UUIDType) column in DC1, one node, NetworkTopologyStrategy, options DC1=1, DC2=1. (see mycolumnfamily.txt) # Create secondary index on the column of CompositeType. # Write any composite value to a row. # Drop the value. # Write another composite value to another row. # Drop second value. # Bootstrap add a new DC2. The similar issue I got on indexed composite column in a single 3 nodes DC with SimpleStrategy
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a RuntimeException at new node system.log on bootstrapping a new DC: {code:title=RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:804) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) ... 3 more {code} The exception stacktrace is attached (see java.lang.RuntimeException.txt). My steps to reproduce (cassandra 2.0.9): # Create a CF with a secondary index on a CompositeType(Int32Type, UUIDType) column in DC1, one node, NetworkTopologyStrategy, options DC1=1, DC2=1. (see mycolumnfamily.txt, statusReferenceId column) # Create secondary index on the column of CompositeType. # Write any composite value to a row. # Drop the value. # Write another composite value to another row. # Drop second value. # Bootstrap add a new DC2. The similar issue I got on indexed composite column in a single 3 nodes DC with SimpleStrategy and replication_factor=3 (cassandra 1.2.18). was: I get a RuntimeException at new node system.log on bootstrapping a new DC: {code:title=RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a RuntimeException at new node system.log on bootstrapping a new DC: {code:title=RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:804) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) ... 3 more {code} The exception stacktrace is attached (see java.lang.RuntimeException.txt). My steps to reproduce (cassandra 2.0.9): # Create a CF with a secondary index on a CompositeType(Int32Type, UUIDType) column in DC1, one node, NetworkTopologyStrategy, options DC1=1, DC2=1. (see mycolumnfamily.txt, statusReferenceId column) # Write any composite value to a row. # Drop the value. # Write another composite value to another row. # Drop second value. # Bootstrap add a new DC2. The similar issue I got on indexed composite column in a single 3 nodes DC with SimpleStrategy and replication_factor=3 (cassandra 1.2.18). was: I get a RuntimeException at new node system.log on bootstrapping a new DC: {code:title=RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at
[jira] [Updated] (CASSANDRA-7828) New node cannot be joined if a value in composite type column is dropped
[ https://issues.apache.org/jira/browse/CASSANDRA-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Zubchenok updated CASSANDRA-7828: -- Description: I get a RuntimeException at new node system.log on bootstrapping a new DC: {code:title=RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} ERROR [NonPeriodicTasks:1] 2014-08-26 02:02:42,987 CassandraDaemon.java (line 199) Exception in thread Thread[NonPeriodicTasks:1,5,main] java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at org.apache.cassandra.streaming.StreamReceiveTask$OnCompletionRunnable.run(StreamReceiveTask.java:113) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:188) at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:409) ... 9 more Caused by: java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:267) at org.apache.cassandra.utils.ByteBufferUtil.readBytes(ByteBufferUtil.java:587) at org.apache.cassandra.utils.ByteBufferUtil.readBytesWithShortLength(ByteBufferUtil.java:596) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:61) at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:36) at org.apache.cassandra.dht.LocalToken.compareTo(LocalToken.java:44) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:85) at org.apache.cassandra.db.DecoratedKey.compareTo(DecoratedKey.java:36) at java.util.concurrent.ConcurrentSkipListMap.findNode(ConcurrentSkipListMap.java:804) at java.util.concurrent.ConcurrentSkipListMap.doGet(ConcurrentSkipListMap.java:828) at java.util.concurrent.ConcurrentSkipListMap.get(ConcurrentSkipListMap.java:1626) at org.apache.cassandra.db.Memtable.resolve(Memtable.java:215) at org.apache.cassandra.db.Memtable.put(Memtable.java:173) at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:900) at org.apache.cassandra.db.index.AbstractSimplePerColumnSecondaryIndex.insert(AbstractSimplePerColumnSecondaryIndex.java:107) at org.apache.cassandra.db.index.SecondaryIndexManager.indexRow(SecondaryIndexManager.java:441) at org.apache.cassandra.db.Keyspace.indexRow(Keyspace.java:413) at org.apache.cassandra.db.index.SecondaryIndexBuilder.build(SecondaryIndexBuilder.java:62) at org.apache.cassandra.db.compaction.CompactionManager$9.run(CompactionManager.java:834) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) ... 3 more {code} The exception stacktrace is attached (see java.lang.RuntimeException.txt). My steps to reproduce (cassandra 2.0.9): # Create a CF with a secondary index on a CompositeType(Int32Type, UUIDType) column in DC1, one node, NetworkTopologyStrategy, options DC1=1, DC2=1. (see mycolumnfamily.txt, statusReferenceId column) # Write any composite value to a row. # Drop the value. # Write another composite value to another row. # Drop second value. # Bootstrap add a new DC2. The similar issue I got on indexed composite column in a single 3 nodes DC with SimpleStrategy and replication_factor=3 (cassandra 1.2.18). was: I get a RuntimeException at new node system.log on bootstrapping a new DC: {code:title=RuntimeException caused by IllegalArgumentException in Buffer.limit|borderStyle=solid} java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException at org.apache.cassandra.utils.FBUtilities.waitOnFuture(FBUtilities.java:413) at org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndexes(SecondaryIndexManager.java:142) at