[jira] [Comment Edited] (CASSANDRA-11701) [windows] dtest failure in cqlsh_tests.cqlsh_copy_tests.CqlshCopyTest.test_reading_with_skip_and_max_rows

2016-08-07 Thread Stefania (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15408997#comment-15408997
 ] 

Stefania edited comment on CASSANDRA-11701 at 8/8/16 2:10 AM:
--

I rewrote the patch to avoid using a thread lock, since it cannot be pickl-ed 
on Windows. I extracted the pipe out of the channels, so we only transfer pipes 
and not channels to the child processes, which then create the channels after 
forking. To avoid redundant threads, which are only required for sending, I've 
separated receiving from sending channels. Only sending channels create a 
feeding thread, right in the constructor so the lock is no longer required.

I'm not sure if we want this fix in 2.1 or not, it is not a critical bug but it 
is a regression compared to the old cqlsh COPY functionality. It is a rare 
failure but it can occur if the main thread of a child process needs to send an 
error when the receiving thread is already sending results.

||2.1||2.2||3.0||3.9||trunk||
|[patch|https://github.com/stef1927/cassandra/commits/11701-cqlsh-2.1]|[patch|https://github.com/stef1927/cassandra/commits/11701-cqlsh-2.2]|[patch|https://github.com/stef1927/cassandra/commits/11701-cqlsh-3.0]|[patch|https://github.com/stef1927/cassandra/commits/11701-cqlsh-3.9]|[patch|https://github.com/stef1927/cassandra/commits/11701-cqlsh]|
|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-cqlsh-2.1-cqlsh-tests/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-cqlsh-2.2-cqlsh-tests/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-cqlsh-3.0-cqlsh-tests/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-cqlsh-3.9-cqlsh-tests/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-cqlsh-cqlsh-tests/]|

The windows test results will be available 
[here|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-dtest-multiplex-win32/],
 build -#7 and #8- #8 and #9.


was (Author: stefania):
I rewrote the patch to avoid using a thread lock, since it cannot be pickl-ed 
on Windows. I extracted the pipe out of the channels, so we only transfer pipes 
and not channels to the child processes, which then create the channels after 
forking. To avoid redundant threads, which are only required for sending, I've 
separated receiving from sending channels. Only sending channels create a 
feeding thread, right in the constructor so the lock is no longer required.

I'm not sure if we want this fix in 2.1 or not, it is not a critical bug but it 
is a regression compared to the old cqlsh COPY functionality. It is a rare 
failure but it can occur if the main thread of a child process needs to send an 
error when the receiving thread is already sending results.

||2.1||2.2||3.0||3.9||trunk||
|[patch|https://github.com/stef1927/cassandra/commits/11701-cqlsh-2.1]|[patch|https://github.com/stef1927/cassandra/commits/11701-cqlsh-2.2]|[patch|https://github.com/stef1927/cassandra/commits/11701-cqlsh-3.0]|[patch|https://github.com/stef1927/cassandra/commits/11701-cqlsh-3.9]|[patch|https://github.com/stef1927/cassandra/commits/11701-cqlsh]|
|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-cqlsh-2.1-cqlsh-tests/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-cqlsh-2.2-cqlsh-tests/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-cqlsh-3.0-cqlsh-tests/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-cqlsh-3.9-cqlsh-tests/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-cqlsh-cqlsh-tests/]|

The windows test results will be available 
[here|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-dtest-multiplex-win32/],
 build #7 and #8.

> [windows] dtest failure in 
> cqlsh_tests.cqlsh_copy_tests.CqlshCopyTest.test_reading_with_skip_and_max_rows
> -
>
> Key: CASSANDRA-11701
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11701
> Project: Cassandra
>  Issue Type: Test
>Reporter: Russ Hatch
>Assignee: Stefania
>  Labels: dtest, windows
>
> looks to be an assertion problem, so could be test or cassandra related:
> e.g.:
> {noformat}
> 1 != 331
> {noformat}
> http://cassci.datastax.com/job/trunk_dtest_win32/404/testReport/cqlsh_tests.cqlsh_copy_tests/CqlshCopyTest/test_reading_with_skip_and_max_rows
> Failed on CassCI build trunk_dtest_win32 #404



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Comment Edited] (CASSANDRA-11701) [windows] dtest failure in cqlsh_tests.cqlsh_copy_tests.CqlshCopyTest.test_reading_with_skip_and_max_rows

2016-05-02 Thread Stefania (JIRA)

[ 
https://issues.apache.org/jira/browse/CASSANDRA-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15267921#comment-15267921
 ] 

Stefania edited comment on CASSANDRA-11701 at 5/3/16 2:00 AM:
--

It seems there was an exception in {{write_rows_to_csv}} that caused 
{{init_feeding_thread}} to be called simultaneously by 2 threads. This method 
should be protected by a lock, here is the patch:

||2.1||2.2||3.0||trunk||
|[patch|https://github.com/stef1927/cassandra/commits/11701-2.1]|[patch|https://github.com/stef1927/cassandra/commits/11701-2.2]|[patch|https://github.com/stef1927/cassandra/commits/11701-3.0]|[patch|https://github.com/stef1927/cassandra/commits/11701]|
|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-2.1-dtest/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-2.2-dtest/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-3.0-dtest/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-dtest/]|

The 2.1 patch merges upwards without conflicts.

After protecting this method, we should be able to see what the initial 
exception was, [~rhatch] are you able to run this test a few times on Windows 
with the trunk patch applied?


was (Author: stefania):
It seems there was an exception in {{write_rows_to_csv}} that caused 
{{init_feeding_thread}} to be called simultaneously by 2 threads. This method 
should be protected by a lock, here is the patch:

||2.1||2.2||3.0||trunk||
|[patch|https://github.com/stef1927/cassandra/commits/11701-2.1]|[patch|https://github.com/stef1927/cassandra/commits/11701-2.2]|[patch|https://github.com/stef1927/cassandra/commits/11701-3.0]|[patch|https://github.com/stef1927/cassandra/commits/11701]|
|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-2.1-dtest/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-2.2-dtest/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-3.0-dtest/]|[dtest|http://cassci.datastax.com/view/Dev/view/stef1927/job/stef1927-11701-dtest/]|

The 2.1 patch merges upwards without conflicts.

After protecting this method, we should be able to see what the initial 
exception was, [~rhatch] are you able to run this test a few times on Windows 
with the patch applied?

> [windows] dtest failure in 
> cqlsh_tests.cqlsh_copy_tests.CqlshCopyTest.test_reading_with_skip_and_max_rows
> -
>
> Key: CASSANDRA-11701
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11701
> Project: Cassandra
>  Issue Type: Test
>Reporter: Russ Hatch
>Assignee: Stefania
>  Labels: dtest, windows
>
> looks to be an assertion problem, so could be test or cassandra related:
> e.g.:
> {noformat}
> 1 != 331
> {noformat}
> http://cassci.datastax.com/job/trunk_dtest_win32/404/testReport/cqlsh_tests.cqlsh_copy_tests/CqlshCopyTest/test_reading_with_skip_and_max_rows
> Failed on CassCI build trunk_dtest_win32 #404



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)