[ 
https://issues.apache.org/jira/browse/BEAM-7365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844689#comment-16844689
 ] 

Frederik Bode commented on BEAM-7365:
-------------------------------------

I cannot reproduce this behaviour:

Python 2.7:

```

py27 inst-nodeps: 
/app/sdks/python/target/.tox/.tmp/package/1/apache-beam-2.14.0.dev0.zip

...

py27 run-test: commands[0] | python setup.py test -s 
apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive
...
test_dynamic_work_rebalancing_exhaustive (apache_beam.io.avroio_test.TestAvro) 
... WARNING:root:After 101 concurrent splitting trials at item #3, observed 
only failure, giving up on this item
ok

----------------------------------------------------------------------
Ran 1 test in 0.705s

OK
py27 run-test-post: commands[0] | /app/sdks/python/scripts/run_tox_cleanup.sh

...

```

Python 3.5

```
py35 inst-nodeps: 
/app/sdks/python/target/.tox/.tmp/package/1/apache-beam-2.14.0.dev0.zip
...
py35 run-test: commands[0] | python setup.py test -s 
apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive
...
test_dynamic_work_rebalancing_exhaustive (apache_beam.io.avroio_test.TestAvro) 
... /app/sdks/python/apache_beam/io/source_test_utils.py:596: 
DeprecationWarning: The 'warn' function is deprecated, use 'warning' instead
 'success' if have_success else 'failure'
WARNING:root:After 101 concurrent splitting trials at item #1, observed only 
failure, giving up on this item
WARNING:root:After 101 concurrent splitting trials at item #2, observed only 
failure, giving up on this item
WARNING:root:After 101 concurrent splitting trials at item #3, observed only 
failure, giving up on this item
WARNING:root:After 101 concurrent splitting trials at item #4, observed only 
failure, giving up on this item
ok

----------------------------------------------------------------------
Ran 1 test in 1.201s

OK

```

> apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive 
> is very slow
> -----------------------------------------------------------------------------------------
>
>                 Key: BEAM-7365
>                 URL: https://issues.apache.org/jira/browse/BEAM-7365
>             Project: Beam
>          Issue Type: Sub-task
>          Components: io-python-avro
>            Reporter: Robert Bradshaw
>            Priority: Major
>
> {noformat}
> $ python setup.py test -s 
> apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive
> test_dynamic_work_rebalancing_exhaustive 
> (apache_beam.io.avroio_test.TestFastAvro) ... WARNING:root:After 101 
> concurrent splitting trials at item #2, observed only failure, giving up on 
> this item
> WARNING:root:After 101 concurrent splitting trials at item #21, observed only 
> failure, giving up on this item
> WARNING:root:After 101 concurrent splitting trials at item #22, observed only 
> failure, giving up on this item
> WARNING:root:After 1014 total concurrent splitting trials, considered only 25 
> items, giving up.
> ok
> ----------------------------------------------------------------------
> Ran 1 test in 172.223s
>  
> {noformat}
> Compare this with 
> {noformat}
> $ python setup.py test -s 
> apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive
> test_dynamic_work_rebalancing_exhaustive 
> (apache_beam.io.avroio_test.TestAvro) ... ok
> ----------------------------------------------------------------------
> Ran 1 test in 0.623s
> OK
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to