[
https://issues.apache.org/jira/browse/BEAM-7365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844689#comment-16844689
]
Frederik Bode commented on BEAM-7365:
-------------------------------------
I cannot reproduce this behaviour:
Python 2.7:
```
py27 inst-nodeps:
/app/sdks/python/target/.tox/.tmp/package/1/apache-beam-2.14.0.dev0.zip
...
py27 run-test: commands[0] | python setup.py test -s
apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive
...
test_dynamic_work_rebalancing_exhaustive (apache_beam.io.avroio_test.TestAvro)
... WARNING:root:After 101 concurrent splitting trials at item #3, observed
only failure, giving up on this item
ok
----------------------------------------------------------------------
Ran 1 test in 0.705s
OK
py27 run-test-post: commands[0] | /app/sdks/python/scripts/run_tox_cleanup.sh
...
```
Python 3.5
```
py35 inst-nodeps:
/app/sdks/python/target/.tox/.tmp/package/1/apache-beam-2.14.0.dev0.zip
...
py35 run-test: commands[0] | python setup.py test -s
apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive
...
test_dynamic_work_rebalancing_exhaustive (apache_beam.io.avroio_test.TestAvro)
... /app/sdks/python/apache_beam/io/source_test_utils.py:596:
DeprecationWarning: The 'warn' function is deprecated, use 'warning' instead
'success' if have_success else 'failure'
WARNING:root:After 101 concurrent splitting trials at item #1, observed only
failure, giving up on this item
WARNING:root:After 101 concurrent splitting trials at item #2, observed only
failure, giving up on this item
WARNING:root:After 101 concurrent splitting trials at item #3, observed only
failure, giving up on this item
WARNING:root:After 101 concurrent splitting trials at item #4, observed only
failure, giving up on this item
ok
----------------------------------------------------------------------
Ran 1 test in 1.201s
OK
```
> apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive
> is very slow
> -----------------------------------------------------------------------------------------
>
> Key: BEAM-7365
> URL: https://issues.apache.org/jira/browse/BEAM-7365
> Project: Beam
> Issue Type: Sub-task
> Components: io-python-avro
> Reporter: Robert Bradshaw
> Priority: Major
>
> {noformat}
> $ python setup.py test -s
> apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive
> test_dynamic_work_rebalancing_exhaustive
> (apache_beam.io.avroio_test.TestFastAvro) ... WARNING:root:After 101
> concurrent splitting trials at item #2, observed only failure, giving up on
> this item
> WARNING:root:After 101 concurrent splitting trials at item #21, observed only
> failure, giving up on this item
> WARNING:root:After 101 concurrent splitting trials at item #22, observed only
> failure, giving up on this item
> WARNING:root:After 1014 total concurrent splitting trials, considered only 25
> items, giving up.
> ok
> ----------------------------------------------------------------------
> Ran 1 test in 172.223s
>
> {noformat}
> Compare this with
> {noformat}
> $ python setup.py test -s
> apache_beam.io.avroio_test.TestAvro.test_dynamic_work_rebalancing_exhaustive
> test_dynamic_work_rebalancing_exhaustive
> (apache_beam.io.avroio_test.TestAvro) ... ok
> ----------------------------------------------------------------------
> Ran 1 test in 0.623s
> OK
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)