[
https://issues.apache.org/jira/browse/BEAM-6258?focusedWorklogId=775563&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-775563
]
ASF GitHub Bot logged work on BEAM-6258:
----------------------------------------
Author: ASF GitHub Bot
Created on: 27/May/22 19:10
Start Date: 27/May/22 19:10
Worklog Time Spent: 10m
Work Description: codecov[bot] commented on PR #17777:
URL: https://github.com/apache/beam/pull/17777#issuecomment-1139954786
#
[Codecov](https://codecov.io/gh/apache/beam/pull/17777?src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
Report
> Merging
[#17777](https://codecov.io/gh/apache/beam/pull/17777?src=pr&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
(49d8d8a) into
[master](https://codecov.io/gh/apache/beam/commit/64c61e99236533bd92596983ea2d4e9bcbecdb9d?el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
(64c61e9) will **decrease** coverage by `0.00%`.
> The diff coverage is `n/a`.
```diff
@@ Coverage Diff @@
## master #17777 +/- ##
==========================================
- Coverage 73.99% 73.99% -0.01%
==========================================
Files 696 696
Lines 91851 91861 +10
==========================================
+ Hits 67964 67968 +4
- Misses 22638 22644 +6
Partials 1249 1249
```
| Flag | Coverage Δ | |
|---|---|---|
| python | `83.73% <ø> (-0.01%)` | :arrow_down: |
Flags with carried forward coverage won't be shown. [Click
here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#carryforward-flags-in-the-pull-request-comment)
to find out more.
| [Impacted
Files](https://codecov.io/gh/apache/beam/pull/17777?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
| Coverage Δ | |
|---|---|---|
|
[...hon/apache\_beam/runners/direct/test\_stream\_impl.py](https://codecov.io/gh/apache/beam/pull/17777/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vcnVubmVycy9kaXJlY3QvdGVzdF9zdHJlYW1faW1wbC5weQ==)
| `93.28% <0.00%> (-0.75%)` | :arrow_down: |
|
[sdks/python/apache\_beam/runners/direct/executor.py](https://codecov.io/gh/apache/beam/pull/17777/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vcnVubmVycy9kaXJlY3QvZXhlY3V0b3IucHk=)
| `96.46% <0.00%> (-0.55%)` | :arrow_down: |
|
[sdks/python/apache\_beam/transforms/combiners.py](https://codecov.io/gh/apache/beam/pull/17777/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vdHJhbnNmb3Jtcy9jb21iaW5lcnMucHk=)
| `93.05% <0.00%> (-0.39%)` | :arrow_down: |
|
[...hon/apache\_beam/runners/worker/bundle\_processor.py](https://codecov.io/gh/apache/beam/pull/17777/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vcnVubmVycy93b3JrZXIvYnVuZGxlX3Byb2Nlc3Nvci5weQ==)
| `93.17% <0.00%> (-0.26%)` | :arrow_down: |
|
[...ks/python/apache\_beam/runners/worker/sdk\_worker.py](https://codecov.io/gh/apache/beam/pull/17777/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vcnVubmVycy93b3JrZXIvc2RrX3dvcmtlci5weQ==)
| `88.94% <0.00%> (-0.16%)` | :arrow_down: |
|
[...ks/python/apache\_beam/runners/worker/operations.py](https://codecov.io/gh/apache/beam/pull/17777/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vcnVubmVycy93b3JrZXIvb3BlcmF0aW9ucy5weQ==)
| `74.02% <0.00%> (-0.07%)` | :arrow_down: |
|
[sdks/python/apache\_beam/io/gcp/bigquery.py](https://codecov.io/gh/apache/beam/pull/17777/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vaW8vZ2NwL2JpZ3F1ZXJ5LnB5)
| `64.96% <0.00%> (-0.04%)` | :arrow_down: |
|
[sdks/python/apache\_beam/io/textio.py](https://codecov.io/gh/apache/beam/pull/17777/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vaW8vdGV4dGlvLnB5)
| `96.89% <0.00%> (ø)` | |
|
[sdks/python/apache\_beam/transforms/core.py](https://codecov.io/gh/apache/beam/pull/17777/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vdHJhbnNmb3Jtcy9jb3JlLnB5)
| `92.30% <0.00%> (ø)` | |
|
[sdks/python/apache\_beam/ml/inference/api.py](https://codecov.io/gh/apache/beam/pull/17777/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation#diff-c2Rrcy9weXRob24vYXBhY2hlX2JlYW0vbWwvaW5mZXJlbmNlL2FwaS5weQ==)
| `90.00% <0.00%> (ø)` | |
| ... and [9
more](https://codecov.io/gh/apache/beam/pull/17777/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
| |
------
[Continue to review full report at
Codecov](https://codecov.io/gh/apache/beam/pull/17777?src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
> **Legend** - [Click here to learn
more](https://docs.codecov.io/docs/codecov-delta?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation)
> `Δ = absolute <relative> (impact)`, `ø = not affected`, `? = missing data`
> Powered by
[Codecov](https://codecov.io/gh/apache/beam/pull/17777?src=pr&el=footer&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
Last update
[64c61e9...49d8d8a](https://codecov.io/gh/apache/beam/pull/17777?src=pr&el=lastupdated&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
Read the [comment
docs](https://docs.codecov.io/docs/pull-request-comments?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=The+Apache+Software+Foundation).
Issue Time Tracking
-------------------
Worklog Id: (was: 775563)
Time Spent: 2h 50m (was: 2h 40m)
> Data channel failing after some time for 1G data input
> ------------------------------------------------------
>
> Key: BEAM-6258
> URL: https://issues.apache.org/jira/browse/BEAM-6258
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-harness
> Reporter: Ankur Goenka
> Priority: P3
> Attachments: d44b7eda9e4c_java_server_logs.logs.gz,
> d44b7eda9e4c_python_client_logs.log.bz2
>
> Time Spent: 2h 50m
> Remaining Estimate: 0h
>
> Data channel and logging channel are failing after some time with 1GB input
> data for chicago taxi.
>
> E1218 02:44:02.837680206 72 chttp2_transport.cc:1148] Received a GOAWAY with
> error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings"
> Exception in thread read_grpc_client_inputs:
> Traceback (most recent call last):
> File "/usr/local/lib/python2.7/threading.py", line 801, in __bootstrap_inner
> self.run()
> File "/usr/local/lib/python2.7/threading.py", line 754, in run
> self.__target(*self.__args, **self.__kwargs)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/data_plane.py",
> line 273, in <lambda>
> target=lambda: self._read_inputs(elements_iterator),
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/data_plane.py",
> line 260, in _read_inputs
> for elements in elements_iterator:
> File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 347, in
> next
> return self._next()
> File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 338, in
> _next
> raise self
> _Rendezvous: <_Rendezvous of RPC that terminated with
> (StatusCode.RESOURCE_EXHAUSTED, GOAWAY received)>
> Traceback (most recent call last):
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 145, in _execute
> response = task()
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 180, in <lambda>
> self._execute(lambda: worker.do_instruction(work), work)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 253, in do_instruction
> request.instruction_id)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 269, in process_bundle
> bundle_processor.process_bundle(instruction_id)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/bundle_processor.py",
> line 481, in process_bundle
> instruction_id, expected_targets):
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/data_plane.py",
> line 209, in input_elements
> raise_(t, v, tb)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/data_plane.py",
> line 260, in _read_inputs
> for elements in elements_iterator:
> File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 347, in
> next
> return self._next()
> File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 338, in
> _next
> raise self
> _Rendezvous: <_Rendezvous of RPC that terminated with
> (StatusCode.RESOURCE_EXHAUSTED, GOAWAY received)>
> Traceback (most recent call last):
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 145, in _execute
> response = task()
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 180, in <lambda>
> self._execute(lambda: worker.do_instruction(work), work)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 253, in do_instruction
> request.instruction_id)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 269, in process_bundle
> bundle_processor.process_bundle(instruction_id)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/bundle_processor.py",
> line 481, in process_bundle
> instruction_id, expected_targets):
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/data_plane.py",
> line 209, in input_elements
> raise_(t, v, tb)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/data_plane.py",
> line 260, in _read_inputs
> for elements in elements_iterator:
> File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 347, in
> next
> return self._next()
> File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 338, in
> _next
> raise self
> _Rendezvous: <_Rendezvous of RPC that terminated with
> (StatusCode.RESOURCE_EXHAUSTED, GOAWAY received)>
> Traceback (most recent call last):
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 145, in _execute
> response = task()
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 180, in <lambda>
> self._execute(lambda: worker.do_instruction(work), work)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 253, in do_instruction
> request.instruction_id)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 269, in process_bundle
> bundle_processor.process_bundle(instruction_id)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/bundle_processor.py",
> line 481, in process_bundle
> instruction_id, expected_targets):
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/data_plane.py",
> line 209, in input_elements
> raise_(t, v, tb)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/data_plane.py",
> line 260, in _read_inputs
> for elements in elements_iterator:
> File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 347, in
> next
> return self._next()
> File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 338, in
> _next
> raise self
> _Rendezvous: <_Rendezvous of RPC that terminated with
> (StatusCode.RESOURCE_EXHAUSTED, GOAWAY received)>
> Traceback (most recent call last):
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 145, in _execute
> response = task()
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 180, in <lambda>
> self._execute(lambda: worker.do_instruction(work), work)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 253, in do_instruction
> request.instruction_id)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 269, in process_bundle
> bundle_processor.process_bundle(instruction_id)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/bundle_processor.py",
> line 481, in process_bundle
> instruction_id, expected_targets):
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/data_plane.py",
> line 209, in input_elements
> raise_(t, v, tb)
> File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/data_plane.py",
> line 260, in _read_inputs
> for elements in elements_iterator:
> File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 347, in
> next
> return self._next()
> File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 338, in
> _next
> raise self
> _Rendezvous: <_Rendezvous of RPC that terminated with
> (StatusCode.RESOURCE_EXHAUSTED, GOAWAY received)>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
