[
https://issues.apache.org/jira/browse/BEAM-8912?focusedWorklogId=461293&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-461293
]
ASF GitHub Bot logged work on BEAM-8912:
----------------------------------------
Author: ASF GitHub Bot
Created on: 20/Jul/20 21:46
Start Date: 20/Jul/20 21:46
Worklog Time Spent: 10m
Work Description: ibzib edited a comment on pull request #12307:
URL: https://github.com/apache/beam/pull/12307#issuecomment-661350385
> Are all the removed tests covered by the xlang test suite?
test_external_transform and test_sql are covered by
beam_PostCommit_XVR_Flink:
- test_external_transform:
https://github.com/apache/beam/blob/9b0941945545e71a949649309e05e405ca73aea2/sdks/python/apache_beam/io/external/generate_sequence_test.py#L48-L53
- test_sql:
https://github.com/apache/beam/blob/9b0941945545e71a949649309e05e405ca73aea2/sdks/python/apache_beam/transforms/sql_test.py#L141-L148
Kafka tests are covered by the crossLanguagePythonJavaKafkaIOFlink task,
which runs as part of Python 2 and Python 3.8 postcommits.
- Read:
https://github.com/apache/beam/blob/9b0941945545e71a949649309e05e405ca73aea2/sdks/python/apache_beam/io/external/xlang_kafkaio_it_test.py#L60-L77
- Write:
https://github.com/apache/beam/blob/9b0941945545e71a949649309e05e405ca73aea2/sdks/python/apache_beam/io/external/xlang_kafkaio_it_test.py#L122-L132
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 461293)
Time Spent: 1h (was: 50m)
> PreCommit_Python2_PVR_Flink_Commit flaky
> ----------------------------------------
>
> Key: BEAM-8912
> URL: https://issues.apache.org/jira/browse/BEAM-8912
> Project: Beam
> Issue Type: Sub-task
> Components: runner-flink
> Reporter: Ahmet Altay
> Assignee: Kyle Weaver
> Priority: P1
> Labels: flake, flaky, flaky-test
> Time Spent: 1h
> Remaining Estimate: 0h
>
> cc: [~angoenka]
> Logs:
> [https://builds.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Commit/1687/console]
> Error:
> 42assert_that/Group/GroupByKey/GroupByWindow.None/beam:env:external:v1:0:beam:metric:sampled_byte_size:v1
> \{PCOLLECTION=ref_PCollection_PCollection_27}: DistributionResult\{sum=59,
> count=1, min=59, max=59}))*19:44:02* [flink-runner-job-invoker] WARN
> org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService - Failed
> to remove job staging directory for token
> \{"sessionId":"job_b05dbc6c-00d8-4df1-9bf1-efdf35899fa6","basePath":"/tmp/flinktestdPbkyj"}:
> {}*19:44:02* java.io.FileNotFoundException:
> /tmp/flinktestdPbkyj/job_b05dbc6c-00d8-4df1-9bf1-efdf35899fa6/MANIFEST (No
> such file or directory)*19:44:02* at
> java.io.FileInputStream.open0(Native Method)*19:44:02* at
> java.io.FileInputStream.open(FileInputStream.java:195)*19:44:02* at
> java.io.FileInputStream.<init>(FileInputStream.java:138)*19:44:02* at
> org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:118)*19:44:02*
> at
> org.apache.beam.sdk.io.LocalFileSystem.open(LocalFileSystem.java:82)*19:44:02*
> at
> org.apache.beam.sdk.io.FileSystems.open(FileSystems.java:252)*19:44:02*
> at
> org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactRetrievalService.loadManifest(BeamFileSystemArtifactRetrievalService.java:88)*19:44:02*
> at
> org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactStagingService.removeArtifacts(BeamFileSystemArtifactStagingService.java:92)*19:44:02*
> at
> org.apache.beam.runners.fnexecution.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:63)*19:44:02*
> at
> org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:201)*19:44:02*
> at
> org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.setState(JobInvocation.java:241)*19:44:02*
> at
> org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.access$200(JobInvocation.java:48)*19:44:02*
> at
> org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:110)*19:44:02*
> at
> org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:96)*19:44:02*
> at
> org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1058)*19:44:02*
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)*19:44:02*
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)*19:44:02*
> at java.lang.Thread.run(Thread.java:748)*19:44:02*
> INFO:apache_beam.runners.portability.portable_runner:Job state changed to
> DONE*19:44:02* .INFO:__main__:removing conf dir:
> /tmp/flinktest-confGy17Mj*19:44:02*
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
