[
https://issues.apache.org/jira/browse/BEAM-8521?focusedWorklogId=336461&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336461
]
ASF GitHub Bot logged work on BEAM-8521:
----------------------------------------
Author: ASF GitHub Bot
Created on: 30/Oct/19 20:56
Start Date: 30/Oct/19 20:56
Worklog Time Spent: 10m
Work Description: ibzib commented on pull request #9939: [BEAM-8521] only
build Python 2.7 for xlang test
URL: https://github.com/apache/beam/pull/9939
Xlang tests are failing with errors that look like version mismatches. I
suspect building containers for all four supported Python versions could be
corrupting the environment somehow, although I haven't been able to determine
specifically how.
Regardless, building containers is expensive and Xlang is only currently
using py2 anyway.
Post-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
--- | --- | --- | --- | --- | --- | --- | ---
Go | [](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/)
| --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/)
| --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/)
Java | [](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/)
Python | [](https://builds.apache.org/job/beam_PostCommit_Python2/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Python35/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Python36/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Python37/lastCompletedBuild/)
| --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PreCommit_Python2_PVR_Flink_Cron/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PostCommit_Python35_VR_Flink/lastCompletedBuild/)
| --- | --- | [](https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/lastCompletedBuild/)
XLang | --- | --- | --- | [](https://builds.apache.org/job/beam_PostCommit_XVR_Flink/lastCompletedBuild/)
| --- | --- | ---
Pre-Commit Tests Status (on master branch)
------------------------------------------------------------------------------------------------
--- |Java | Python | Go | Website
--- | --- | --- | --- | ---
Non-portable | [](https://builds.apache.org/job/beam_PreCommit_Java_Cron/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PreCommit_Python_Cron/lastCompletedBuild/)<br>[](https://builds.apache.org/job/beam_PreCommit_PythonLint_Cron/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PreCommit_Go_Cron/lastCompletedBuild/)
| [](https://builds.apache.org/job/beam_PreCommit_Website_Cron/lastCompletedBuild/)
Portable | --- | [](https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/lastCompletedBuild/)
| --- | ---
See
[.test-infra/jenkins/README](https://github.com/apache/beam/blob/master/.test-infra/jenkins/README.md)
for trigger phrase, status and link of all Jenkins jobs.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 336461)
Remaining Estimate: 0h
Time Spent: 10m
> beam_PostCommit_XVR_Flink failing
> ---------------------------------
>
> Key: BEAM-8521
> URL: https://issues.apache.org/jira/browse/BEAM-8521
> Project: Beam
> Issue Type: Bug
> Components: test-failures
> Reporter: Kyle Weaver
> Assignee: Kyle Weaver
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> *11:13:37* java.util.concurrent.ExecutionException:
> java.lang.RuntimeException: Error received from SDK harness for instruction
> 72: Traceback (most recent call last):*11:13:37* File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 173, in _execute*11:13:37* response = task()*11:13:37* File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 196, in <lambda>*11:13:37* self._execute(lambda:
> worker.do_instruction(work), work)*11:13:37* File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 358, in do_instruction*11:13:37* request.instruction_id)*11:13:37* File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 378, in process_bundle*11:13:37* instruction_id,
> request.process_bundle_descriptor_id)*11:13:37* File
> "/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
> line 311, in get*11:13:37* self.fns[bundle_descriptor_id],*11:13:37*
> KeyError: u'1-37'
>
> *13:43:05* [grpc-default-executor-1] ERROR
> org.apache.beam.fn.harness.control.BeamFnControlClient - Exception while
> trying to handle InstructionRequest 10 java.lang.IllegalArgumentException:
> unable to deserialize Custom DoFn With Execution Info*13:43:05* at
> org.apache.beam.sdk.util.SerializableUtils.deserializeFromByteArray(SerializableUtils.java:74)*13:43:05*
> at
> org.apache.beam.runners.core.construction.ParDoTranslation.doFnWithExecutionInformationFromProto(ParDoTranslation.java:609)*13:43:05*
> at
> org.apache.beam.runners.core.construction.ParDoTranslation.getDoFn(ParDoTranslation.java:285)*13:43:05*
> at
> org.apache.beam.fn.harness.DoFnPTransformRunnerFactory$Context.<init>(DoFnPTransformRunnerFactory.java:197)*13:43:05*
> at
> org.apache.beam.fn.harness.DoFnPTransformRunnerFactory.createRunnerForPTransform(DoFnPTransformRunnerFactory.java:96)*13:43:05*
> at
> org.apache.beam.fn.harness.DoFnPTransformRunnerFactory.createRunnerForPTransform(DoFnPTransformRunnerFactory.java:64)*13:43:05*
> at
> org.apache.beam.fn.harness.control.ProcessBundleHandler.createRunnerAndConsumersForPTransformRecursively(ProcessBundleHandler.java:194)*13:43:05*
> at
> org.apache.beam.fn.harness.control.ProcessBundleHandler.createRunnerAndConsumersForPTransformRecursively(ProcessBundleHandler.java:163)*13:43:05*
> at
> org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:290)*13:43:05*
> at
> org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:160)*13:43:05*
> at
> org.apache.beam.fn.harness.control.BeamFnControlClient.lambda$processInstructionRequests$0(BeamFnControlClient.java:144)*13:43:05*
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)*13:43:05*
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)*13:43:05*
> at java.lang.Thread.run(Thread.java:748)*13:43:05* Caused by:
> java.io.InvalidClassException:
> org.apache.beam.sdk.options.ValueProvider$StaticValueProvider; local class
> incompatible: stream classdesc serialVersionUID = -7089438576249123133, local
> class serialVersionUID = -7141898054594373712*13:43:05* at
> java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:699)*13:43:05*
> at
> java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1885)*13:43:05*
> at
> java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1751)*13:43:05*
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2042)*13:43:05*
> at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)*13:43:05*
> at
> java.io.ObjectInputStream.readArray(ObjectInputStream.java:1975)*13:43:05*
> at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1567)*13:43:05*
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)*13:43:05*
> at
> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)*13:43:05*
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)*13:43:05*
> at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)*13:43:05*
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)*13:43:05*
> at
> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)*13:43:05*
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)*13:43:05*
> at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)*13:43:05*
> at
> java.io.ObjectInputStream.readArray(ObjectInputStream.java:1975)*13:43:05*
> at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1567)*13:43:05*
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)*13:43:05*
> at
> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)*13:43:05*
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)*13:43:05*
> at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)*13:43:05*
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)*13:43:05*
> at
> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)*13:43:05*
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)*13:43:05*
> at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)*13:43:05*
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)*13:43:05*
> at
> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)*13:43:05*
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)*13:43:05*
> at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)*13:43:05*
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)*13:43:05*
> at
> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)*13:43:05*
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)*13:43:05*
> at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)*13:43:05*
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)*13:43:05*
> at
> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)*13:43:05*
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)*13:43:05*
> at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)*13:43:05*
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)*13:43:05*
> at
> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)*13:43:05*
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)*13:43:05*
> at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)*13:43:05*
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)*13:43:05*
> at
> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)*13:43:05*
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)*13:43:05*
> at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)*13:43:05*
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)*13:43:05*
> at
> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)*13:43:05*
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)*13:43:05*
> at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)*13:43:05*
> at
> java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2287)*13:43:05*
> at
> java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2211)*13:43:05*
> at
> java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2069)*13:43:05*
> at
> java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)*13:43:05*
> at
> java.io.ObjectInputStream.readObject(ObjectInputStream.java:431)*13:43:05*
> at
> org.apache.beam.sdk.util.SerializableUtils.deserializeFromByteArray(SerializableUtils.java:71)*13:43:05*
> ... 13 more
--
This message was sent by Atlassian Jira
(v8.3.4#803005)