See <https://builds.apache.org/job/beam_PerformanceTests_Python/976/display/redirect>
------------------------------------------ [...truncated 790.84 KB...] [INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-banned-dependencies) @ beam-runners-flink_2.11 --- [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-runners-flink_2.11 --- [INFO] [INFO] --- maven-resources-plugin:3.0.2:resources (default-resources) @ beam-runners-flink_2.11 --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 1 resource [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @ beam-runners-flink_2.11 --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 75 source files to <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/beam/runners/flink/target/classes> [INFO] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/beam/runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkBatchTransformTranslators.java>: Some input files use or override a deprecated API. [INFO] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/beam/runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkBatchTransformTranslators.java>: Recompile with -Xlint:deprecation for details. [INFO] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/beam/runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/state/FlinkStateInternals.java>: Some input files use unchecked or unsafe operations. [INFO] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/beam/runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/state/FlinkStateInternals.java>: Recompile with -Xlint:unchecked for details. [INFO] ------------------------------------------------------------- [ERROR] COMPILATION ERROR : [INFO] ------------------------------------------------------------- [ERROR] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/beam/runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/DoFnOperator.java>:[359,11] cannot infer type arguments for org.apache.beam.runners.core.ProcessFnRunner<> reason: cannot infer type-variable(s) InputT,OutputT,RestrictionT (argument mismatch; org.apache.beam.runners.core.DoFnRunner cannot be converted to org.apache.beam.runners.core.SimpleDoFnRunner<org.apache.beam.runners.core.KeyedWorkItem<java.lang.String,org.apache.beam.sdk.values.KV<InputT,RestrictionT>>,OutputT>) [INFO] 1 error [INFO] ------------------------------------------------------------- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Beam :: Parent .............................. SUCCESS [ 9.843 s] [INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 4.240 s] [INFO] Apache Beam :: Model ............................... SUCCESS [ 0.036 s] [INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 10.106 s] [INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 4.926 s] [INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 4.934 s] [INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.161 s] [INFO] Apache Beam :: SDKs :: Go .......................... SUCCESS [ 14.334 s] [INFO] Apache Beam :: SDKs :: Java ........................ SUCCESS [ 0.189 s] [INFO] Apache Beam :: SDKs :: Java :: Core ................ SUCCESS [ 48.787 s] [INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SUCCESS [ 6.165 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SUCCESS [ 0.126 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SUCCESS [ 7.575 s] [INFO] Apache Beam :: Runners ............................. SUCCESS [ 0.183 s] [INFO] Apache Beam :: Runners :: Core Construction Java ... SUCCESS [ 6.544 s] [INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 5.629 s] [INFO] Apache Beam :: SDKs :: Java :: Harness ............. SUCCESS [ 10.202 s] [INFO] Apache Beam :: SDKs :: Java :: Container ........... SUCCESS [ 4.149 s] [INFO] Apache Beam :: SDKs :: Java :: IO .................. SUCCESS [ 0.077 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SUCCESS [ 3.457 s] [INFO] Apache Beam :: Runners :: Local Java Core .......... SUCCESS [ 1.729 s] [INFO] Apache Beam :: Runners :: Direct Java .............. SUCCESS [ 12.401 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SUCCESS [ 3.431 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SUCCESS [ 1.993 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SUCCESS [ 3.031 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SUCCESS [ 2.635 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 0.731 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.615 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 3.428 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 3.410 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 2.797 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 5.267 s] [INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 9.112 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 2.222 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 6.671 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 4.467 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 3.493 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 15.892 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 7.601 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 11.398 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 2.531 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 3.049 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 1.974 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 2.755 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 2.526 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 2.303 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 6.551 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 6.295 s] [INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 2.371 s] [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.043 s] [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 9.071 s] [INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.033 s] [INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 4.031 s] [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 28.814 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 1.990 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 2.149 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 2.911 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 2.774 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 16.322 s] [INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 16.708 s] [INFO] Apache Beam :: SDKs :: Python ...................... SUCCESS [ 17.060 s] [INFO] Apache Beam :: SDKs :: Python :: Container ......... SUCCESS [ 3.855 s] [INFO] Apache Beam :: Runners :: Java Fn Execution ........ SUCCESS [ 3.902 s] [INFO] Apache Beam :: Runners :: Java Local Artifact Service SUCCESS [ 2.287 s] [INFO] Apache Beam :: Runners :: Reference ................ SUCCESS [ 0.034 s] [INFO] Apache Beam :: Runners :: Reference :: Java ........ SUCCESS [ 1.819 s] [INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SUCCESS [ 3.052 s] [INFO] Apache Beam :: Runners :: Flink .................... FAILURE [ 4.797 s] [INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED [INFO] Apache Beam :: Runners :: Spark .................... SKIPPED [INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED [INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED [INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 06:40 min [INFO] Finished at: 2018-03-02T18:07:29Z [INFO] Final Memory: 382M/1862M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.7.0:compile (default-compile) on project beam-runners-flink_2.11: Compilation failure [ERROR] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/beam/runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/DoFnOperator.java>:[359,11] cannot infer type arguments for org.apache.beam.runners.core.ProcessFnRunner<> [ERROR] reason: cannot infer type-variable(s) InputT,OutputT,RestrictionT [ERROR] (argument mismatch; org.apache.beam.runners.core.DoFnRunner cannot be converted to org.apache.beam.runners.core.SimpleDoFnRunner<org.apache.beam.runners.core.KeyedWorkItem<java.lang.String,org.apache.beam.sdk.values.KV<InputT,RestrictionT>>,OutputT>) [ERROR] [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :beam-runners-flink_2.11 STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache). log4j:WARN Please initialize the log4j system properly. Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking. /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:355: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0' normalized_version, /usr/local/lib/python2.7/dist-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:318: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#snimissingwarning. SNIMissingWarning /usr/local/lib/python2.7/dist-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#insecureplatformwarning. InsecurePlatformWarning /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:355: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0' normalized_version, <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/beam/sdks/python/gen_protos.py>:50: UserWarning: Installing grpcio-tools is recommended for development. warnings.warn('Installing grpcio-tools is recommended for development.') WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/beam/sdks/python/.eggs/grpcio-wheels> WARNING:root:Installing grpcio-tools took 4.31 seconds. /usr/local/lib/python2.7/dist-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:318: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#snimissingwarning. SNIMissingWarning /usr/local/lib/python2.7/dist-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:122: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/security.html#insecureplatformwarning. InsecurePlatformWarning <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/beam/sdks/python/target/python/lib/python2.7/site-packages/setuptools/dist.py>:355: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0' normalized_version, 2018-03-02 18:07:30,402 a7f46637 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark 2018-03-02 18:07:30,418 a7f46637 MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz> 2018-03-02 18:07:32,417 a7f46637 MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1, WallTime:0:01.99s, CPU:1.13s, MaxMemory:36212kb STDOUT: STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:355: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0' normalized_version, <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/beam/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/plugins/manager.py>:395: RuntimeWarning: Unable to load plugin beam_test_plugin = test_config:BeamTestPlugin: The 'hdfs<3.0.0,>=2.1.0' distribution was not found and is required by the application RuntimeWarning) usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...] or: setup.py --help [cmd1 cmd2 ...] or: setup.py --help-commands or: setup.py cmd --help error: option --test-pipeline-options not recognized 2018-03-02 18:07:32,418 a7f46637 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 622, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 525, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2018-03-02 18:07:32,419 a7f46637 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2018-03-02 18:07:32,421 a7f46637 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 732, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 622, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 525, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 159, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2018-03-02 18:07:32,421 a7f46637 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2018-03-02 18:07:32,421 a7f46637 MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2018-03-02 18:07:32,421 a7f46637 MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/pkb.log> 2018-03-02 18:07:32,421 a7f46637 MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/a7f46637/completion_statuses.json> Build step 'Execute shell' marked build as failure Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected] Not sending mail to unregistered user [email protected]
