See <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/1017/display/redirect?page=changes>
Changes: [lukasz.gajowy] [BEAM-6076] Fetch only required fields for BigQuery Table [robertwb] Implement profiling for Python DirectRunner and SDK Harness. ------------------------------------------ [...truncated 217.22 KB...] ******************* GRADLE SHADOW STATS Total Jars: 2 (includes project) Total Time: 3.676s [3676ms] Average Time/Jar: 1.838s [1838.0ms] ******************* :beam-sdks-java-fn-execution:shadowJar (Thread[Task worker for ':' Thread 6,5,main]) completed. Took 3.897 secs. > Task :beam-runners-core-construction-java:shadowJar ******************* GRADLE SHADOW STATS Total Jars: 2 (includes project) Total Time: 3.325s [3325ms] Average Time/Jar: 1.6625s [1662.5ms] ******************* :beam-runners-core-construction-java:shadowJar (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 4.08 secs. :beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 3,5,main]) started. > Task :beam-runners-core-java:compileJava Deleting stale output file: <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/src/runners/core-java/build/generated/source/apt/main> Deleting stale output file: <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/src/runners/core-java/build/classes/java/main> Build cache key for task ':beam-runners-core-java:compileJava' is b2bb4c88f15bfc550a24b4433f3fe00d Task ':beam-runners-core-java:compileJava' is not up-to-date because: No history is available. Custom actions are attached to task ':beam-runners-core-java:compileJava'. All input files are considered out-of-date for incremental task ':beam-runners-core-java:compileJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with error-prone compiler > Task :beam-sdks-java-io-google-cloud-platform:compileJava Created classpath snapshot for incremental compilation in 0.889 secs. 51 duplicate classes found in classpath (see all with --debug). Packing task ':beam-sdks-java-io-google-cloud-platform:compileJava' :beam-sdks-java-io-google-cloud-platform:compileJava (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 15.537 secs. :beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' Thread 14,5,main]) started. > Task :beam-sdks-java-io-google-cloud-platform:classes Skipping task ':beam-sdks-java-io-google-cloud-platform:classes' as it has no actions. :beam-sdks-java-io-google-cloud-platform:classes (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 0.0 secs. :beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' Thread 14,5,main]) started. > Task :beam-sdks-java-io-google-cloud-platform:shadowJar Build cache key for task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is a6a1fc3c3dfc8e52daf3d511d5c4eb26 Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:shadowJar': Caching has not been enabled for the task Task ':beam-sdks-java-io-google-cloud-platform:shadowJar' is not up-to-date because: No history is available. ******************* GRADLE SHADOW STATS Total Jars: 1 (includes project) Total Time: 0.0s [0ms] Average Time/Jar: 0.0s [0.0ms] ******************* :beam-sdks-java-io-google-cloud-platform:shadowJar (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 0.204 secs. :beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for ':' Thread 14,5,main]) started. > Task :beam-runners-core-java:compileJava Created classpath snapshot for incremental compilation in 0.73 secs. 409 duplicate classes found in classpath (see all with --debug). Packing task ':beam-runners-core-java:compileJava' :beam-runners-core-java:compileJava (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 10.256 secs. :beam-runners-core-java:classes (Thread[Task worker for ':' Thread 3,5,main]) started. > Task :beam-runners-core-java:classes Skipping task ':beam-runners-core-java:classes' as it has no actions. :beam-runners-core-java:classes (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.0 secs. :beam-runners-core-java:shadowJar (Thread[Task worker for ':' Thread 3,5,main]) started. > Task :beam-runners-google-cloud-dataflow-java:compileJava Build cache key for task ':beam-runners-google-cloud-dataflow-java:compileJava' is 12c6a4cd5fad6749a5a32b05a032baf1 Task ':beam-runners-google-cloud-dataflow-java:compileJava' is not up-to-date because: No history is available. Custom actions are attached to task ':beam-runners-google-cloud-dataflow-java:compileJava'. All input files are considered out-of-date for incremental task ':beam-runners-google-cloud-dataflow-java:compileJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with error-prone compiler > Task :beam-runners-core-java:shadowJar Build cache key for task ':beam-runners-core-java:shadowJar' is 8779b7cfb30b2cee9bb480f88f45e355 Caching disabled for task ':beam-runners-core-java:shadowJar': Caching has not been enabled for the task Task ':beam-runners-core-java:shadowJar' is not up-to-date because: No history is available. ******************* GRADLE SHADOW STATS Total Jars: 2 (includes project) Total Time: 2.57s [2570ms] Average Time/Jar: 1.285s [1285.0ms] ******************* :beam-runners-core-java:shadowJar (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 2.952 secs. :beam-sdks-java-harness:compileJava (Thread[Task worker for ':' Thread 3,5,main]) started. > Task :beam-sdks-java-harness:compileJava Build cache key for task ':beam-sdks-java-harness:compileJava' is 7632e131e019d4a7ac6fef8320566913 Task ':beam-sdks-java-harness:compileJava' is not up-to-date because: No history is available. Custom actions are attached to task ':beam-sdks-java-harness:compileJava'. All input files are considered out-of-date for incremental task ':beam-sdks-java-harness:compileJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with error-prone compiler > Task :beam-runners-google-cloud-dataflow-java:compileJava Created classpath snapshot for incremental compilation in 0.12 secs. 421 duplicate classes found in classpath (see all with --debug). Packing task ':beam-runners-google-cloud-dataflow-java:compileJava' :beam-runners-google-cloud-dataflow-java:compileJava (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 9.746 secs. :beam-runners-google-cloud-dataflow-java:classes (Thread[Task worker for ':' Thread 14,5,main]) started. > Task :beam-runners-google-cloud-dataflow-java:classes Skipping task ':beam-runners-google-cloud-dataflow-java:classes' as it has no actions. :beam-runners-google-cloud-dataflow-java:classes (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 0.0 secs. :beam-runners-google-cloud-dataflow-java:shadowJar (Thread[Task worker for ':' Thread 14,5,main]) started. > Task :beam-runners-google-cloud-dataflow-java:shadowJar Build cache key for task ':beam-runners-google-cloud-dataflow-java:shadowJar' is 8e411c631c92f5901f6c3cb2320a3024 Caching disabled for task ':beam-runners-google-cloud-dataflow-java:shadowJar': Caching has not been enabled for the task Task ':beam-runners-google-cloud-dataflow-java:shadowJar' is not up-to-date because: No history is available. ******************* GRADLE SHADOW STATS Total Jars: 2 (includes project) Total Time: 3.235s [3235ms] Average Time/Jar: 1.6175s [1617.5ms] ******************* :beam-runners-google-cloud-dataflow-java:shadowJar (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 3.677 secs. > Task :beam-sdks-java-harness:compileJava Created classpath snapshot for incremental compilation in 0.428 secs. 421 duplicate classes found in classpath (see all with --debug). Packing task ':beam-sdks-java-harness:compileJava' :beam-sdks-java-harness:compileJava (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 8.429 secs. :beam-sdks-java-harness:classes (Thread[Task worker for ':' Thread 3,5,main]) started. > Task :beam-sdks-java-harness:classes Skipping task ':beam-sdks-java-harness:classes' as it has no actions. :beam-sdks-java-harness:classes (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.0 secs. :beam-sdks-java-harness:jar (Thread[Task worker for ':',5,main]) started. > Task :beam-sdks-java-harness:jar Build cache key for task ':beam-sdks-java-harness:jar' is 0f950f7bf916ed3d5f075f3a91a3e06f Caching disabled for task ':beam-sdks-java-harness:jar': Caching has not been enabled for the task Task ':beam-sdks-java-harness:jar' is not up-to-date because: No history is available. :beam-sdks-java-harness:jar (Thread[Task worker for ':',5,main]) completed. Took 0.053 secs. :beam-sdks-java-harness:shadowJar (Thread[Task worker for ':',5,main]) started. > Task :beam-sdks-java-core:compileTestJava Created classpath snapshot for incremental compilation in 1.037 secs. 90 duplicate classes found in classpath (see all with --debug). Packing task ':beam-sdks-java-core:compileTestJava' :beam-sdks-java-core:compileTestJava (Thread[Task worker for ':' Thread 4,5,main]) completed. Took 33.69 secs. :beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 4,5,main]) started. > Task :beam-sdks-java-core:testClasses Skipping task ':beam-sdks-java-core:testClasses' as it has no actions. :beam-sdks-java-core:testClasses (Thread[Task worker for ':' Thread 4,5,main]) completed. Took 0.0 secs. :beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 4,5,main]) started. > Task :beam-sdks-java-harness:shadowJar Build cache key for task ':beam-sdks-java-harness:shadowJar' is fde3b649668fdb5a194389cecb6b41a0 Caching disabled for task ':beam-sdks-java-harness:shadowJar': Caching has not been enabled for the task Task ':beam-sdks-java-harness:shadowJar' is not up-to-date because: No history is available. > Task :beam-sdks-java-core:shadowTestJar Build cache key for task ':beam-sdks-java-core:shadowTestJar' is 5070c8fb649c06f5929b2994d15a0e7a Caching disabled for task ':beam-sdks-java-core:shadowTestJar': Caching has not been enabled for the task Task ':beam-sdks-java-core:shadowTestJar' is not up-to-date because: No history is available. ******************* GRADLE SHADOW STATS Total Jars: 6 (includes project) Total Time: 6.919s [6919ms] Average Time/Jar: 1.1531666666667s [1153.1666666667ms] ******************* :beam-sdks-java-core:shadowTestJar (Thread[Task worker for ':' Thread 4,5,main]) completed. Took 8.866 secs. :beam-sdks-java-extensions-google-cloud-platform-core:compileTestJava (Thread[Task worker for ':' Thread 4,5,main]) started. > Task :beam-sdks-java-extensions-google-cloud-platform-core:compileTestJava Build cache key for task ':beam-sdks-java-extensions-google-cloud-platform-core:compileTestJava' is c91329c33faf148cdc91db167f885a99 Task ':beam-sdks-java-extensions-google-cloud-platform-core:compileTestJava' is not up-to-date because: No history is available. Custom actions are attached to task ':beam-sdks-java-extensions-google-cloud-platform-core:compileTestJava'. All input files are considered out-of-date for incremental task ':beam-sdks-java-extensions-google-cloud-platform-core:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Compiling with error-prone compiler # # There is insufficient memory for the Java Runtime Environment to continue. # Native memory allocation (mmap) failed to map 1233649664 bytes for committing reserved memory. # An error report file with more information is saved as: # <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/src/hs_err_pid31288.log> STDERR: Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x0000000741780000, 1233649664, 0) failed; error='Cannot allocate memory' (errno=12) 2018-11-19 12:10:41,476 aa4d06ef MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 719, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 580, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 160, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2018-11-19 12:10:41,665 aa4d06ef MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2018-11-19 12:10:41,723 aa4d06ef MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 860, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 719, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 580, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 160, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2018-11-19 12:10:41,724 aa4d06ef MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2018-11-19 12:10:41,779 aa4d06ef MainThread INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2018-11-19 12:10:41,780 aa4d06ef MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/runs/aa4d06ef/pkb.log> 2018-11-19 12:10:41,780 aa4d06ef MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/runs/aa4d06ef/completion_statuses.json> Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
