[
https://issues.apache.org/jira/browse/BEAM-4415?focusedWorklogId=109334&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-109334
]
ASF GitHub Bot logged work on BEAM-4415:
----------------------------------------
Author: ASF GitHub Bot
Created on: 06/Jun/18 10:51
Start Date: 06/Jun/18 10:51
Worklog Time Spent: 10m
Work Description: lgajowy closed pull request #5520: [BEAM-4415] Add
jenkins job for HDFS ParquetIOIT
URL: https://github.com/apache/beam/pull/5520
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):
diff --git
a/.test-infra/jenkins/job_PerformanceTests_FileBasedIO_IT_HDFS.groovy
b/.test-infra/jenkins/job_PerformanceTests_FileBasedIO_IT_HDFS.groovy
index 7aa5c3251c0..22be13c7139 100644
--- a/.test-infra/jenkins/job_PerformanceTests_FileBasedIO_IT_HDFS.groovy
+++ b/.test-infra/jenkins/job_PerformanceTests_FileBasedIO_IT_HDFS.groovy
@@ -78,6 +78,17 @@ def testsConfigurations = [
numberOfRecords: '100000',
charset: 'UTF-8'
]
+ ],
+ [
+ jobName : 'beam_PerformanceTests_ParquetIOIT_HDFS',
+ jobDescription : 'Runs PerfKit tests for
beam_PerformanceTests_ParquetIOIT on HDFS',
+ itClass :
'org.apache.beam.sdk.io.parquet.ParquetIOIT',
+ bqTable :
'beam_performance.parquetioit_hdfs_pkb_results',
+ prCommitStatusName: 'Java ParquetIOPerformance Test on HDFS',
+ prTriggerPhase : 'Run Java ParquetIO Performance Test HDFS',
+ extraPipelineArgs: [
+ numberOfRecords: '1000000'
+ ]
]
]
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 109334)
Time Spent: 50m (was: 40m)
> Enable HDFS based Performance Test for ParquetIO
> ------------------------------------------------
>
> Key: BEAM-4415
> URL: https://issues.apache.org/jira/browse/BEAM-4415
> Project: Beam
> Issue Type: New Feature
> Components: io-java-parquet, testing
> Reporter: Łukasz Gajowy
> Assignee: Łukasz Gajowy
> Priority: Major
> Time Spent: 50m
> Remaining Estimate: 0h
>
> There already is a running job for ParquetIO on Jenkins:
> [https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_ParquetIOIT/]
>
> There are also Jenkins' Jobs running such tests on an HDFS cluster:
> [https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_AvroIOIT_HDFS/]
>
> Therefore, we should provide a Performance Test for ParquetIO running on HDFS
> cluster.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
