[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=238450=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-238450 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 07/May/19 13:20 Start Date: 07/May/19 13:20 Worklog Time Spent: 10m Work Description: lgajowy commented on issue #8427: [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-490076190 Cool - I updated the metrics plot for that: https://s.apache.org/io-test-dashboards (at the bottom). Thanks for doing this. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 238450) Time Spent: 3h 40m (was: 3.5h) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Fix For: 2.13.0 > > Time Spent: 3h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=236374=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-236374 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 02/May/19 15:51 Start Date: 02/May/19 15:51 Worklog Time Spent: 10m Work Description: iemejia commented on pull request #8427: [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 236374) Time Spent: 3.5h (was: 3h 20m) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 3.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=236363=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-236363 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 02/May/19 15:28 Start Date: 02/May/19 15:28 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #8427: [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-488718843 Run Java HadoopFormatIO Performance Test This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 236363) Time Spent: 3h 20m (was: 3h 10m) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 3h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=236355=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-236355 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 02/May/19 15:17 Start Date: 02/May/19 15:17 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-488704293 Run Java HadoopFormatIO Performance Test This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 236355) Time Spent: 3h (was: 2h 50m) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 3h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=236356=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-236356 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 02/May/19 15:17 Start Date: 02/May/19 15:17 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #8427: [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-488714416 Run Seed Job This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 236356) Time Spent: 3h 10m (was: 3h) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 3h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=236354=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-236354 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 02/May/19 15:16 Start Date: 02/May/19 15:16 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-488714251 @mwalenia Yes, I copied these metric gathering into `HadoopFormatIOIT ` as well, thanks This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 236354) Time Spent: 2h 50m (was: 2h 40m) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 2h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=236340=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-236340 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 02/May/19 14:51 Start Date: 02/May/19 14:51 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-488704293 Run Java HadoopFormatIO Performance Test This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 236340) Time Spent: 2h 40m (was: 2.5h) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 2h 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=236214=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-236214 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 02/May/19 10:48 Start Date: 02/May/19 10:48 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on pull request #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#discussion_r280367779 ## File path: website/src/documentation/io/testing.md ## @@ -274,7 +274,7 @@ Since `performanceTest` task involved running PerfkitBenchmarker, we can't use i Example usage on Cloud Dataflow runner: ``` -./gradlew integrationTest -p sdks/java/io/hadoop-input-format -DintegrationTestPipelineOptions='["--project=GOOGLE_CLOUD_PROJECT", "--tempRoot=GOOGLE_STORAGE_BUCKET", "--numberOfRecords=1000", "--postgresPort=5432", "--postgresServerName=SERVER_NAME", "--postgresUsername=postgres", "--postgresPassword=PASSWORD", "--postgresDatabaseName=postgres", "--postgresSsl=false", "--runner=TestDataflowRunner"]' -DintegrationTestRunner=dataflow --tests=org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIOIT +./gradlew integrationTest -p sdks/java/io/hadoop-format -DintegrationTestPipelineOptions='["--project=GOOGLE_CLOUD_PROJECT", "--tempRoot=GOOGLE_STORAGE_BUCKET", "--numberOfRecords=1000", "--postgresPort=5432", "--postgresServerName=SERVER_NAME", "--postgresUsername=postgres", "--postgresPassword=PASSWORD", "--postgresDatabaseName=postgres", "--postgresSsl=false", "--runner=TestDataflowRunner"]' -DintegrationTestRunner=dataflow --tests=org.apache.beam.sdk.io.hadoop.format.HadoopFormatIOIT Review comment: I can confirm that It works fine with SparkRunner and local Postgres This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 236214) Time Spent: 2.5h (was: 2h 20m) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 2.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=235725=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-235725 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 01/May/19 09:05 Start Date: 01/May/19 09:05 Worklog Time Spent: 10m Work Description: mwalenia commented on issue #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-488239961 @aromanenko-dev could you add metric gathering to `HadoopFormatIOIT`? It's included in `HadoopInputFormatIOIT`. Lack of metrics will disable reporting on dashboards, it would be good to keep the functionality intact. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 235725) Time Spent: 2h 20m (was: 2h 10m) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 2h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=235608=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-235608 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 01/May/19 00:07 Start Date: 01/May/19 00:07 Worklog Time Spent: 10m Work Description: chamikaramj commented on issue #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-488158277 LGTM. Thanks. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 235608) Time Spent: 2h 10m (was: 2h) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 2h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=235556=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-235556 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 30/Apr/19 21:52 Start Date: 30/Apr/19 21:52 Worklog Time Spent: 10m Work Description: chamikaramj commented on pull request #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#discussion_r279947897 ## File path: website/src/documentation/io/testing.md ## @@ -274,7 +274,7 @@ Since `performanceTest` task involved running PerfkitBenchmarker, we can't use i Example usage on Cloud Dataflow runner: ``` -./gradlew integrationTest -p sdks/java/io/hadoop-input-format -DintegrationTestPipelineOptions='["--project=GOOGLE_CLOUD_PROJECT", "--tempRoot=GOOGLE_STORAGE_BUCKET", "--numberOfRecords=1000", "--postgresPort=5432", "--postgresServerName=SERVER_NAME", "--postgresUsername=postgres", "--postgresPassword=PASSWORD", "--postgresDatabaseName=postgres", "--postgresSsl=false", "--runner=TestDataflowRunner"]' -DintegrationTestRunner=dataflow --tests=org.apache.beam.sdk.io.hadoop.inputformat.HadoopInputFormatIOIT +./gradlew integrationTest -p sdks/java/io/hadoop-format -DintegrationTestPipelineOptions='["--project=GOOGLE_CLOUD_PROJECT", "--tempRoot=GOOGLE_STORAGE_BUCKET", "--numberOfRecords=1000", "--postgresPort=5432", "--postgresServerName=SERVER_NAME", "--postgresUsername=postgres", "--postgresPassword=PASSWORD", "--postgresDatabaseName=postgres", "--postgresSsl=false", "--runner=TestDataflowRunner"]' -DintegrationTestRunner=dataflow --tests=org.apache.beam.sdk.io.hadoop.format.HadoopFormatIOIT Review comment: Please confirm that this works by running manually. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 235556) Time Spent: 2h (was: 1h 50m) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 2h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=23=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-23 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 30/Apr/19 21:51 Start Date: 30/Apr/19 21:51 Worklog Time Spent: 10m Work Description: chamikaramj commented on issue #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-488128441 Run Java HadoopFormatIO Performance Test This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 23) Time Spent: 1h 50m (was: 1h 40m) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 1h 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=235546=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-235546 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 30/Apr/19 21:27 Start Date: 30/Apr/19 21:27 Worklog Time Spent: 10m Work Description: iemejia commented on issue #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-488121821 @chamikaramj can you please take a look at this one, it seems the polish crew are in holidays this week. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 235546) Time Spent: 1.5h (was: 1h 20m) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 1.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=235279=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-235279 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 30/Apr/19 13:24 Start Date: 30/Apr/19 13:24 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-487904167 R: @kkucharc R: @mwalenia R: @chamikaramj Could you take a look? I'm also wondering how to make new command `Run Java HadoopFormatIO Performance Test` working and run corresponding Jenkins job This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 235279) Time Spent: 1h 20m (was: 1h 10m) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=235228=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-235228 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 30/Apr/19 10:37 Start Date: 30/Apr/19 10:37 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-487904167 R: @kkucharc R: @mwalenia Could you take a look? I'm also wondering how to make new command `Run Java HadoopFormatIO Performance Test` working and run corresponding Jenkins job This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 235228) Time Spent: 1h 10m (was: 1h) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 1h 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=235227=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-235227 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 30/Apr/19 10:36 Start Date: 30/Apr/19 10:36 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-487870940 @melap Could you take a look? I'm also wondering how to make new command `Run Java HadoopFormatIO Performance Test` working and run Jenkins job This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 235227) Time Spent: 1h (was: 50m) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 1h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=235226=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-235226 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 30/Apr/19 10:36 Start Date: 30/Apr/19 10:36 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-487904167 @kkucharc @mwalenia Could you take a look? I'm also wondering how to make new command `Run Java HadoopFormatIO Performance Test` working and run corresponding Jenkins job This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 235226) Time Spent: 50m (was: 40m) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 50m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=235185=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-235185 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 30/Apr/19 08:59 Start Date: 30/Apr/19 08:59 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-487870940 @melap Could you take a look? I'm also wondering how to make new command `Run Java HadoopFormatIO Performance Test` working and run Jenkins job This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 235185) Time Spent: 40m (was: 0.5h) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 40m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=234634=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-234634 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 29/Apr/19 16:42 Start Date: 29/Apr/19 16:42 Worklog Time Spent: 10m Work Description: lgajowy commented on issue #8427: WIP [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-487653474 I'm on vacation until 5th may. Please reassign reviewer. Thanks :) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 234634) Time Spent: 0.5h (was: 20m) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=234627=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-234627 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 29/Apr/19 16:32 Start Date: 29/Apr/19 16:32 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on issue #8427: [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427#issuecomment-487650173 Run Java HadoopFormatIO Performance Test This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 234627) Time Spent: 20m (was: 10m) > Add HadoopFormatIO ITs to Jenkins > - > > Key: BEAM-6850 > URL: https://issues.apache.org/jira/browse/BEAM-6850 > Project: Beam > Issue Type: Improvement > Components: io-java-hadoop >Reporter: Alexey Romanenko >Assignee: Alexey Romanenko >Priority: Major > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-6850) Add HadoopFormatIO ITs to Jenkins
[ https://issues.apache.org/jira/browse/BEAM-6850?focusedWorklogId=234624=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-234624 ] ASF GitHub Bot logged work on BEAM-6850: Author: ASF GitHub Bot Created on: 29/Apr/19 16:29 Start Date: 29/Apr/19 16:29 Worklog Time Spent: 10m Work Description: aromanenko-dev commented on pull request #8427: [BEAM-6850] Use HadoopFormatIOIT for performance/integration testing URL: https://github.com/apache/beam/pull/8427 Use `HadoopFormatIOIT` for performance/integration testing instead of deprecated `HadoopInputFormatIOIT`. Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [x] [**Choose reviewer(s)**](https://beam.apache.org/contribute/#make-your-change) and mention them in a comment (`R: @username`). - [x] Format the pull request title like `[BEAM-XXX] Fixes bug in ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). Post-Commit Tests Status (on master branch) Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark --- | --- | --- | --- | --- | --- | --- | --- Go | [](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/) | --- | --- | --- | --- | --- | --- Java | [](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/) Python | [](https://builds.apache.org/job/beam_PostCommit_Python_Verify/lastCompletedBuild/)[](https://builds.apache.org/job/beam_PostCommit_Python3_Verify/lastCompletedBuild/) | --- | [](https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/lastCompletedBuild/) [](https://builds.apache.org/job/beam_PostCommit_Py_ValCont/lastCompletedBuild/) | [](https://builds.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/lastCompletedBuild/) | --- | --- | --- Pre-Commit Tests Status (on master branch) --- |Java | Python | Go |
