[
https://issues.apache.org/jira/browse/BEAM-3997?focusedWorklogId=92543&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-92543
]
ASF GitHub Bot logged work on BEAM-3997:
----------------------------------------
Author: ASF GitHub Bot
Created on: 19/Apr/18 12:50
Start Date: 19/Apr/18 12:50
Worklog Time Spent: 10m
Work Description: lgajowy commented on a change in pull request #5097:
[BEAM-3997] HCatalog integration test
URL: https://github.com/apache/beam/pull/5097#discussion_r182733665
##########
File path: sdks/java/io/hcatalog/pom.xml
##########
@@ -35,6 +35,118 @@
<apache.commons.version>2.5</apache.commons.version>
</properties>
+ <profiles>
+ <!--
+ This profile invokes PerfKitBenchmarker, which does benchmarking of
+ the IO ITs. The arguments passed to it allow it to invoke mvn again
+ with the desired benchmark.
+
+ To invoke this, run:
+
+ mvn verify -Dio-it-suite -pl sdks/java/io/file-based-io-tests
Review comment:
@iemejia thanks for this question, because it gives a feedback meaning that
we should popularise and describe the IOITs more!
The test you're currently reviewing is specific: currently one can run it
only if he/she has all existing infrastructure set up. We currently (locally)
use google dataproc and special [init
action](https://github.com/GoogleCloudPlatform/dataproc-initialization-actions/tree/master/hive-hcatalog)
to setup needed infrastructure.
Please consider this a work in progress: this is yet do be decided if we
provide dedicated kubernetes setup for this test (the way we did in other
tests) or setup this standalone dataproc infrastructure and use it on jenkins.
There is a website, but IMO it needs solid improvement. This is also a
pending task, but it's to be done after the gradle migration (which I'm
finishing it right now). It might be a good idea to describe current HCatalog
infrastracture setup there too.
@kkucharc let's add a README.md file with infrastructure description for
this test only, at least for now, given that there's no mention about the
exceptional setup and we still didn't decide which option is best. I think this
is the best and quickest solution. @iemejia do you agree?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 92543)
Time Spent: 2h 20m (was: 2h 10m)
> implement HCatalog integration test
> -----------------------------------
>
> Key: BEAM-3997
> URL: https://issues.apache.org/jira/browse/BEAM-3997
> Project: Beam
> Issue Type: Test
> Components: testing
> Reporter: Dariusz Aniszewski
> Assignee: Jason Kuster
> Priority: Major
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
