[
https://issues.apache.org/jira/browse/HIVE-14373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Poepping updated HIVE-14373:
-----------------------------------
Attachment: HIVE-14373.05.patch
I'll open a new review-board request for this, as I can't update the old one.
This patch takes what Abdullah had and:
* creates an abstraction in the CliDrivers for code reuse
* allows the QTEST_LEAVE_FILES environment variable implemented in HIVE-8100
to be used to optionally leave files in S3 for inspection and debugging
* abstracts the test.blobstore.path to the conf.xml file, so it doesn't need
to be set each time
* implements a unique folder identifier for each test run, so if multiple
people run tests against the same blobstore path at the same time, there will
be no collisions
> Add integration tests for hive on S3
> ------------------------------------
>
> Key: HIVE-14373
> URL: https://issues.apache.org/jira/browse/HIVE-14373
> Project: Hive
> Issue Type: Sub-task
> Reporter: Sergio Peña
> Assignee: Thomas Poepping
> Attachments: HIVE-14373.02.patch, HIVE-14373.03.patch,
> HIVE-14373.04.patch, HIVE-14373.05.patch, HIVE-14373.patch
>
>
> With Hive doing improvements to run on S3, it would be ideal to have better
> integration testing on S3.
> These S3 tests won't be able to be executed by HiveQA because it will need
> Amazon credentials. We need to write suite based on ideas from the Hadoop
> project where:
> - an xml file is provided with S3 credentials
> - a committer must run these tests manually to verify it works
> - the xml file should not be part of the commit, and hiveqa should not run
> these tests.
> https://wiki.apache.org/hadoop/HowToContribute#Submitting_patches_against_object_stores_such_as_Amazon_S3.2C_OpenStack_Swift_and_Microsoft_Azure
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
