Thomas Poepping updated HIVE-14373:
    Attachment: HIVE-14373.05.patch

I'll open a new review-board request for this, as I can't update the old one.

This patch takes what Abdullah had and:
 * creates an abstraction in the CliDrivers for code reuse
 * allows the QTEST_LEAVE_FILES environment variable implemented in HIVE-8100 
to be used to optionally leave files in S3 for inspection and debugging
 * abstracts the test.blobstore.path to the conf.xml file, so it doesn't need 
to be set each time
 * implements a unique folder identifier for each test run, so if multiple 
people run tests against the same blobstore path at the same time, there will 
be no collisions

> Add integration tests for hive on S3
> ------------------------------------
>                 Key: HIVE-14373
>                 URL: https://issues.apache.org/jira/browse/HIVE-14373
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Sergio Peña
>            Assignee: Thomas Poepping
>         Attachments: HIVE-14373.02.patch, HIVE-14373.03.patch, 
> HIVE-14373.04.patch, HIVE-14373.05.patch, HIVE-14373.patch
> With Hive doing improvements to run on S3, it would be ideal to have better 
> integration testing on S3.
> These S3 tests won't be able to be executed by HiveQA because it will need 
> Amazon credentials. We need to write suite based on ideas from the Hadoop 
> project where:
> - an xml file is provided with S3 credentials
> - a committer must run these tests manually to verify it works
> - the xml file should not be part of the commit, and hiveqa should not run 
> these tests.
> https://wiki.apache.org/hadoop/HowToContribute#Submitting_patches_against_object_stores_such_as_Amazon_S3.2C_OpenStack_Swift_and_Microsoft_Azure

This message was sent by Atlassian JIRA

Reply via email to