Thomas Poepping updated HIVE-14373:
    Attachment: HIVE-14373.05.patch

I'll create a new review-board submission, as I can't edit the old one.

This patch takes what Abdullah had and adds improvements, including:
 * added an abstraction in CliDrivers to increase code reuse
 * allowed QTEST_LEAVE_FILES implemented in HIVE-8100 to be used to leave files 
in blobstore for debugging
 * implemented unique blobstore paths for individual test runs, so if multiple 
people start test runs at the same time with the same blobstore path, there 
will be no collisions
 * moved test.blobstore.path to the conf.xml file, so it need not be specified 
each time
 * fixed README, added more examples

> Add integration tests for hive on S3
> ------------------------------------
>                 Key: HIVE-14373
>                 URL: https://issues.apache.org/jira/browse/HIVE-14373
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Sergio Peña
>            Assignee: Thomas Poepping
>         Attachments: HIVE-14373.02.patch, HIVE-14373.03.patch, 
> HIVE-14373.04.patch, HIVE-14373.05.patch, HIVE-14373.05.patch, 
> HIVE-14373.patch
> With Hive doing improvements to run on S3, it would be ideal to have better 
> integration testing on S3.
> These S3 tests won't be able to be executed by HiveQA because it will need 
> Amazon credentials. We need to write suite based on ideas from the Hadoop 
> project where:
> - an xml file is provided with S3 credentials
> - a committer must run these tests manually to verify it works
> - the xml file should not be part of the commit, and hiveqa should not run 
> these tests.
> https://wiki.apache.org/hadoop/HowToContribute#Submitting_patches_against_object_stores_such_as_Amazon_S3.2C_OpenStack_Swift_and_Microsoft_Azure

This message was sent by Atlassian JIRA

Reply via email to