[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937975#comment-15937975 ] Lefty Leverenz commented on HIVE-15867: --- Doc note: This appends ",s3,s3a" to the default value of *hive.exim.uri.scheme.whitelist* so the wiki needs to be updated again. (It already has a 2.2.0 update for HIVE-15151.) * [Configuration Properties -- hive.exim.uri.scheme.whitelist | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.exim.uri.scheme.whitelist] * formatting example using bullet list: [hive.mapred.mode | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.mapred.mode] Added a TODOC2.2 label. > Add blobstore tests for import/export > - > > Key: HIVE-15867 > URL: https://issues.apache.org/jira/browse/HIVE-15867 > Project: Hive > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Thomas Poepping >Assignee: Juan Rodríguez Hortalá > Labels: TODOC2.2, patch, test > Fix For: 2.2.0 > > Attachments: HIVE-15867.patch > > > This patch covers ten separate tests testing import and export operations > running against blobstore filesystems: > * Import addpartition > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore > ** blobstore -> hdfs > * import/export > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore (partitioned and non-partitioned) > ** blobstore -> HDFS (partitioned and non-partitioned) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export
[
https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937051#comment-15937051
]
Hive QA commented on HIVE-15867:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12859974/HIVE-15867.patch
{color:green}SUCCESS:{color} +1 due to 10 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 10507 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[comments] (batchId=35)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_if_expr]
(batchId=141)
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/4294/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/4294/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-4294/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12859974 - PreCommit-HIVE-Build
> Add blobstore tests for import/export
> -
>
> Key: HIVE-15867
> URL: https://issues.apache.org/jira/browse/HIVE-15867
> Project: Hive
> Issue Type: Bug
>Affects Versions: 2.1.1
>Reporter: Thomas Poepping
>Assignee: Juan Rodríguez Hortalá
> Labels: patch, test
> Attachments: HIVE-15867.patch
>
>
> This patch covers ten separate tests testing import and export operations
> running against blobstore filesystems:
> * Import addpartition
> ** blobstore -> file
> ** file -> blobstore
> ** blobstore -> blobstore
> ** blobstore -> hdfs
> * import/export
> ** blobstore -> file
> ** file -> blobstore
> ** blobstore -> blobstore (partitioned and non-partitioned)
> ** blobstore -> HDFS (partitioned and non-partitioned)
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936783#comment-15936783 ] Juan Rodríguez Hortalá commented on HIVE-15867: --- Ok, thanks for the tip > Add blobstore tests for import/export > - > > Key: HIVE-15867 > URL: https://issues.apache.org/jira/browse/HIVE-15867 > Project: Hive > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Thomas Poepping >Assignee: Juan Rodríguez Hortalá > Labels: patch, test > Attachments: HIVE-15867-v3.patch > > > This patch covers ten separate tests testing import and export operations > running against blobstore filesystems: > * Import addpartition > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore > ** blobstore -> hdfs > * import/export > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore (partitioned and non-partitioned) > ** blobstore -> HDFS (partitioned and non-partitioned) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936782#comment-15936782 ] Sergio Peña commented on HIVE-15867: Please monitor the Jenkins job that will run these tests. If it does not post the test results, then add the results and the job linkmanually as a comment. > Add blobstore tests for import/export > - > > Key: HIVE-15867 > URL: https://issues.apache.org/jira/browse/HIVE-15867 > Project: Hive > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Thomas Poepping >Assignee: Juan Rodríguez Hortalá > Labels: patch, test > Attachments: HIVE-15867-v3.patch > > > This patch covers ten separate tests testing import and export operations > running against blobstore filesystems: > * Import addpartition > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore > ** blobstore -> hdfs > * import/export > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore (partitioned and non-partitioned) > ** blobstore -> HDFS (partitioned and non-partitioned) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936777#comment-15936777 ] Juan Rodríguez Hortalá commented on HIVE-15867: --- yes, no problem > Add blobstore tests for import/export > - > > Key: HIVE-15867 > URL: https://issues.apache.org/jira/browse/HIVE-15867 > Project: Hive > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Thomas Poepping >Assignee: Juan Rodríguez Hortalá > Labels: patch, test > Attachments: HIVE-15867-v3.patch > > > This patch covers ten separate tests testing import and export operations > running against blobstore filesystems: > * Import addpartition > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore > ** blobstore -> hdfs > * import/export > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore (partitioned and non-partitioned) > ** blobstore -> HDFS (partitioned and non-partitioned) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936755#comment-15936755 ] Sergio Peña commented on HIVE-15867: Ah, sorry. I was waiting for HieQA to notify me about the results. I think there were some errors on Jenkins last week. It should be fixed now, could you re-submit the patch again? > Add blobstore tests for import/export > - > > Key: HIVE-15867 > URL: https://issues.apache.org/jira/browse/HIVE-15867 > Project: Hive > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Thomas Poepping >Assignee: Juan Rodríguez Hortalá > Labels: patch, test > Attachments: HIVE-15867-v3.patch > > > This patch covers ten separate tests testing import and export operations > running against blobstore filesystems: > * Import addpartition > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore > ** blobstore -> hdfs > * import/export > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore (partitioned and non-partitioned) > ** blobstore -> HDFS (partitioned and non-partitioned) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936697#comment-15936697 ] Juan Rodríguez Hortalá commented on HIVE-15867: --- Hi [~spena], do you need any other change before pushing the code? Thanks! > Add blobstore tests for import/export > - > > Key: HIVE-15867 > URL: https://issues.apache.org/jira/browse/HIVE-15867 > Project: Hive > Issue Type: Bug >Affects Versions: 2.1.1 >Reporter: Thomas Poepping >Assignee: Juan Rodríguez Hortalá > Labels: patch, test > Attachments: HIVE-15867-v3.patch > > > This patch covers ten separate tests testing import and export operations > running against blobstore filesystems: > * Import addpartition > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore > ** blobstore -> hdfs > * import/export > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore (partitioned and non-partitioned) > ** blobstore -> HDFS (partitioned and non-partitioned) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928248#comment-15928248 ] Sergio Peña commented on HIVE-15867: [~juanrh] Seems the tests weren't executed. Could you re-submit the patch to trigger HiveQA? > Add blobstore tests for import/export > - > > Key: HIVE-15867 > URL: https://issues.apache.org/jira/browse/HIVE-15867 > Project: Hive > Issue Type: Bug >Reporter: Thomas Poepping >Assignee: Juan Rodríguez Hortalá > Attachments: HIVE-15867-v3.patch > > > This patch covers ten separate tests testing import and export operations > running against blobstore filesystems: > * Import addpartition > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore > ** blobstore -> hdfs > * import/export > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore (partitioned and non-partitioned) > ** blobstore -> HDFS (partitioned and non-partitioned) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924324#comment-15924324 ] Sergio Peña commented on HIVE-15867: The tests look very good. +1 I just left a minor comment on the RB. Once that's addressed, I will commit the patch. > Add blobstore tests for import/export > - > > Key: HIVE-15867 > URL: https://issues.apache.org/jira/browse/HIVE-15867 > Project: Hive > Issue Type: Bug >Reporter: Thomas Poepping >Assignee: Juan Rodríguez Hortalá > Attachments: HIVE-15867.patch > > > This patch covers ten separate tests testing import and export operations > running against blobstore filesystems: > * Import addpartition > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore > ** blobstore -> hdfs > * import/export > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore (partitioned and non-partitioned) > ** blobstore -> HDFS (partitioned and non-partitioned) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15906445#comment-15906445 ] Sahil Takiar commented on HIVE-15867: - +1 (non-binding, still need a committer to take a look) > Add blobstore tests for import/export > - > > Key: HIVE-15867 > URL: https://issues.apache.org/jira/browse/HIVE-15867 > Project: Hive > Issue Type: Bug >Reporter: Thomas Poepping >Assignee: Juan Rodríguez Hortalá > Attachments: HIVE-15867.patch > > > This patch covers ten separate tests testing import and export operations > running against blobstore filesystems: > * Import addpartition > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore > ** blobstore -> hdfs > * import/export > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore (partitioned and non-partitioned) > ** blobstore -> HDFS (partitioned and non-partitioned) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903536#comment-15903536 ] Juan Rodríguez Hortalá commented on HIVE-15867: --- I have opened https://reviews.apache.org/r/57471/ for the review of the patch > Add blobstore tests for import/export > - > > Key: HIVE-15867 > URL: https://issues.apache.org/jira/browse/HIVE-15867 > Project: Hive > Issue Type: Bug >Reporter: Thomas Poepping >Assignee: Juan Rodríguez Hortalá > Attachments: HIVE-15867.patch > > > This patch covers ten separate tests testing import and export operations > running against blobstore filesystems: > * Import addpartition > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore > ** blobstore -> hdfs > * import/export > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore (partitioned and non-partitioned) > ** blobstore -> HDFS (partitioned and non-partitioned) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876820#comment-15876820 ] Sahil Takiar commented on HIVE-15867: - No worries, just checking in, thanks for the update! > Add blobstore tests for import/export > - > > Key: HIVE-15867 > URL: https://issues.apache.org/jira/browse/HIVE-15867 > Project: Hive > Issue Type: Bug >Reporter: Thomas Poepping >Assignee: Thomas Poepping > > This patch covers ten separate tests testing import and export operations > running against blobstore filesystems: > * Import addpartition > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore > ** blobstore -> hdfs > * import/export > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore (partitioned and non-partitioned) > ** blobstore -> HDFS (partitioned and non-partitioned) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876786#comment-15876786 ] Thomas Poepping commented on HIVE-15867: Hi [~stakiar], yes, still on the radar. My colleague is working on a patch now, once it passes our internal review he'll attach it here. Sorry for the wait > Add blobstore tests for import/export > - > > Key: HIVE-15867 > URL: https://issues.apache.org/jira/browse/HIVE-15867 > Project: Hive > Issue Type: Bug >Reporter: Thomas Poepping >Assignee: Thomas Poepping > > This patch covers ten separate tests testing import and export operations > running against blobstore filesystems: > * Import addpartition > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore > ** blobstore -> hdfs > * import/export > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore (partitioned and non-partitioned) > ** blobstore -> HDFS (partitioned and non-partitioned) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876650#comment-15876650 ] Sahil Takiar commented on HIVE-15867: - [~poeppt] is this still on your radar? If not I'm happy to help out. > Add blobstore tests for import/export > - > > Key: HIVE-15867 > URL: https://issues.apache.org/jira/browse/HIVE-15867 > Project: Hive > Issue Type: Bug >Reporter: Thomas Poepping >Assignee: Thomas Poepping > > This patch covers ten separate tests testing import and export operations > running against blobstore filesystems: > * Import addpartition > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore > ** blobstore -> hdfs > * import/export > ** blobstore -> file > ** file -> blobstore > ** blobstore -> blobstore (partitioned and non-partitioned) > ** blobstore -> HDFS (partitioned and non-partitioned) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
