[
https://issues.apache.org/jira/browse/HIVE-21164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16982037#comment-16982037
]
Hive QA commented on HIVE-21164:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12986687/HIVE-21164.12.patch
{color:green}SUCCESS:{color} +1 due to 8 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 35 failed/errored test(s), 17741 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.TestAcidOnTez.testAcidInsertWithRemoveUnion
(batchId=247)
org.apache.hadoop.hive.ql.TestAcidOnTez.testBucketedAcidInsertWithRemoveUnion
(batchId=247)
org.apache.hadoop.hive.ql.TestTxnAddPartition.addPartitionTransactional
(batchId=351)
org.apache.hadoop.hive.ql.TestTxnCommands.testNonAcidToAcidConversion01
(batchId=355)
org.apache.hadoop.hive.ql.TestTxnCommands2.testNonAcidToAcidConversion1
(batchId=336)
org.apache.hadoop.hive.ql.TestTxnCommands2.testNonAcidToAcidConversion3
(batchId=336)
org.apache.hadoop.hive.ql.TestTxnCommands2WithSplitUpdateAndVectorization.testNonAcidToAcidConversion1
(batchId=350)
org.apache.hadoop.hive.ql.TestTxnCommands2WithSplitUpdateAndVectorization.testNonAcidToAcidConversion3
(batchId=350)
org.apache.hadoop.hive.ql.TestTxnCommands3.testCleaner2 (batchId=351)
org.apache.hadoop.hive.ql.TestTxnCommands3.testRenameTable (batchId=351)
org.apache.hadoop.hive.ql.TestTxnCommands3.testSdpoBucketed (batchId=351)
org.apache.hadoop.hive.ql.TestTxnConcatenate.testConcatenate (batchId=321)
org.apache.hadoop.hive.ql.TestTxnConcatenate.testConcatenatePart (batchId=321)
org.apache.hadoop.hive.ql.TestTxnExIm.testImportPartitioned (batchId=336)
org.apache.hadoop.hive.ql.TestTxnLoadData.loadData (batchId=311)
org.apache.hadoop.hive.ql.TestTxnLoadData.loadDataUpdate (batchId=311)
org.apache.hadoop.hive.ql.TestTxnLoadData.testAbort (batchId=311)
org.apache.hadoop.hive.ql.TestTxnLoadData.testLoadAcidFile (batchId=311)
org.apache.hadoop.hive.ql.TestTxnLoadData.testMultiStatement (batchId=311)
org.apache.hadoop.hive.ql.TestTxnNoBuckets.testCompactStatsGather (batchId=336)
org.apache.hadoop.hive.ql.TestTxnNoBuckets.testDefault (batchId=336)
org.apache.hadoop.hive.ql.TestTxnNoBuckets.testInsertToAcidWithUnionRemove
(batchId=336)
org.apache.hadoop.hive.ql.TestTxnNoBuckets.testNoBuckets (batchId=336)
org.apache.hadoop.hive.ql.TestTxnNoBuckets.testToAcidConversion02 (batchId=336)
org.apache.hadoop.hive.ql.TestTxnNoBucketsVectorized.testCompactStatsGather
(batchId=336)
org.apache.hadoop.hive.ql.TestTxnNoBucketsVectorized.testDefault (batchId=336)
org.apache.hadoop.hive.ql.TestTxnNoBucketsVectorized.testInsertToAcidWithUnionRemove
(batchId=336)
org.apache.hadoop.hive.ql.TestTxnNoBucketsVectorized.testNoBuckets (batchId=336)
org.apache.hadoop.hive.ql.TestTxnNoBucketsVectorized.testToAcidConversion02
(batchId=336)
org.apache.hadoop.hive.ql.io.TestAcidUtils.testParsing (batchId=323)
org.apache.hadoop.hive.ql.parse.TestReplicationScenariosIncrementalLoadAcidTables.testAcidTableIncrementalReplication
(batchId=273)
org.apache.hive.hcatalog.streaming.TestStreaming.testNoBuckets (batchId=220)
org.apache.hive.streaming.TestStreaming.testAutoRollTransactionBatch
(batchId=362)
org.apache.hive.streaming.TestStreaming.testConnectionWithWriteId (batchId=362)
org.apache.hive.streaming.TestStreaming.testNoBuckets (batchId=362)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/19604/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/19604/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-19604/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 35 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12986687 - PreCommit-HIVE-Build
> ACID: explore how we can avoid a move step during inserts/compaction
> --------------------------------------------------------------------
>
> Key: HIVE-21164
> URL: https://issues.apache.org/jira/browse/HIVE-21164
> Project: Hive
> Issue Type: Bug
> Components: Transactions
> Affects Versions: 3.1.1
> Reporter: Vaibhav Gumashta
> Assignee: Marta Kuczora
> Priority: Major
> Attachments: HIVE-21164.1.patch, HIVE-21164.10.patch,
> HIVE-21164.11.patch, HIVE-21164.11.patch, HIVE-21164.12.patch,
> HIVE-21164.2.patch, HIVE-21164.3.patch, HIVE-21164.4.patch,
> HIVE-21164.5.patch, HIVE-21164.6.patch, HIVE-21164.7.patch,
> HIVE-21164.8.patch, HIVE-21164.9.patch
>
>
> Currently, we write compacted data to a temporary location and then move the
> files to a final location, which is an expensive operation on some cloud file
> systems. Since HIVE-20823 is already in, it can control the visibility of
> compacted data for the readers. Therefore, we can perhaps avoid writing data
> to a temporary location and directly write compacted data to the intended
> final path.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
