[jira] [Commented] (HIVE-14262) Inherit writetype from partition WriteEntity for table WriteEntity

2016-07-18 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383270#comment-15383270
 ] 

Hive QA commented on HIVE-14262:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12818612/HIVE-14262.2.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 8 failed/errored test(s), 10336 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_acid_globallimit
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_list_bucket_dml_13
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_list_bucket
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_subquery_multiinsert
org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_acid_globallimit
org.apache.hadoop.hive.llap.daemon.impl.TestLlapTokenChecker.testCheckPermissions
org.apache.hadoop.hive.llap.daemon.impl.TestLlapTokenChecker.testGetToken
org.apache.hadoop.hive.metastore.TestMetaStoreMetrics.testConnections
{noformat}

Test results: 
https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/568/testReport
Console output: 
https://builds.apache.org/job/PreCommit-HIVE-MASTER-Build/568/console
Test logs: 
http://ec2-204-236-174-241.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-MASTER-Build-568/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 8 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12818612 - PreCommit-HIVE-MASTER-Build

> Inherit writetype from partition WriteEntity for table WriteEntity
> --
>
> Key: HIVE-14262
> URL: https://issues.apache.org/jira/browse/HIVE-14262
> Project: Hive
>  Issue Type: Bug
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Attachments: HIVE-14262.1.patch, HIVE-14262.2.patch
>
>
> For partitioned table operations, a Table WriteEntity is being added to the 
> list to be authorized if there is a partition in the output list from 
> semantic analyzer. 
> However, it is being added with a default WriteType of DDL_NO_TASK.
> The new Table WriteEntity should be created with the WriteType of the 
> partition WriteEntity.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14262) Inherit writetype from partition WriteEntity for table WriteEntity

2016-07-18 Thread Sushanth Sowmyan (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382991#comment-15382991
 ] 

Sushanth Sowmyan commented on HIVE-14262:
-

(We should still let the test runs finish with .2.patch though, I think, for 
verification)

> Inherit writetype from partition WriteEntity for table WriteEntity
> --
>
> Key: HIVE-14262
> URL: https://issues.apache.org/jira/browse/HIVE-14262
> Project: Hive
>  Issue Type: Bug
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Attachments: HIVE-14262.1.patch, HIVE-14262.2.patch
>
>
> For partitioned table operations, a Table WriteEntity is being added to the 
> list to be authorized if there is a partition in the output list from 
> semantic analyzer. 
> However, it is being added with a default WriteType of DDL_NO_TASK.
> The new Table WriteEntity should be created with the WriteType of the 
> partition WriteEntity.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14262) Inherit writetype from partition WriteEntity for table WriteEntity

2016-07-18 Thread Sushanth Sowmyan (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382989#comment-15382989
 ] 

Sushanth Sowmyan commented on HIVE-14262:
-

Ah, makes sense. +1. I remember now that I had a similar issue with that bit a 
while back.

> Inherit writetype from partition WriteEntity for table WriteEntity
> --
>
> Key: HIVE-14262
> URL: https://issues.apache.org/jira/browse/HIVE-14262
> Project: Hive
>  Issue Type: Bug
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Attachments: HIVE-14262.1.patch, HIVE-14262.2.patch
>
>
> For partitioned table operations, a Table WriteEntity is being added to the 
> list to be authorized if there is a partition in the output list from 
> semantic analyzer. 
> However, it is being added with a default WriteType of DDL_NO_TASK.
> The new Table WriteEntity should be created with the WriteType of the 
> partition WriteEntity.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14262) Inherit writetype from partition WriteEntity for table WriteEntity

2016-07-18 Thread Thejas M Nair (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382952#comment-15382952
 ] 

Thejas M Nair commented on HIVE-14262:
--

The 2.patch won't need the .q.out files to be updated. In 1.patch, I changed 
the WriteEntity.equals method thinking that it is necessary to prevent any 
writeentity getting added as part of the loop over partitions from overwriting 
ones already added by SemanticAnalyzer, just in case it has the more accurate 
writeType.
But on taking a closer look at the Sets.union method, that wasn't necessary, 
and I added comment around that in 2.patch.


> Inherit writetype from partition WriteEntity for table WriteEntity
> --
>
> Key: HIVE-14262
> URL: https://issues.apache.org/jira/browse/HIVE-14262
> Project: Hive
>  Issue Type: Bug
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Attachments: HIVE-14262.1.patch, HIVE-14262.2.patch
>
>
> For partitioned table operations, a Table WriteEntity is being added to the 
> list to be authorized if there is a partition in the output list from 
> semantic analyzer. 
> However, it is being added with a default WriteType of DDL_NO_TASK.
> The new Table WriteEntity should be created with the WriteType of the 
> partition WriteEntity.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14262) Inherit writetype from partition WriteEntity for table WriteEntity

2016-07-18 Thread Sushanth Sowmyan (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382905#comment-15382905
 ] 

Sushanth Sowmyan commented on HIVE-14262:
-

+1 for the code change, but it looks like this impacts a lot of .q.out files 
that also need to be updated.

> Inherit writetype from partition WriteEntity for table WriteEntity
> --
>
> Key: HIVE-14262
> URL: https://issues.apache.org/jira/browse/HIVE-14262
> Project: Hive
>  Issue Type: Bug
>Reporter: Thejas M Nair
>Assignee: Thejas M Nair
> Attachments: HIVE-14262.1.patch, HIVE-14262.2.patch
>
>
> For partitioned table operations, a Table WriteEntity is being added to the 
> list to be authorized if there is a partition in the output list from 
> semantic analyzer. 
> However, it is being added with a default WriteType of DDL_NO_TASK.
> The new Table WriteEntity should be created with the WriteType of the 
> partition WriteEntity.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-14262) Inherit writetype from partition WriteEntity for table WriteEntity

2016-07-17 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-14262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15381612#comment-15381612
 ] 

Hive QA commented on HIVE-14262:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12818477/HIVE-14262.1.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 871 failed/errored test(s), 10334 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_acid_globallimit
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_acid_table_stats
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_add_part_exist
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter3
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter5
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_char1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_char2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_file_format
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_merge
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_merge_2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_merge_2_orc
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_merge_3
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_merge_orc
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_merge_stats
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_merge_stats_orc
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_numbuckets_partitioned_table2_h23
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_numbuckets_partitioned_table_h23
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_partition_change_col
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_partition_clusterby_sortby
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_partition_coltype
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_partition_format_loc
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_rename_partition
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_rename_partition_authorization
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_skewed_table
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_table_cascade
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_table_invalidate_column_stats
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_table_location
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_table_not_sorted
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_table_partition_drop
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_table_serde
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_table_serde2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_varchar1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_varchar2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_view_as_select
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_view_rename
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_analyze_table_null_partition
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_filter
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_groupby
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_groupby2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_join_pkfk
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_limit
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_select
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_table
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_union
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_archive_excludeHadoop20
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_1_sql_std
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_6
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_7
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_admin_almighty1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_admin_almighty2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_cli_nonsql
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_authorization_create_temp_table