[jira] Updated: (HIVE-1843) add an option in dynamic partition inserts to throw an error if 0 partitions are created
[ https://issues.apache.org/jira/browse/HIVE-1843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1843: - Attachment: HIVE-1843.patch add an option in dynamic partition inserts to throw an error if 0 partitions are created Key: HIVE-1843 URL: https://issues.apache.org/jira/browse/HIVE-1843 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: Namit Jain Assignee: Ning Zhang Attachments: HIVE-1843.patch Currently, we print a error message in that scenario. However, it would be very useful if an option was added where we would error out. This would help a lot in debugging -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1843) add an option in dynamic partition inserts to throw an error if 0 partitions are created
[ https://issues.apache.org/jira/browse/HIVE-1843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1843: - Status: Patch Available (was: Open) add an option in dynamic partition inserts to throw an error if 0 partitions are created Key: HIVE-1843 URL: https://issues.apache.org/jira/browse/HIVE-1843 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: Namit Jain Assignee: Ning Zhang Attachments: HIVE-1843.patch Currently, we print a error message in that scenario. However, it would be very useful if an option was added where we would error out. This would help a lot in debugging -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1844) Hanging hive client caused by TaskRunner's OutOfMemoryError
[ https://issues.apache.org/jira/browse/HIVE-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1844: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Committed. Thanks Yongqiang Hanging hive client caused by TaskRunner's OutOfMemoryError --- Key: HIVE-1844 URL: https://issues.apache.org/jira/browse/HIVE-1844 Project: Hive Issue Type: Bug Reporter: He Yongqiang Assignee: He Yongqiang Attachments: hive-1844.1.patch -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1838) Add quickLZ compression codec for Hive.
[ https://issues.apache.org/jira/browse/HIVE-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969855#action_12969855 ] He Yongqiang commented on HIVE-1838: Just found that there is already a jira on Hadoop side: https://issues.apache.org/jira/browse/HADOOP-6349 Add quickLZ compression codec for Hive. --- Key: HIVE-1838 URL: https://issues.apache.org/jira/browse/HIVE-1838 Project: Hive Issue Type: New Feature Reporter: He Yongqiang -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1526) Hive should depend on a release version of Thrift
[ https://issues.apache.org/jira/browse/HIVE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1526: - Resolution: Fixed Hadoop Flags: [Incompatible change, Reviewed] Status: Resolved (was: Patch Available) Committed. Thanks Carl, Todd and Ashutosh! Hive should depend on a release version of Thrift - Key: HIVE-1526 URL: https://issues.apache.org/jira/browse/HIVE-1526 Project: Hive Issue Type: Task Components: Build Infrastructure, Clients Reporter: Carl Steinbach Assignee: Carl Steinbach Fix For: 0.7.0 Attachments: compile.err, HIVE-1526-complete.4.patch.txt, HIVE-1526-complete.5.patch.txt, HIVE-1526-complete.6.patch.txt, HIVE-1526-complete.7.patch.txt, HIVE-1526-complete.8.patch.txt, HIVE-1526-no-codegen.3.patch.txt, HIVE-1526-no-codegen.4.patch.txt, HIVE-1526-no-codegen.5.patch.txt, HIVE-1526-no-codegen.6.patch.txt, HIVE-1526-no-codegen.7.patch.txt, HIVE-1526-no-codegen.8.patch.txt, HIVE-1526.2.patch.txt, HIVE-1526.3.patch.txt, hive-1526.txt, libfb303.jar, libthrift.jar, serde2_test.patch, svn_rm.sh, test.log, thrift-0.5.0.jar, thrift-fb303-0.5.0.jar Hive should depend on a release version of Thrift, and ideally it should use Ivy to resolve this dependency. The Thrift folks are working on adding Thrift artifacts to a maven repository here: https://issues.apache.org/jira/browse/THRIFT-363 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1843) add an option in dynamic partition inserts to throw an error if 0 partitions are created
[ https://issues.apache.org/jira/browse/HIVE-1843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969861#action_12969861 ] Namit Jain commented on HIVE-1843: -- +1 add an option in dynamic partition inserts to throw an error if 0 partitions are created Key: HIVE-1843 URL: https://issues.apache.org/jira/browse/HIVE-1843 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: Namit Jain Assignee: Ning Zhang Attachments: HIVE-1843.patch Currently, we print a error message in that scenario. However, it would be very useful if an option was added where we would error out. This would help a lot in debugging -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-842) Authentication Infrastructure for Hive
[ https://issues.apache.org/jira/browse/HIVE-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969862#action_12969862 ] Ashutosh Chauhan commented on HIVE-842: --- HIVE-1526 went in. This is ready to go in as well. Patch (hive-842_2.patch) applies cleanly. Please review. Authentication Infrastructure for Hive -- Key: HIVE-842 URL: https://issues.apache.org/jira/browse/HIVE-842 Project: Hive Issue Type: New Feature Components: Security, Server Infrastructure Reporter: Edward Capriolo Assignee: Todd Lipcon Attachments: hive-842.txt, hive-842_2.patch, HiveSecurityThoughts.pdf This issue deals with the authentication (user name,password) infrastructure. Not the authorization components that specify what a user should be able to do. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-842) Authentication Infrastructure for Hive
[ https://issues.apache.org/jira/browse/HIVE-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969866#action_12969866 ] John Sichi commented on HIVE-842: - Click Submit Patch to get it into the review queue. Authentication Infrastructure for Hive -- Key: HIVE-842 URL: https://issues.apache.org/jira/browse/HIVE-842 Project: Hive Issue Type: New Feature Components: Security, Server Infrastructure Reporter: Edward Capriolo Assignee: Todd Lipcon Attachments: hive-842.txt, hive-842_2.patch, HiveSecurityThoughts.pdf This issue deals with the authentication (user name,password) infrastructure. Not the authorization components that specify what a user should be able to do. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1526) Hive should depend on a release version of Thrift
[ https://issues.apache.org/jira/browse/HIVE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969868#action_12969868 ] Ashutosh Chauhan commented on HIVE-1526: Great ! Carl, you noted above: bq. Need to update this page once this change is committed: http://wiki.apache.org/hadoop/Hive/HowToContribute#Generating_Code Now that its in, the wiki page can now be updated as well. Otherwise, similar number of iterations will take place when we upgrade to next version of thrift :) Hive should depend on a release version of Thrift - Key: HIVE-1526 URL: https://issues.apache.org/jira/browse/HIVE-1526 Project: Hive Issue Type: Task Components: Build Infrastructure, Clients Reporter: Carl Steinbach Assignee: Carl Steinbach Fix For: 0.7.0 Attachments: compile.err, HIVE-1526-complete.4.patch.txt, HIVE-1526-complete.5.patch.txt, HIVE-1526-complete.6.patch.txt, HIVE-1526-complete.7.patch.txt, HIVE-1526-complete.8.patch.txt, HIVE-1526-no-codegen.3.patch.txt, HIVE-1526-no-codegen.4.patch.txt, HIVE-1526-no-codegen.5.patch.txt, HIVE-1526-no-codegen.6.patch.txt, HIVE-1526-no-codegen.7.patch.txt, HIVE-1526-no-codegen.8.patch.txt, HIVE-1526.2.patch.txt, HIVE-1526.3.patch.txt, hive-1526.txt, libfb303.jar, libthrift.jar, serde2_test.patch, svn_rm.sh, test.log, thrift-0.5.0.jar, thrift-fb303-0.5.0.jar Hive should depend on a release version of Thrift, and ideally it should use Ivy to resolve this dependency. The Thrift folks are working on adding Thrift artifacts to a maven repository here: https://issues.apache.org/jira/browse/THRIFT-363 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1648) Automatically gathering stats when reading a table/partition
[ https://issues.apache.org/jira/browse/HIVE-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Butler updated HIVE-1648: -- Attachment: HIVE-1648.5.patch Automatically gathering stats when reading a table/partition Key: HIVE-1648 URL: https://issues.apache.org/jira/browse/HIVE-1648 Project: Hive Issue Type: Sub-task Reporter: Ning Zhang Assignee: Paul Butler Attachments: HIVE-1648.2.patch, HIVE-1648.3.patch, HIVE-1648.4.patch, HIVE-1648.5.patch, HIVE-1648.patch, hive-1648.svn.patch HIVE-1361 introduces a new command 'ANALYZE TABLE T COMPUTE STATISTICS' to gathering stats. This requires additional scan of the data. Stats gathering can be piggy-backed on TableScanOperator whenever a table/partition is scanned (given not LIMIT operator). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1845) Some attributes in the Eclipse template file is deprecated
[ https://issues.apache.org/jira/browse/HIVE-1845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1845: - Attachment: hive-1845-1.patch Update all the eclipse template files. Some attributes in the Eclipse template file is deprecated Key: HIVE-1845 URL: https://issues.apache.org/jira/browse/HIVE-1845 Project: Hive Issue Type: Bug Reporter: Liyin Tang Assignee: Liyin Tang Attachments: hive-1845-1.patch In the eclipse template file, it will reference this jar file, which is deprecated. /@PROJECT@/build/metastore/hive-mod...@hive_version@.jar So the correct one should be: /@PROJECT@/build/metastore/hive-metasto...@hive_version@.jar Just update all the eclipse template files. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1648) Automatically gathering stats when reading a table/partition
[ https://issues.apache.org/jira/browse/HIVE-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969878#action_12969878 ] Paul Butler commented on HIVE-1648: --- Added an SVN patch (5) that applies to latest. Automatically gathering stats when reading a table/partition Key: HIVE-1648 URL: https://issues.apache.org/jira/browse/HIVE-1648 Project: Hive Issue Type: Sub-task Reporter: Ning Zhang Assignee: Paul Butler Attachments: HIVE-1648.2.patch, HIVE-1648.3.patch, HIVE-1648.4.patch, HIVE-1648.5.patch, HIVE-1648.patch, hive-1648.svn.patch HIVE-1361 introduces a new command 'ANALYZE TABLE T COMPUTE STATISTICS' to gathering stats. This requires additional scan of the data. Stats gathering can be piggy-backed on TableScanOperator whenever a table/partition is scanned (given not LIMIT operator). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1845) Some attributes in the Eclipse template file is deprecated
[ https://issues.apache.org/jira/browse/HIVE-1845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liyin Tang updated HIVE-1845: - Status: Patch Available (was: Open) Some attributes in the Eclipse template file is deprecated Key: HIVE-1845 URL: https://issues.apache.org/jira/browse/HIVE-1845 Project: Hive Issue Type: Bug Reporter: Liyin Tang Assignee: Liyin Tang Attachments: hive-1845-1.patch In the eclipse template file, it will reference this jar file, which is deprecated. /@PROJECT@/build/metastore/hive-mod...@hive_version@.jar So the correct one should be: /@PROJECT@/build/metastore/hive-metasto...@hive_version@.jar Just update all the eclipse template files. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-842) Authentication Infrastructure for Hive
[ https://issues.apache.org/jira/browse/HIVE-842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-842: -- Fix Version/s: 0.7.0 Status: Patch Available (was: Open) Lets get it in review queue. Authentication Infrastructure for Hive -- Key: HIVE-842 URL: https://issues.apache.org/jira/browse/HIVE-842 Project: Hive Issue Type: New Feature Components: Security, Server Infrastructure Reporter: Edward Capriolo Assignee: Todd Lipcon Fix For: 0.7.0 Attachments: hive-842.txt, hive-842_2.patch, HiveSecurityThoughts.pdf This issue deals with the authentication (user name,password) infrastructure. Not the authorization components that specify what a user should be able to do. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-842) Authentication Infrastructure for Hive
[ https://issues.apache.org/jira/browse/HIVE-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969881#action_12969881 ] He Yongqiang commented on HIVE-842: --- will take a look. Authentication Infrastructure for Hive -- Key: HIVE-842 URL: https://issues.apache.org/jira/browse/HIVE-842 Project: Hive Issue Type: New Feature Components: Security, Server Infrastructure Reporter: Edward Capriolo Assignee: Todd Lipcon Fix For: 0.7.0 Attachments: hive-842.txt, hive-842_2.patch, HiveSecurityThoughts.pdf This issue deals with the authentication (user name,password) infrastructure. Not the authorization components that specify what a user should be able to do. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1829) TestRemoteMetaStore fails if machine has multiple IPs
[
https://issues.apache.org/jira/browse/HIVE-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969891#action_12969891
]
Ashutosh Chauhan commented on HIVE-1829:
I see similar errors randomly. But, whenever I see doing following always get
me past it:
TestRemoteHiveMetaStore.java line number 51:
-Thread.sleep(5000);
+Thread.sleep(2);
So, not sure if it has to do anything with machine having multiple IPs. I also
see Running metastore! occurring 2-7 times when there is a random failure.
TestRemoteMetaStore fails if machine has multiple IPs
-
Key: HIVE-1829
URL: https://issues.apache.org/jira/browse/HIVE-1829
Project: Hive
Issue Type: Bug
Components: Metastore
Affects Versions: 0.6.0
Reporter: Edward Capriolo
Notice how Running metastore! appears twice.
{noformat}
test:
[junit] Running org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore
[junit] BR.recoverFromMismatchedToken
[junit] Tests run: 11, Failures: 0, Errors: 0, Time elapsed: 36.697 sec
[junit] Running org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore
[junit] Running metastore!
[junit] Running metastore!
[junit] org.apache.thrift.transport.TTransportException: Could not create
ServerSocket on address 0.0.0.0/0.0.0.0:29083.
[junit] at
org.apache.thrift.transport.TServerSocket.init(TServerSocket.java:98)
[junit] at
org.apache.thrift.transport.TServerSocket.init(TServerSocket.java:79)
[junit] at
org.apache.hadoop.hive.metastore.TServerSocketKeepAlive.init(TServerSocketKeepAlive.java:34)
[junit] at
org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:2189)
[junit] at
org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore$RunMS.run(TestRemoteHiveMetaStore.java:35)
[junit] at java.lang.Thread.run(Thread.java:619)
[junit] Running org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore
[junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
[junit] Test org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore
FAILED (crashed)
{noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1526) Hive should depend on a release version of Thrift
[ https://issues.apache.org/jira/browse/HIVE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969906#action_12969906 ] Carl Steinbach commented on HIVE-1526: -- @Ashutosh: Thanks for reminding me. I'll see that this gets updated. Hive should depend on a release version of Thrift - Key: HIVE-1526 URL: https://issues.apache.org/jira/browse/HIVE-1526 Project: Hive Issue Type: Task Components: Build Infrastructure, Clients Reporter: Carl Steinbach Assignee: Carl Steinbach Fix For: 0.7.0 Attachments: compile.err, HIVE-1526-complete.4.patch.txt, HIVE-1526-complete.5.patch.txt, HIVE-1526-complete.6.patch.txt, HIVE-1526-complete.7.patch.txt, HIVE-1526-complete.8.patch.txt, HIVE-1526-no-codegen.3.patch.txt, HIVE-1526-no-codegen.4.patch.txt, HIVE-1526-no-codegen.5.patch.txt, HIVE-1526-no-codegen.6.patch.txt, HIVE-1526-no-codegen.7.patch.txt, HIVE-1526-no-codegen.8.patch.txt, HIVE-1526.2.patch.txt, HIVE-1526.3.patch.txt, hive-1526.txt, libfb303.jar, libthrift.jar, serde2_test.patch, svn_rm.sh, test.log, thrift-0.5.0.jar, thrift-fb303-0.5.0.jar Hive should depend on a release version of Thrift, and ideally it should use Ivy to resolve this dependency. The Thrift folks are working on adding Thrift artifacts to a maven repository here: https://issues.apache.org/jira/browse/THRIFT-363 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-78) Authorization infrastructure for Hive
[ https://issues.apache.org/jira/browse/HIVE-78?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-78: - Attachment: HIVE-78.6.no_thrift.patch HIVE-78.6.complete.patch refresh patch against the trunk. Authorization infrastructure for Hive - Key: HIVE-78 URL: https://issues.apache.org/jira/browse/HIVE-78 Project: Hive Issue Type: New Feature Components: Metastore, Query Processor, Server Infrastructure Reporter: Ashish Thusoo Assignee: He Yongqiang Attachments: createuser-v1.patch, hive-78-metadata-v1.patch, hive-78-syntax-v1.patch, HIVE-78.1.nothrift.patch, HIVE-78.1.thrift.patch, HIVE-78.2.nothrift.patch, HIVE-78.2.thrift.patch, HIVE-78.4.complete.patch, HIVE-78.4.no_thrift.patch, HIVE-78.5.complete.patch, HIVE-78.5.no_thrift.patch, HIVE-78.6.complete.patch, HIVE-78.6.no_thrift.patch, hive-78.diff Allow hive to integrate with existing user repositories for authentication and authorization infromation. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (HIVE-1846) change hive assumption that local mode mappers/reducers always run in same jvm
change hive assumption that local mode mappers/reducers always run in same jvm --- Key: HIVE-1846 URL: https://issues.apache.org/jira/browse/HIVE-1846 Project: Hive Issue Type: Bug Reporter: Joydeep Sen Sarma Assignee: Joydeep Sen Sarma we are trying out a version of hadoop local mode that runs multiple mappers/reducers by spawning jvm's for them. In this mode hive mappers fail in reading the plan file. it seems that we assume (in the setMapredWork call) that local mode mappers/reducers will run in the same jvm (we can cache the current plan in a global var and don't serialize to a path). this needs to get fixed. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-788) Triggers when a new partition is created for a table
[ https://issues.apache.org/jira/browse/HIVE-788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969992#action_12969992 ] Ashutosh Chauhan commented on HIVE-788: --- What is the status of this issue? Is anyone actively working on it? Triggers when a new partition is created for a table Key: HIVE-788 URL: https://issues.apache.org/jira/browse/HIVE-788 Project: Hive Issue Type: New Feature Reporter: Zheng Shao One requirement for HIVE-787 is that users would like to run a command whenever a new partition of a Hive table gets created. There are several ways to achieve this functionality: A. Probe and wait: We can have the scripts running in a loop checking if a new partition is created. Pros: easy to write, easy to control Cons: will introduce another delay based on the probing interval. B. Triggered: The command is registered inside the hive metastore. Whenever a partition gets created, we run the registered command. Several questions around option B are: 1. whether to support registration of HiveQL or shell command; 2. which machine/environment to run the command; 3. what to do if the registered command failed. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1731) Improve miscellaneous error messages
[ https://issues.apache.org/jira/browse/HIVE-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi updated HIVE-1731: - Comment: was deleted (was: hive select actiontype, sourcetype, destinationtype, get_json_object(payloaddata, '$.product'), regexp_extract(fullurl, '^.*?php') from nectar_contentaction_merged_partitioned where ds = '2010-11-30' and payloadtype = 'comment' and get_json_object(payloaddata, '$.product') = 'groups' limit 50; Total MapReduce jobs = 1 Launching Job 1 out of 1 ... Ended Job = job_20101201_220674 with errors FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask The actual error was something to do with my regexp_extract syntax: index out of bounds error, no group 1 I didn't specify a group in the regexp, and when I made the adjustment everything worked as expected. It seems like this should be caught earlier, or at least the error trace for the task with the most failures (or a random task with max_failures if there's more than one) should be dumped to the CLI. This one might belong in a different task, since it's a much harder problem to deal with the error traces for badly specified functions (or, worse, custom scripts). However, in general return code 2 is not useful. It only tells me I need to do a bunch of work to find out what's broken, and the only reason I know that is because I've been using Hive for a long time.) Improve miscellaneous error messages Key: HIVE-1731 URL: https://issues.apache.org/jira/browse/HIVE-1731 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: John Sichi Fix For: 0.7.0 This is a place for accumulating error message improvements so that we can update a bunch in batch. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-78) Authorization infrastructure for Hive
[ https://issues.apache.org/jira/browse/HIVE-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970002#action_12970002 ] John Sichi commented on HIVE-78: HIVE-78.6.no_thrift.patch has the thrift-generated code. Authorization infrastructure for Hive - Key: HIVE-78 URL: https://issues.apache.org/jira/browse/HIVE-78 Project: Hive Issue Type: New Feature Components: Metastore, Query Processor, Server Infrastructure Reporter: Ashish Thusoo Assignee: He Yongqiang Attachments: createuser-v1.patch, hive-78-metadata-v1.patch, hive-78-syntax-v1.patch, HIVE-78.1.nothrift.patch, HIVE-78.1.thrift.patch, HIVE-78.2.nothrift.patch, HIVE-78.2.thrift.patch, HIVE-78.4.complete.patch, HIVE-78.4.no_thrift.patch, HIVE-78.5.complete.patch, HIVE-78.5.no_thrift.patch, HIVE-78.6.complete.patch, HIVE-78.6.no_thrift.patch, hive-78.diff Allow hive to integrate with existing user repositories for authentication and authorization infromation. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1648) Automatically gathering stats when reading a table/partition
[ https://issues.apache.org/jira/browse/HIVE-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970009#action_12970009 ] Namit Jain commented on HIVE-1648: -- 1. QBParseInfo: add setDestToLimit() for symmetry() 2. I am not sure any of your tests are working - set hive.stats.autogather = false before you create the tables for which you want the stats to be populated while reading. Clearly, this is the reason why piggyback_part.q is working. 2. piggyback_join.q End: show table extended like piggy_table3; drop table piggy_table; Add: show table extended like piggy_table1; show table extended like piggy_table2; Also, add a test where you are joining: piggyback_table1 a join piggyback_table2 b on a.key = b.key join piggyback_table3 c b.key = c.key and then show table extended all the 3 tables. 3. piggyback_limit.q add: show table extended like piggy_table1; before the end. It should have no stats 4. piggbyback_subq.q and _union.q are wrong - you need to create new tables, and then show table extended them at the end, just like other tests. 5. Automatically gathering stats when reading a table/partition Key: HIVE-1648 URL: https://issues.apache.org/jira/browse/HIVE-1648 Project: Hive Issue Type: Sub-task Reporter: Ning Zhang Assignee: Paul Butler Attachments: HIVE-1648.2.patch, HIVE-1648.3.patch, HIVE-1648.4.patch, HIVE-1648.5.patch, HIVE-1648.patch, hive-1648.svn.patch HIVE-1361 introduces a new command 'ANALYZE TABLE T COMPUTE STATISTICS' to gathering stats. This requires additional scan of the data. Stats gathering can be piggy-backed on TableScanOperator whenever a table/partition is scanned (given not LIMIT operator). -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1790) Patch to support HAVING clause in Hive
[ https://issues.apache.org/jira/browse/HIVE-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1790: - Attachment: HIVE-1790.2.patch.txt Attaching a new version of the patch that has been rebased to trunk. I could not get the original to apply cleanly with patch -p0. Patch to support HAVING clause in Hive -- Key: HIVE-1790 URL: https://issues.apache.org/jira/browse/HIVE-1790 Project: Hive Issue Type: New Feature Components: Query Processor Reporter: Vaibhav Aggarwal Assignee: Vaibhav Aggarwal Fix For: 0.7.0 Attachments: HIVE-1790-1.patch, HIVE-1790.2.patch.txt, HIVE-1790.patch Currently Hive users have to do nested queries in order to apply filter on group by expressions. This patch allows users to directly apply filter on group by expressions by using HAVING clause. This patch also helps us integrate Hive with other data analysis tools which rely on HAVING expression. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1790) Patch to support HAVING clause in Hive
[ https://issues.apache.org/jira/browse/HIVE-1790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-1790: - Attachment: HIVE-1790.3.patch.txt Accidentally picked up one of my own changes with the last patch. Attaching a new copy that includes only Vaibhav's work. Patch to support HAVING clause in Hive -- Key: HIVE-1790 URL: https://issues.apache.org/jira/browse/HIVE-1790 Project: Hive Issue Type: New Feature Components: Query Processor Reporter: Vaibhav Aggarwal Assignee: Vaibhav Aggarwal Fix For: 0.7.0 Attachments: HIVE-1790-1.patch, HIVE-1790.2.patch.txt, HIVE-1790.3.patch.txt, HIVE-1790.patch Currently Hive users have to do nested queries in order to apply filter on group by expressions. This patch allows users to directly apply filter on group by expressions by using HAVING clause. This patch also helps us integrate Hive with other data analysis tools which rely on HAVING expression. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1843) add an option in dynamic partition inserts to throw an error if 0 partitions are created
[ https://issues.apache.org/jira/browse/HIVE-1843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-1843: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Committed. Thanks Ning add an option in dynamic partition inserts to throw an error if 0 partitions are created Key: HIVE-1843 URL: https://issues.apache.org/jira/browse/HIVE-1843 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: Namit Jain Assignee: Ning Zhang Attachments: HIVE-1843.patch Currently, we print a error message in that scenario. However, it would be very useful if an option was added where we would error out. This would help a lot in debugging -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-78) Authorization infrastructure for Hive
[ https://issues.apache.org/jira/browse/HIVE-78?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Sichi updated HIVE-78: --- Comment: was deleted (was: HIVE-78.6.no_thrift.patch has the thrift-generated code. ) Authorization infrastructure for Hive - Key: HIVE-78 URL: https://issues.apache.org/jira/browse/HIVE-78 Project: Hive Issue Type: New Feature Components: Metastore, Query Processor, Server Infrastructure Reporter: Ashish Thusoo Assignee: He Yongqiang Attachments: createuser-v1.patch, hive-78-metadata-v1.patch, hive-78-syntax-v1.patch, HIVE-78.1.nothrift.patch, HIVE-78.1.thrift.patch, HIVE-78.2.nothrift.patch, HIVE-78.2.thrift.patch, HIVE-78.4.complete.patch, HIVE-78.4.no_thrift.patch, HIVE-78.5.complete.patch, HIVE-78.5.no_thrift.patch, HIVE-78.6.complete.patch, HIVE-78.6.no_thrift.patch, hive-78.diff Allow hive to integrate with existing user repositories for authentication and authorization infromation. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1846) change hive assumption that local mode mappers/reducers always run in same jvm
[ https://issues.apache.org/jira/browse/HIVE-1846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramkumar Vadali updated HIVE-1846: -- Attachment: HIVE-1846.patch change hive assumption that local mode mappers/reducers always run in same jvm --- Key: HIVE-1846 URL: https://issues.apache.org/jira/browse/HIVE-1846 Project: Hive Issue Type: Bug Reporter: Joydeep Sen Sarma Assignee: Joydeep Sen Sarma Attachments: HIVE-1846.patch we are trying out a version of hadoop local mode that runs multiple mappers/reducers by spawning jvm's for them. In this mode hive mappers fail in reading the plan file. it seems that we assume (in the setMapredWork call) that local mode mappers/reducers will run in the same jvm (we can cache the current plan in a global var and don't serialize to a path). this needs to get fixed. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1612) Cannot build hive for hadoop 0.21.0
[ https://issues.apache.org/jira/browse/HIVE-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bochun Bai updated HIVE-1612: - Attachment: HIVE-1612-for-r1043843.patch A modified patch for trunk version 1043843 Cannot build hive for hadoop 0.21.0 --- Key: HIVE-1612 URL: https://issues.apache.org/jira/browse/HIVE-1612 Project: Hive Issue Type: Bug Affects Versions: 0.7.0 Reporter: AJ Pahl Attachments: HIVE-1612-for-r1043843.patch, HIVE-1612.patch Current trunk for 0.7.0 does not support building HIVE against the Hadoop 0.21.0 release. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1612) Cannot build hive for hadoop 0.21.0
[ https://issues.apache.org/jira/browse/HIVE-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bochun Bai updated HIVE-1612: - Attachment: HIVE-1612-for-r1043843.patch Overwrite previous patch which is not includes shims new files. This patch is working but needs more works about comments and test cases. It is not ready to commit. Cannot build hive for hadoop 0.21.0 --- Key: HIVE-1612 URL: https://issues.apache.org/jira/browse/HIVE-1612 Project: Hive Issue Type: Bug Affects Versions: 0.7.0 Reporter: AJ Pahl Attachments: HIVE-1612-for-r1043843.patch, HIVE-1612-for-r1043843.patch, HIVE-1612.patch Current trunk for 0.7.0 does not support building HIVE against the Hadoop 0.21.0 release. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
