[jira] [Commented] (HIVE-2186) Dynamic Partitioning Failing because of characters not supported globStatus
[ https://issues.apache.org/jira/browse/HIVE-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13043235#comment-13043235 ] Siying Dong commented on HIVE-2186: --- You need to show partition after dropping partition to make sure dropping partition succeeded. Dynamic Partitioning Failing because of characters not supported globStatus --- Key: HIVE-2186 URL: https://issues.apache.org/jira/browse/HIVE-2186 Project: Hive Issue Type: Bug Components: Query Processor Reporter: Siying Dong Assignee: Franklin Hu Attachments: hive-2186.1.patch, hive-2186.2.patch, hive-2186.3.patch Some dynamic queries failed on the stage of loading partitions if dynamic partition columns contain special characters. We need to escape all of them. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2185) extend table statistics to store the size of uncompressed data (+extend interfaces for collecting other types of statistics)
[ https://issues.apache.org/jira/browse/HIVE-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13043236#comment-13043236 ] Ning Zhang commented on HIVE-2185: -- +1. Will commit if tests pass. extend table statistics to store the size of uncompressed data (+extend interfaces for collecting other types of statistics) Key: HIVE-2185 URL: https://issues.apache.org/jira/browse/HIVE-2185 Project: Hive Issue Type: New Feature Components: Serializers/Deserializers, Statistics Reporter: Tomasz Nykiel Assignee: Tomasz Nykiel Attachments: HIVE-2185.1.patch, HIVE-2185.2.patch, HIVE-2185.patch Currently, when executing INSERT OVERWRITE and ANALYZE TABLE commands we collect statistics about the number of rows per partition/table. Other statistics (e.g., total table/partition size) are derived from the file system. Here, we want to collect information about the sizes of uncompressed data, to be able to determine the efficiency of compression. Currently, a large part of statistics collection mechanism is hardcoded and not-easily extensible for other statistics. On top of adding the new statistic collected, it would be desirable to extend the collection mechanism, so any new statistics could be added easily. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2185) extend table statistics to store the size of uncompressed data (+extend interfaces for collecting other types of statistics)
[ https://issues.apache.org/jira/browse/HIVE-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13043237#comment-13043237 ] Tomasz Nykiel commented on HIVE-2185: - I ran all tests. All quantities were the same as previously, but now the name of the metric changed. Thanks. extend table statistics to store the size of uncompressed data (+extend interfaces for collecting other types of statistics) Key: HIVE-2185 URL: https://issues.apache.org/jira/browse/HIVE-2185 Project: Hive Issue Type: New Feature Components: Serializers/Deserializers, Statistics Reporter: Tomasz Nykiel Assignee: Tomasz Nykiel Attachments: HIVE-2185.1.patch, HIVE-2185.2.patch, HIVE-2185.patch Currently, when executing INSERT OVERWRITE and ANALYZE TABLE commands we collect statistics about the number of rows per partition/table. Other statistics (e.g., total table/partition size) are derived from the file system. Here, we want to collect information about the sizes of uncompressed data, to be able to determine the efficiency of compression. Currently, a large part of statistics collection mechanism is hardcoded and not-easily extensible for other statistics. On top of adding the new statistic collected, it would be desirable to extend the collection mechanism, so any new statistics could be added easily. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2163) SquirrelSQL 3.2.1 doesn't work with Hive 0.7.0
[
https://issues.apache.org/jira/browse/HIVE-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13043289#comment-13043289
]
Mythili Gopalakrishnan commented on HIVE-2163:
--
I have the exact same problem. I have squirrel installed on windows machine
which is not part of the cloudera hadoop cluster. and I am trying to connect to
HIVE using JDBC. Is there anything else to do to get this working...
SquirrelSQL 3.2.1 doesn't work with Hive 0.7.0
--
Key: HIVE-2163
URL: https://issues.apache.org/jira/browse/HIVE-2163
Project: Hive
Issue Type: Bug
Components: JDBC
Affects Versions: 0.7.0
Reporter: Carl Steinbach
I tried using SquirrelSQL 3.2.1 with Hive 0.7.0 following the directions
located here: http://wiki.apache.org/hadoop/Hive/HiveJDBCInterface
I registered the Hive JDBC driver with SquirrelSQL, and then get the
following exception when I try to connect to the Hive Server process:
{noformat}
java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.RuntimeException: java.io.IOException: failure to login
at
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:226)
at org.apache.hadoop.hive.jdbc.HiveConnection.init(HiveConnection.java:72)
at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)
at
net.sourceforge.squirrel_sql.fw.sql.SQLDriverManager.getConnection(SQLDriverManager.java:133)
at
net.sourceforge.squirrel_sql.client.mainframe.action.OpenConnectionCommand.execute(OpenConnectionCommand.java:97)
at
net.sourceforge.squirrel_sql.client.mainframe.action.ConnectToAliasCommand$SheetHandler.run(ConnectToAliasCommand.java:281)
at
net.sourceforge.squirrel_sql.client.mainframe.action.ConnectToAliasCommand$SheetHandler.performOK(ConnectToAliasCommand.java:238)
at
net.sourceforge.squirrel_sql.client.gui.db.ConnectionInternalFrame.connect(ConnectionInternalFrame.java:311)
at
net.sourceforge.squirrel_sql.client.gui.db.ConnectionInternalFrame.access$300(ConnectionInternalFrame.java:56)
at
net.sourceforge.squirrel_sql.client.gui.db.ConnectionInternalFrame$MyOkClosePanelListener.okPressed(ConnectionInternalFrame.java:461)
at
net.sourceforge.squirrel_sql.client.gui.OkClosePanel.fireButtonPressed(OkClosePanel.java:148)
at
net.sourceforge.squirrel_sql.client.gui.OkClosePanel.access$100(OkClosePanel.java:33)
at
net.sourceforge.squirrel_sql.client.gui.OkClosePanel$1.actionPerformed(OkClosePanel.java:174)
at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:2028)
at
javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2351)
at
javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:387)
at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:242)
at
javax.swing.plaf.basic.BasicButtonListener.mouseReleased(BasicButtonListener.java:236)
at java.awt.Component.processMouseEvent(Component.java:6374)
at javax.swing.JComponent.processMouseEvent(JComponent.java:3267)
at java.awt.Component.processEvent(Component.java:6139)
at java.awt.Container.processEvent(Container.java:2085)
at java.awt.Component.dispatchEventImpl(Component.java:4736)
at java.awt.Container.dispatchEventImpl(Container.java:2143)
at java.awt.Component.dispatchEvent(Component.java:4566)
at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4621)
at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4282)
at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4212)
at java.awt.Container.dispatchEventImpl(Container.java:2129)
at java.awt.Window.dispatchEventImpl(Window.java:2478)
at java.awt.Component.dispatchEvent(Component.java:4566)
at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:680)
at java.awt.EventQueue.access$000(EventQueue.java:86)
at java.awt.EventQueue$1.run(EventQueue.java:639)
at java.awt.EventQueue$1.run(EventQueue.java:637)
at java.security.AccessController.doPrivileged(Native Method)
at
java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:87)
at
java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:98)
at java.awt.EventQueue$2.run(EventQueue.java:653)
at java.awt.EventQueue$2.run(EventQueue.java:651)
at java.security.AccessController.doPrivileged(Native Method)
at
java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:87)
at java.awt.EventQueue.dispatchEvent(EventQueue.java:650)
at net.sourceforge.squirrel_sql.client.Main$1.dispatchEvent(Main.java:93)
at
java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:296)
at
pivot table in hive
Hi Experts,
I need one solution for hive in my project. Actually I have to
create a pivot table type of concept in hive. I don't know how to do the
same. But I have studied and implemented in hive for the same. But by
looking into it, I am not satisfied with the solution and I am not knowing
about the performance overhead also. You people please inform me whether
any other way better than this to implement pivot table in hive.
I have referenced the following site for understanding the basic concept of
pivot table.
http://blogs.msdn.com/b/spike/archive/2009/03/03/pivot-tables-in-sql-server-a-simple-sample.aspx
I am attaching the input file and hive implementation which I have done for
the same.
Attachments:
1. testfile_pivot.txt : This file contains the input data for creating table
for both sql server and hive. You please remove the heading and the under
line and load data into hive
2. pivottable.txt : contains sql server command for creating table,
populating table and pivot table creation and hive command for table
creation. loading data into hive and .
pivot table creation statements etc
Please reply me your suggestions.
--
Thanks and Regards
Reju. R
VendorId IncomeDay IncomeAmount
-- --
SPIKE FRI 100
SPIKE MON 300
FREDS SUN 400
SPIKE WED 500
SPIKE TUE 200
JOHNS WED 900
SPIKE FRI 100
JOHNS MON 300
SPIKE SUN 400
JOHNS FRI 300
FREDS TUE 200
SPIKE MON 900
FREDS FRI 900
FREDS MON 500
JOHNS SUN 600
SPIKE FRI 300
SPIKE FRI 300
SPIKE WED 500
SPIKE FRI 300
JOHNS THU 800
JOHNS SAT 800
SPIKE TUE 100
SPIKE THU 300
FREDS WED 500
SPIKE SAT 100
FREDS SAT 500
FREDS THU 800
JOHNS TUE 600-- PIVOT TABLE CONCEPT IN SQL SERVER
create table DailyIncome(VendorId nvarchar(10), IncomeDay nvarchar(10),
IncomeAmount int);
--populating the sql server database
insert into DailyIncome values ('SPIKE', 'FRI', 100);
insert into DailyIncome values ('SPIKE', 'MON', 300);
insert into DailyIncome values ('FREDS', 'SUN', 400);
insert into DailyIncome values ('SPIKE', 'WED', 500);
insert into DailyIncome values ('SPIKE', 'TUE', 200);
insert into DailyIncome values ('JOHNS', 'WED', 900);
insert into DailyIncome values ('SPIKE', 'FRI', 100);
insert into DailyIncome values ('JOHNS', 'MON', 300);
insert into DailyIncome values ('SPIKE', 'SUN', 400);
insert into DailyIncome values ('JOHNS', 'FRI', 300);
insert into DailyIncome values ('FREDS', 'TUE', 500);
insert into DailyIncome values ('FREDS', 'TUE', 200);
insert into DailyIncome values ('SPIKE', 'MON', 900);
insert into DailyIncome values ('FREDS', 'FRI', 900);
insert into DailyIncome values ('FREDS', 'MON', 500);
insert into DailyIncome values ('JOHNS', 'SUN', 600);
insert into DailyIncome values ('SPIKE', 'FRI', 300);
insert into DailyIncome values ('SPIKE', 'WED', 500);
insert into DailyIncome values ('SPIKE', 'FRI', 300);
insert into DailyIncome values ('JOHNS', 'THU', 800);
insert into DailyIncome values ('JOHNS', 'SAT', 800);
insert into DailyIncome values ('SPIKE', 'TUE', 100);
insert into DailyIncome values ('SPIKE', 'THU', 300);
insert into DailyIncome values ('FREDS', 'WED', 500);
insert into DailyIncome values ('SPIKE', 'SAT', 100);
insert into DailyIncome values ('FREDS', 'SAT', 500);
insert into DailyIncome values ('FREDS', 'THU', 800);
insert into DailyIncome values ('JOHNS', 'TUE', 600);
select * from DailyIncome
pivot (avg (IncomeAmount) for IncomeDay in
([SUN],[MON],[TUE],[WED],[THU],[FRI],[SAT])) as AvgIncomePerDay
--PIVOT TABLE CONCEPT IN HIVE
CREATE TABLE pivot_source (vendorid string, incomeday string, incomeamount int)
ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' LINES TERMINATED BY '\n' STORED
AS textfile;
LOAD DATA INPATH '/userdata/rejur/test/testfile_pivot.txt' INTO TABLE
pivot_source;
CREATE TABLE pivottest (vendorid string,SUN string, MON string, TUE string, WED
string,THU string, FRI string, SAT string) ROW FORMAT DELIMITED FIELDS
TERMINATED BY '\t' LINES TERMINATED BY '\n' STORED AS textfile;
INSERT OVERWRITE TABLE pivottest SELECT DISTINCT vendorid, '1', '2', '3',
'4','5', '6',
[jira] [Commented] (HIVE-2163) SquirrelSQL 3.2.1 doesn't work with Hive 0.7.0
[
https://issues.apache.org/jira/browse/HIVE-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13043317#comment-13043317
]
Bennie Schut commented on HIVE-2163:
HIVE-2054 removes the dependency to SessionState which includes code which
should be server side so it's most likely fixed by that. Can you try 0.7.1 or
higher?
SquirrelSQL 3.2.1 doesn't work with Hive 0.7.0
--
Key: HIVE-2163
URL: https://issues.apache.org/jira/browse/HIVE-2163
Project: Hive
Issue Type: Bug
Components: JDBC
Affects Versions: 0.7.0
Reporter: Carl Steinbach
I tried using SquirrelSQL 3.2.1 with Hive 0.7.0 following the directions
located here: http://wiki.apache.org/hadoop/Hive/HiveJDBCInterface
I registered the Hive JDBC driver with SquirrelSQL, and then get the
following exception when I try to connect to the Hive Server process:
{noformat}
java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.RuntimeException: java.io.IOException: failure to login
at
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:226)
at org.apache.hadoop.hive.jdbc.HiveConnection.init(HiveConnection.java:72)
at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)
at
net.sourceforge.squirrel_sql.fw.sql.SQLDriverManager.getConnection(SQLDriverManager.java:133)
at
net.sourceforge.squirrel_sql.client.mainframe.action.OpenConnectionCommand.execute(OpenConnectionCommand.java:97)
at
net.sourceforge.squirrel_sql.client.mainframe.action.ConnectToAliasCommand$SheetHandler.run(ConnectToAliasCommand.java:281)
at
net.sourceforge.squirrel_sql.client.mainframe.action.ConnectToAliasCommand$SheetHandler.performOK(ConnectToAliasCommand.java:238)
at
net.sourceforge.squirrel_sql.client.gui.db.ConnectionInternalFrame.connect(ConnectionInternalFrame.java:311)
at
net.sourceforge.squirrel_sql.client.gui.db.ConnectionInternalFrame.access$300(ConnectionInternalFrame.java:56)
at
net.sourceforge.squirrel_sql.client.gui.db.ConnectionInternalFrame$MyOkClosePanelListener.okPressed(ConnectionInternalFrame.java:461)
at
net.sourceforge.squirrel_sql.client.gui.OkClosePanel.fireButtonPressed(OkClosePanel.java:148)
at
net.sourceforge.squirrel_sql.client.gui.OkClosePanel.access$100(OkClosePanel.java:33)
at
net.sourceforge.squirrel_sql.client.gui.OkClosePanel$1.actionPerformed(OkClosePanel.java:174)
at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:2028)
at
javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2351)
at
javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:387)
at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:242)
at
javax.swing.plaf.basic.BasicButtonListener.mouseReleased(BasicButtonListener.java:236)
at java.awt.Component.processMouseEvent(Component.java:6374)
at javax.swing.JComponent.processMouseEvent(JComponent.java:3267)
at java.awt.Component.processEvent(Component.java:6139)
at java.awt.Container.processEvent(Container.java:2085)
at java.awt.Component.dispatchEventImpl(Component.java:4736)
at java.awt.Container.dispatchEventImpl(Container.java:2143)
at java.awt.Component.dispatchEvent(Component.java:4566)
at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4621)
at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4282)
at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4212)
at java.awt.Container.dispatchEventImpl(Container.java:2129)
at java.awt.Window.dispatchEventImpl(Window.java:2478)
at java.awt.Component.dispatchEvent(Component.java:4566)
at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:680)
at java.awt.EventQueue.access$000(EventQueue.java:86)
at java.awt.EventQueue$1.run(EventQueue.java:639)
at java.awt.EventQueue$1.run(EventQueue.java:637)
at java.security.AccessController.doPrivileged(Native Method)
at
java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:87)
at
java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:98)
at java.awt.EventQueue$2.run(EventQueue.java:653)
at java.awt.EventQueue$2.run(EventQueue.java:651)
at java.security.AccessController.doPrivileged(Native Method)
at
java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:87)
at java.awt.EventQueue.dispatchEvent(EventQueue.java:650)
at net.sourceforge.squirrel_sql.client.Main$1.dispatchEvent(Main.java:93)
at
java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:296)
at
java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:211)
at
[jira] [Commented] (HIVE-2182) Avoid null pointer exception when executing UDF
[
https://issues.apache.org/jira/browse/HIVE-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13043356#comment-13043356
]
Chinna Rao Lalam commented on HIVE-2182:
Hi He Yongqiang,
I feel this validation is not possible on client side because the client
side validation cannot
ensure the jar presence in task tracker classpath.
Avoid null pointer exception when executing UDF
---
Key: HIVE-2182
URL: https://issues.apache.org/jira/browse/HIVE-2182
Project: Hive
Issue Type: Bug
Components: Query Processor
Affects Versions: 0.5.0, 0.8.0
Environment: Hadoop 0.20.1, Hive0.8.0 and SUSE Linux Enterprise
Server 10 SP2 (i586) - Kernel 2.6.16.60-0.21-smp (5)
Reporter: Chinna Rao Lalam
Assignee: Chinna Rao Lalam
Attachments: HIVE-2182.patch
For using UDF's executed following steps
{noformat}
add jar /home/udf/udf.jar;
create temporary function grade as 'udf.Grade';
select m.userid,m.name,grade(m.maths,m.physics,m.chemistry) from marks m;
{noformat}
But from the above steps if we miss the first step (add jar) and execute
remaining steps
{noformat}
create temporary function grade as 'udf.Grade';
select m.userid,m.name,grade(m.maths,m.physics,m.chemistry) from marks m;
{noformat}
In tasktracker it is throwing this exception
{noformat}
Caused by: java.lang.RuntimeException: Map operator initialization failed
at
org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:121)
... 18 more
Caused by: java.lang.RuntimeException: java.lang.NullPointerException
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:115)
at
org.apache.hadoop.hive.ql.udf.generic.GenericUDFBridge.initialize(GenericUDFBridge.java:126)
at
org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.initialize(ExprNodeGenericFuncEvaluator.java:133)
at
org.apache.hadoop.hive.ql.exec.Operator.initEvaluators(Operator.java:878)
at
org.apache.hadoop.hive.ql.exec.Operator.initEvaluatorsAndReturnStruct(Operator.java:904)
at
org.apache.hadoop.hive.ql.exec.SelectOperator.initializeOp(SelectOperator.java:60)
at
org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357)
at
org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:433)
at
org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:389)
at
org.apache.hadoop.hive.ql.exec.TableScanOperator.initializeOp(TableScanOperator.java:133)
at
org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357)
at
org.apache.hadoop.hive.ql.exec.MapOperator.initializeOp(MapOperator.java:444)
at
org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:357)
at
org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:98)
... 18 more
Caused by: java.lang.NullPointerException
at
java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:768)
at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:107)
... 31 more
{noformat}
Instead of null pointer exception it should throw meaning full exception
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2163) SquirrelSQL 3.2.1 doesn't work with Hive 0.7.0
[
https://issues.apache.org/jira/browse/HIVE-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13043357#comment-13043357
]
Mythili Gopalakrishnan commented on HIVE-2163:
--
Thanks. Is 0.7.1 available in binary form for download?
SquirrelSQL 3.2.1 doesn't work with Hive 0.7.0
--
Key: HIVE-2163
URL: https://issues.apache.org/jira/browse/HIVE-2163
Project: Hive
Issue Type: Bug
Components: JDBC
Affects Versions: 0.7.0
Reporter: Carl Steinbach
I tried using SquirrelSQL 3.2.1 with Hive 0.7.0 following the directions
located here: http://wiki.apache.org/hadoop/Hive/HiveJDBCInterface
I registered the Hive JDBC driver with SquirrelSQL, and then get the
following exception when I try to connect to the Hive Server process:
{noformat}
java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.RuntimeException: java.io.IOException: failure to login
at
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:226)
at org.apache.hadoop.hive.jdbc.HiveConnection.init(HiveConnection.java:72)
at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)
at
net.sourceforge.squirrel_sql.fw.sql.SQLDriverManager.getConnection(SQLDriverManager.java:133)
at
net.sourceforge.squirrel_sql.client.mainframe.action.OpenConnectionCommand.execute(OpenConnectionCommand.java:97)
at
net.sourceforge.squirrel_sql.client.mainframe.action.ConnectToAliasCommand$SheetHandler.run(ConnectToAliasCommand.java:281)
at
net.sourceforge.squirrel_sql.client.mainframe.action.ConnectToAliasCommand$SheetHandler.performOK(ConnectToAliasCommand.java:238)
at
net.sourceforge.squirrel_sql.client.gui.db.ConnectionInternalFrame.connect(ConnectionInternalFrame.java:311)
at
net.sourceforge.squirrel_sql.client.gui.db.ConnectionInternalFrame.access$300(ConnectionInternalFrame.java:56)
at
net.sourceforge.squirrel_sql.client.gui.db.ConnectionInternalFrame$MyOkClosePanelListener.okPressed(ConnectionInternalFrame.java:461)
at
net.sourceforge.squirrel_sql.client.gui.OkClosePanel.fireButtonPressed(OkClosePanel.java:148)
at
net.sourceforge.squirrel_sql.client.gui.OkClosePanel.access$100(OkClosePanel.java:33)
at
net.sourceforge.squirrel_sql.client.gui.OkClosePanel$1.actionPerformed(OkClosePanel.java:174)
at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:2028)
at
javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2351)
at
javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:387)
at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:242)
at
javax.swing.plaf.basic.BasicButtonListener.mouseReleased(BasicButtonListener.java:236)
at java.awt.Component.processMouseEvent(Component.java:6374)
at javax.swing.JComponent.processMouseEvent(JComponent.java:3267)
at java.awt.Component.processEvent(Component.java:6139)
at java.awt.Container.processEvent(Container.java:2085)
at java.awt.Component.dispatchEventImpl(Component.java:4736)
at java.awt.Container.dispatchEventImpl(Container.java:2143)
at java.awt.Component.dispatchEvent(Component.java:4566)
at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4621)
at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4282)
at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4212)
at java.awt.Container.dispatchEventImpl(Container.java:2129)
at java.awt.Window.dispatchEventImpl(Window.java:2478)
at java.awt.Component.dispatchEvent(Component.java:4566)
at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:680)
at java.awt.EventQueue.access$000(EventQueue.java:86)
at java.awt.EventQueue$1.run(EventQueue.java:639)
at java.awt.EventQueue$1.run(EventQueue.java:637)
at java.security.AccessController.doPrivileged(Native Method)
at
java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:87)
at
java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:98)
at java.awt.EventQueue$2.run(EventQueue.java:653)
at java.awt.EventQueue$2.run(EventQueue.java:651)
at java.security.AccessController.doPrivileged(Native Method)
at
java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:87)
at java.awt.EventQueue.dispatchEvent(EventQueue.java:650)
at net.sourceforge.squirrel_sql.client.Main$1.dispatchEvent(Main.java:93)
at
java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:296)
at
java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:211)
at
java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:201)
at
[jira] [Commented] (HIVE-2188) Add multi_get_table function in Hive Metastore
[ https://issues.apache.org/jira/browse/HIVE-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13043362#comment-13043362 ] jirapos...@reviews.apache.org commented on HIVE-2188: - --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/831/#review753 --- trunk/metastore/if/hive_metastore.thrift https://reviews.apache.org/r/831/#comment1571 How about calling it get_multi_table instead? multi_get_table sounds little confusing to me. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java https://reviews.apache.org/r/831/#comment1572 You can write this more concisely using commons-lang utility method as: StringUtils.join(tbls,','); trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java https://reviews.apache.org/r/831/#comment1576 You can get rid of tables.get(i) == null check that will never be true. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java https://reviews.apache.org/r/831/#comment1573 Instead of throwing RuntimeException, create MetaException and throw that. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java https://reviews.apache.org/r/831/#comment1574 Please add javadocs for new methods introduced in interface. Also see my first comment for name. trunk/service/src/test/org/apache/hadoop/hive/service/TestHiveServer.java https://reviews.apache.org/r/831/#comment1575 This test really belongs in the TestMetastore or some such in metastore dir not in HiveServer. - Ashutosh On 2011-06-02 23:01:00, Sohan Jain wrote: bq. bq. --- bq. This is an automatically generated e-mail. To reply, visit: bq. https://reviews.apache.org/r/831/ bq. --- bq. bq. (Updated 2011-06-02 23:01:00) bq. bq. bq. Review request for hive, Paul Yang and Ashutosh Chauhan. bq. bq. bq. Summary bq. --- bq. bq. Created a function multi_get_table that retrieves multiple tables on one trip to the hive metastore, saving round trip time. bq. bq. bq. This addresses bug HIVE-2188. bq. https://issues.apache.org/jira/browse/HIVE-2188 bq. bq. bq. Diffs bq. - bq. bq.trunk/metastore/if/hive_metastore.thrift 1130342 bq. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 1130342 bq. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 1130342 bq.trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java 1130342 bq. trunk/service/src/test/org/apache/hadoop/hive/service/TestHiveServer.java 1130342 bq. bq. Diff: https://reviews.apache.org/r/831/diff bq. bq. bq. Testing bq. --- bq. bq. Added a test case to testMetasore() in TestHiveServer. Also tested for speed improvements in a client session. bq. bq. bq. Thanks, bq. bq. Sohan bq. bq. Add multi_get_table function in Hive Metastore -- Key: HIVE-2188 URL: https://issues.apache.org/jira/browse/HIVE-2188 Project: Hive Issue Type: New Feature Components: Metastore Reporter: Sohan Jain Assignee: Sohan Jain Priority: Minor Attachments: HIVE-2188.1.patch This function would get multiple tables from the hive metastore as opposed to just one at a time, saving round trip time to the metastore. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2045) TCTLSeparatedProtocol.SimpleTransportTokenizer.nextToken() throws Null Pointer Exception in some cases
[ https://issues.apache.org/jira/browse/HIVE-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinna Rao Lalam updated HIVE-2045: --- Attachment: HIVE-2045.patch TCTLSeparatedProtocol.SimpleTransportTokenizer.nextToken() throws Null Pointer Exception in some cases -- Key: HIVE-2045 URL: https://issues.apache.org/jira/browse/HIVE-2045 Project: Hive Issue Type: Bug Components: Serializers/Deserializers Affects Versions: 0.7.0 Environment: Hadoop 0.20.1, Hive0.7.0 and SUSE Linux Enterprise Server 10 SP2 (i586) - Kernel 2.6.16.60-0.21-smp (5). Reporter: Chinna Rao Lalam Assignee: Chinna Rao Lalam Attachments: HIVE-2045.patch 1) In TCTLSeparatedProtocol.SimpleTransportTokenizer.nextToken() is doing null check for the tokenizer. If tokenizer is null, fillTokenizer() method is called to get the tokenizer object. But fillTokenizer() method also can update the tokenizer with NULL , so NULL check should be done before using the tokenizer. 2) Also improved some logging in TCTLSeparatedProtocol.java -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Review Request: HIVE-2188: Add a function to retrieve multiple tables on trip to the hive metastore
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/831/#review753 --- trunk/metastore/if/hive_metastore.thrift https://reviews.apache.org/r/831/#comment1571 How about calling it get_multi_table instead? multi_get_table sounds little confusing to me. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java https://reviews.apache.org/r/831/#comment1572 You can write this more concisely using commons-lang utility method as: StringUtils.join(tbls,','); trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java https://reviews.apache.org/r/831/#comment1576 You can get rid of tables.get(i) == null check that will never be true. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java https://reviews.apache.org/r/831/#comment1573 Instead of throwing RuntimeException, create MetaException and throw that. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java https://reviews.apache.org/r/831/#comment1574 Please add javadocs for new methods introduced in interface. Also see my first comment for name. trunk/service/src/test/org/apache/hadoop/hive/service/TestHiveServer.java https://reviews.apache.org/r/831/#comment1575 This test really belongs in the TestMetastore or some such in metastore dir not in HiveServer. - Ashutosh On 2011-06-02 23:01:00, Sohan Jain wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/831/ --- (Updated 2011-06-02 23:01:00) Review request for hive, Paul Yang and Ashutosh Chauhan. Summary --- Created a function multi_get_table that retrieves multiple tables on one trip to the hive metastore, saving round trip time. This addresses bug HIVE-2188. https://issues.apache.org/jira/browse/HIVE-2188 Diffs - trunk/metastore/if/hive_metastore.thrift 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java 1130342 trunk/service/src/test/org/apache/hadoop/hive/service/TestHiveServer.java 1130342 Diff: https://reviews.apache.org/r/831/diff Testing --- Added a test case to testMetasore() in TestHiveServer. Also tested for speed improvements in a client session. Thanks, Sohan
[jira] [Commented] (HIVE-2045) TCTLSeparatedProtocol.SimpleTransportTokenizer.nextToken() throws Null Pointer Exception in some cases
[ https://issues.apache.org/jira/browse/HIVE-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13043364#comment-13043364 ] Chinna Rao Lalam commented on HIVE-2045: In TCTLSeparatedProtocol.SimpleTransportTokenizer.nextToken() handled null pointer exception TCTLSeparatedProtocol.SimpleTransportTokenizer.nextToken() throws Null Pointer Exception in some cases -- Key: HIVE-2045 URL: https://issues.apache.org/jira/browse/HIVE-2045 Project: Hive Issue Type: Bug Components: Serializers/Deserializers Affects Versions: 0.7.0 Environment: Hadoop 0.20.1, Hive0.7.0 and SUSE Linux Enterprise Server 10 SP2 (i586) - Kernel 2.6.16.60-0.21-smp (5). Reporter: Chinna Rao Lalam Assignee: Chinna Rao Lalam Attachments: HIVE-2045.patch 1) In TCTLSeparatedProtocol.SimpleTransportTokenizer.nextToken() is doing null check for the tokenizer. If tokenizer is null, fillTokenizer() method is called to get the tokenizer object. But fillTokenizer() method also can update the tokenizer with NULL , so NULL check should be done before using the tokenizer. 2) Also improved some logging in TCTLSeparatedProtocol.java -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2045) TCTLSeparatedProtocol.SimpleTransportTokenizer.nextToken() throws Null Pointer Exception in some cases
[ https://issues.apache.org/jira/browse/HIVE-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinna Rao Lalam updated HIVE-2045: --- Status: Patch Available (was: Open) TCTLSeparatedProtocol.SimpleTransportTokenizer.nextToken() throws Null Pointer Exception in some cases -- Key: HIVE-2045 URL: https://issues.apache.org/jira/browse/HIVE-2045 Project: Hive Issue Type: Bug Components: Serializers/Deserializers Affects Versions: 0.7.0 Environment: Hadoop 0.20.1, Hive0.7.0 and SUSE Linux Enterprise Server 10 SP2 (i586) - Kernel 2.6.16.60-0.21-smp (5). Reporter: Chinna Rao Lalam Assignee: Chinna Rao Lalam Attachments: HIVE-2045.patch 1) In TCTLSeparatedProtocol.SimpleTransportTokenizer.nextToken() is doing null check for the tokenizer. If tokenizer is null, fillTokenizer() method is called to get the tokenizer object. But fillTokenizer() method also can update the tokenizer with NULL , so NULL check should be done before using the tokenizer. 2) Also improved some logging in TCTLSeparatedProtocol.java -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2029) MetaStore ConnectionURL updates need to trigger creation of Default DB if it doesn't exist
[ https://issues.apache.org/jira/browse/HIVE-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13043434#comment-13043434 ] Ashutosh Chauhan commented on HIVE-2029: Does anyone have any opinion on this? MetaStore ConnectionURL updates need to trigger creation of Default DB if it doesn't exist -- Key: HIVE-2029 URL: https://issues.apache.org/jira/browse/HIVE-2029 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.7.0 Reporter: Carl Steinbach Attachments: hive_2029.patch HIVE-1219 defined the JDOConnectionURLHook plugin, and integrated this feature into HiveMetaStore. On MetaStore operation failures, this plugin is used to update the metastore ConnectionURL configuration property. Currently this update triggers the reinitialization of the underlying JDO PersistenceManager, but it does not trigger checks to see if the default database exists, nor will it create the default database if it does not exist. It needs to do both. This ticket also covers removing the 'hive.metastore.force.reload.conf' property from HiveConf and HiveMetaStore. This property should not have been added in the first place since its sole purpose is to facilitate testing of the JDOConnectionURLHook mechanism by unnaturally forcing reinitialization of the PersistenceManager. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Work started] (HIVE-2191) Allow optional [inner] on equi-join.
[ https://issues.apache.org/jira/browse/HIVE-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-2191 started by Bennie Schut. Allow optional [inner] on equi-join. Key: HIVE-2191 URL: https://issues.apache.org/jira/browse/HIVE-2191 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: Bennie Schut Assignee: Bennie Schut Priority: Trivial Fix For: 0.8.0 Lot's of databases including mysql support an optional inner keyword to explicitely select an equi-join. As shown in the mysql docs: http://dev.mysql.com/doc/refman/5.1/en/join.html For completeness/portability we should allow this. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2191) Allow optional [inner] on equi-join.
[ https://issues.apache.org/jira/browse/HIVE-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bennie Schut updated HIVE-2191: --- Attachment: HIVE-2191.1.patch.txt Created an alias for inner join. Allow optional [inner] on equi-join. Key: HIVE-2191 URL: https://issues.apache.org/jira/browse/HIVE-2191 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: Bennie Schut Assignee: Bennie Schut Priority: Trivial Fix For: 0.8.0 Attachments: HIVE-2191.1.patch.txt Lot's of databases including mysql support an optional inner keyword to explicitely select an equi-join. As shown in the mysql docs: http://dev.mysql.com/doc/refman/5.1/en/join.html For completeness/portability we should allow this. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-2185) extend table statistics to store the size of uncompressed data (+extend interfaces for collecting other types of statistics)
[ https://issues.apache.org/jira/browse/HIVE-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang resolved HIVE-2185. -- Resolution: Fixed Fix Version/s: 0.8.0 Hadoop Flags: [Reviewed] Committed. Thanks Tom! extend table statistics to store the size of uncompressed data (+extend interfaces for collecting other types of statistics) Key: HIVE-2185 URL: https://issues.apache.org/jira/browse/HIVE-2185 Project: Hive Issue Type: New Feature Components: Serializers/Deserializers, Statistics Reporter: Tomasz Nykiel Assignee: Tomasz Nykiel Fix For: 0.8.0 Attachments: HIVE-2185.1.patch, HIVE-2185.2.patch, HIVE-2185.patch Currently, when executing INSERT OVERWRITE and ANALYZE TABLE commands we collect statistics about the number of rows per partition/table. Other statistics (e.g., total table/partition size) are derived from the file system. Here, we want to collect information about the sizes of uncompressed data, to be able to determine the efficiency of compression. Currently, a large part of statistics collection mechanism is hardcoded and not-easily extensible for other statistics. On top of adding the new statistic collected, it would be desirable to extend the collection mechanism, so any new statistics could be added easily. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-1740) support NOT IN and NOT LIKE syntax
[ https://issues.apache.org/jira/browse/HIVE-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang resolved HIVE-1740. -- Resolution: Fixed Fix Version/s: 0.8.0 Hadoop Flags: [Reviewed] Committed. Thanks Eric! support NOT IN and NOT LIKE syntax -- Key: HIVE-1740 URL: https://issues.apache.org/jira/browse/HIVE-1740 Project: Hive Issue Type: Improvement Components: Query Processor Affects Versions: 0.6.0 Reporter: John Sichi Assignee: Eric Hassold Fix For: 0.8.0 Attachments: HIVE-1740.1.patch.txt, HIVE-1740.2.patch.txt Hive should support standard SQL syntax x NOT LIKE p x NOT IN (...) -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2192) Stats table schema incompatible after HIVE-2185
Stats table schema incompatible after HIVE-2185 --- Key: HIVE-2192 URL: https://issues.apache.org/jira/browse/HIVE-2192 Project: Hive Issue Type: Bug Reporter: Ning Zhang Assignee: Tomasz Nykiel HIVE-2185 introduced a new column in the intermediate stats table. This introduces incompatibility between old and new branches (multiple branches could be deployed in production): the old branch will not work with the new schema, and the new branch will not work with the old schema. A solution would be to rename the stats table name (requires code change) or use a different database name (requires hive-default.xml conf change). -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2186) Dynamic Partitioning Failing because of characters not supported globStatus
[ https://issues.apache.org/jira/browse/HIVE-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Franklin Hu updated HIVE-2186: -- Attachment: hive-2186.4.patch show partitions after dropping Dynamic Partitioning Failing because of characters not supported globStatus --- Key: HIVE-2186 URL: https://issues.apache.org/jira/browse/HIVE-2186 Project: Hive Issue Type: Bug Components: Query Processor Reporter: Siying Dong Assignee: Franklin Hu Attachments: hive-2186.1.patch, hive-2186.2.patch, hive-2186.3.patch, hive-2186.4.patch Some dynamic queries failed on the stage of loading partitions if dynamic partition columns contain special characters. We need to escape all of them. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2192) Stats table schema incompatible after HIVE-2185
[ https://issues.apache.org/jira/browse/HIVE-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Nykiel updated HIVE-2192: Attachment: HIVE-2192.patch -Changes the table name used for collecting intermediate statistics by JDBCStatsPublisher -removes an empty TestStatsPublisher.java Stats table schema incompatible after HIVE-2185 --- Key: HIVE-2192 URL: https://issues.apache.org/jira/browse/HIVE-2192 Project: Hive Issue Type: Bug Reporter: Ning Zhang Assignee: Tomasz Nykiel Attachments: HIVE-2192.patch HIVE-2185 introduced a new column in the intermediate stats table. This introduces incompatibility between old and new branches (multiple branches could be deployed in production): the old branch will not work with the new schema, and the new branch will not work with the old schema. A solution would be to rename the stats table name (requires code change) or use a different database name (requires hive-default.xml conf change). -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2163) SquirrelSQL 3.2.1 doesn't work with Hive 0.7.0
[
https://issues.apache.org/jira/browse/HIVE-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13043936#comment-13043936
]
Carl Steinbach commented on HIVE-2163:
--
0.7.1 has not yet been released, but you can get SNAPSHOT tarballs here:
https://builds.apache.org/job/Hive-branch-0.7.1-h0.21/
SquirrelSQL 3.2.1 doesn't work with Hive 0.7.0
--
Key: HIVE-2163
URL: https://issues.apache.org/jira/browse/HIVE-2163
Project: Hive
Issue Type: Bug
Components: JDBC
Affects Versions: 0.7.0
Reporter: Carl Steinbach
I tried using SquirrelSQL 3.2.1 with Hive 0.7.0 following the directions
located here: http://wiki.apache.org/hadoop/Hive/HiveJDBCInterface
I registered the Hive JDBC driver with SquirrelSQL, and then get the
following exception when I try to connect to the Hive Server process:
{noformat}
java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.RuntimeException: java.io.IOException: failure to login
at
org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:226)
at org.apache.hadoop.hive.jdbc.HiveConnection.init(HiveConnection.java:72)
at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:110)
at
net.sourceforge.squirrel_sql.fw.sql.SQLDriverManager.getConnection(SQLDriverManager.java:133)
at
net.sourceforge.squirrel_sql.client.mainframe.action.OpenConnectionCommand.execute(OpenConnectionCommand.java:97)
at
net.sourceforge.squirrel_sql.client.mainframe.action.ConnectToAliasCommand$SheetHandler.run(ConnectToAliasCommand.java:281)
at
net.sourceforge.squirrel_sql.client.mainframe.action.ConnectToAliasCommand$SheetHandler.performOK(ConnectToAliasCommand.java:238)
at
net.sourceforge.squirrel_sql.client.gui.db.ConnectionInternalFrame.connect(ConnectionInternalFrame.java:311)
at
net.sourceforge.squirrel_sql.client.gui.db.ConnectionInternalFrame.access$300(ConnectionInternalFrame.java:56)
at
net.sourceforge.squirrel_sql.client.gui.db.ConnectionInternalFrame$MyOkClosePanelListener.okPressed(ConnectionInternalFrame.java:461)
at
net.sourceforge.squirrel_sql.client.gui.OkClosePanel.fireButtonPressed(OkClosePanel.java:148)
at
net.sourceforge.squirrel_sql.client.gui.OkClosePanel.access$100(OkClosePanel.java:33)
at
net.sourceforge.squirrel_sql.client.gui.OkClosePanel$1.actionPerformed(OkClosePanel.java:174)
at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:2028)
at
javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2351)
at
javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:387)
at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:242)
at
javax.swing.plaf.basic.BasicButtonListener.mouseReleased(BasicButtonListener.java:236)
at java.awt.Component.processMouseEvent(Component.java:6374)
at javax.swing.JComponent.processMouseEvent(JComponent.java:3267)
at java.awt.Component.processEvent(Component.java:6139)
at java.awt.Container.processEvent(Container.java:2085)
at java.awt.Component.dispatchEventImpl(Component.java:4736)
at java.awt.Container.dispatchEventImpl(Container.java:2143)
at java.awt.Component.dispatchEvent(Component.java:4566)
at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4621)
at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4282)
at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4212)
at java.awt.Container.dispatchEventImpl(Container.java:2129)
at java.awt.Window.dispatchEventImpl(Window.java:2478)
at java.awt.Component.dispatchEvent(Component.java:4566)
at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:680)
at java.awt.EventQueue.access$000(EventQueue.java:86)
at java.awt.EventQueue$1.run(EventQueue.java:639)
at java.awt.EventQueue$1.run(EventQueue.java:637)
at java.security.AccessController.doPrivileged(Native Method)
at
java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:87)
at
java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:98)
at java.awt.EventQueue$2.run(EventQueue.java:653)
at java.awt.EventQueue$2.run(EventQueue.java:651)
at java.security.AccessController.doPrivileged(Native Method)
at
java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:87)
at java.awt.EventQueue.dispatchEvent(EventQueue.java:650)
at net.sourceforge.squirrel_sql.client.Main$1.dispatchEvent(Main.java:93)
at
java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:296)
at
java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:211)
at
java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:201)
at
[jira] [Commented] (HIVE-2192) Stats table schema incompatible after HIVE-2185
[ https://issues.apache.org/jira/browse/HIVE-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13043940#comment-13043940 ] jirapos...@reviews.apache.org commented on HIVE-2192: - --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/851/ --- Review request for hive, Hairong Kuang and Ning Zhang. Summary --- HIVE-2185 introduces new statistics collected by StatsPublisher, which causes a change in the schema of the table used for collecting intermediate statistics by JDBCStatsPublisher. This patch changes the table name, to avoid conflicts with the previous version. Also this patch removes an empty JUnit java file. This addresses bug HIVE-2192. https://issues.apache.org/jira/browse/HIVE-2192 Diffs - trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsSetupConstants.java 1131108 Diff: https://reviews.apache.org/r/851/diff Testing --- JDBCStatsPublisherEnhanced JUnit test. Thanks, Tomasz Stats table schema incompatible after HIVE-2185 --- Key: HIVE-2192 URL: https://issues.apache.org/jira/browse/HIVE-2192 Project: Hive Issue Type: Bug Reporter: Ning Zhang Assignee: Tomasz Nykiel Attachments: HIVE-2192.patch HIVE-2185 introduced a new column in the intermediate stats table. This introduces incompatibility between old and new branches (multiple branches could be deployed in production): the old branch will not work with the new schema, and the new branch will not work with the old schema. A solution would be to rename the stats table name (requires code change) or use a different database name (requires hive-default.xml conf change). -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-2193) drop partition with partial specification should remove the HDFS directory corresponding to the root of PS
drop partition with partial specification should remove the HDFS directory corresponding to the root of PS -- Key: HIVE-2193 URL: https://issues.apache.org/jira/browse/HIVE-2193 Project: Hive Issue Type: Improvement Reporter: Ning Zhang Assignee: Paul Yang If a table have multiple partitions, say (ds, hr), currently the following command: alter table T drop partition(ds='1'); won't delete the directory .../T/ds=1, although all subdirectories are deleted. This could result in a lot of dangling inodes in HDFS. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2192) Stats table schema incompatible after HIVE-2185
[ https://issues.apache.org/jira/browse/HIVE-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13043966#comment-13043966 ] Ning Zhang commented on HIVE-2192: -- +1 Stats table schema incompatible after HIVE-2185 --- Key: HIVE-2192 URL: https://issues.apache.org/jira/browse/HIVE-2192 Project: Hive Issue Type: Bug Reporter: Ning Zhang Assignee: Tomasz Nykiel Attachments: HIVE-2192.patch HIVE-2185 introduced a new column in the intermediate stats table. This introduces incompatibility between old and new branches (multiple branches could be deployed in production): the old branch will not work with the new schema, and the new branch will not work with the old schema. A solution would be to rename the stats table name (requires code change) or use a different database name (requires hive-default.xml conf change). -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2191) Allow optional [inner] on equi-join.
[ https://issues.apache.org/jira/browse/HIVE-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bennie Schut updated HIVE-2191: --- Release Note: Allow optional [inner] on equi-join. Status: Patch Available (was: In Progress) https://reviews.apache.org/r/852/ I wasn't sure if a test should be added for this. I could copy a normal join test but it would add to the total build time, considering it's just an alias to join. But if a test is preferred I don't mind adding it. Allow optional [inner] on equi-join. Key: HIVE-2191 URL: https://issues.apache.org/jira/browse/HIVE-2191 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: Bennie Schut Assignee: Bennie Schut Priority: Trivial Fix For: 0.8.0 Attachments: HIVE-2191.1.patch.txt Lot's of databases including mysql support an optional inner keyword to explicitely select an equi-join. As shown in the mysql docs: http://dev.mysql.com/doc/refman/5.1/en/join.html For completeness/portability we should allow this. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
Jenkins build is unstable: Hive-branch-0.7.1-h0.21 #12
See https://builds.apache.org/hudson/job/Hive-branch-0.7.1-h0.21/12/
[jira] [Created] (HIVE-2194) Add actions for alter table and alter partition events for metastore event listeners
Add actions for alter table and alter partition events for metastore event listeners Key: HIVE-2194 URL: https://issues.apache.org/jira/browse/HIVE-2194 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Sohan Jain Assignee: Sohan Jain HIVE-2038 introduced the MetaStoreEventListener abstract class that defines actions to be performed after particular events on a metastore. Improve upon that class by adding events to be performed on alter table and alter partition actions. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2194) Add actions for alter table and alter partition events for metastore event listeners
[ https://issues.apache.org/jira/browse/HIVE-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sohan Jain updated HIVE-2194: - Status: Patch Available (was: Open) Add actions for alter table and alter partition events for metastore event listeners Key: HIVE-2194 URL: https://issues.apache.org/jira/browse/HIVE-2194 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Sohan Jain Assignee: Sohan Jain Attachments: HIVE-2194.1.patch HIVE-2038 introduced the MetaStoreEventListener abstract class that defines actions to be performed after particular events on a metastore. Improve upon that class by adding events to be performed on alter table and alter partition actions. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2194) Add actions for alter table and alter partition events for metastore event listeners
[ https://issues.apache.org/jira/browse/HIVE-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13044016#comment-13044016 ] jirapos...@reviews.apache.org commented on HIVE-2194: - --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/853/ --- Review request for hive and Paul Yang. Summary --- HIVE-2038 introduced the MetaStoreEventListener abstract class that defines actions to be performed after particular events on a metastore. Improve upon that class by adding events to be performed on alter table and alter partition actions. Also, update the hive metastore to call the appropriate functions of the listeners when the events happen. This addresses bug HIVE-2194. https://issues.apache.org/jira/browse/HIVE-2194 Diffs - trunk/metastore/src/java/org/apache/hadoop/hive/metastore/AlterHandler.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreEventListener.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/AlterPartitionEvent.java PRE-CREATION trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/AlterTableEvent.java PRE-CREATION trunk/metastore/src/test/org/apache/hadoop/hive/metastore/DummyListener.java 1130342 trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEventListener.java 1130342 Diff: https://reviews.apache.org/r/853/diff Testing --- Added test cases to TestMetaStoreEventListener. Thanks, Sohan Add actions for alter table and alter partition events for metastore event listeners Key: HIVE-2194 URL: https://issues.apache.org/jira/browse/HIVE-2194 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Sohan Jain Assignee: Sohan Jain Attachments: HIVE-2194.1.patch HIVE-2038 introduced the MetaStoreEventListener abstract class that defines actions to be performed after particular events on a metastore. Improve upon that class by adding events to be performed on alter table and alter partition actions. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
Review Request: HIVE-2194: Add actions to MetaStoreEventListener to be performed on alter table and alter partition operations.
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/853/ --- Review request for hive and Paul Yang. Summary --- HIVE-2038 introduced the MetaStoreEventListener abstract class that defines actions to be performed after particular events on a metastore. Improve upon that class by adding events to be performed on alter table and alter partition actions. Also, update the hive metastore to call the appropriate functions of the listeners when the events happen. This addresses bug HIVE-2194. https://issues.apache.org/jira/browse/HIVE-2194 Diffs - trunk/metastore/src/java/org/apache/hadoop/hive/metastore/AlterHandler.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreEventListener.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/AlterPartitionEvent.java PRE-CREATION trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/AlterTableEvent.java PRE-CREATION trunk/metastore/src/test/org/apache/hadoop/hive/metastore/DummyListener.java 1130342 trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEventListener.java 1130342 Diff: https://reviews.apache.org/r/853/diff Testing --- Added test cases to TestMetaStoreEventListener. Thanks, Sohan
Review Request: HIVE-2191: Allow optional [inner] on equi-join.
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/852/ --- Review request for hive. Summary --- HIVE-2191: Allow optional [inner] on equi-join. This addresses bug HIVE-2191. https://issues.apache.org/jira/browse/HIVE-2191 Diffs - trunk/docs/xdocs/language_manual/joins.xml 1131084 trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g 1131084 Diff: https://reviews.apache.org/r/852/diff Testing --- Thanks, Bennie
Review Request: Stats table schema incompatible after HIVE-2185
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/851/ --- Review request for hive, Hairong Kuang and Ning Zhang. Summary --- HIVE-2185 introduces new statistics collected by StatsPublisher, which causes a change in the schema of the table used for collecting intermediate statistics by JDBCStatsPublisher. This patch changes the table name, to avoid conflicts with the previous version. Also this patch removes an empty JUnit java file. This addresses bug HIVE-2192. https://issues.apache.org/jira/browse/HIVE-2192 Diffs - trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsSetupConstants.java 1131108 Diff: https://reviews.apache.org/r/851/diff Testing --- JDBCStatsPublisherEnhanced JUnit test. Thanks, Tomasz
[jira] [Commented] (HIVE-2029) MetaStore ConnectionURL updates need to trigger creation of Default DB if it doesn't exist
[ https://issues.apache.org/jira/browse/HIVE-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13044032#comment-13044032 ] Paul Yang commented on HIVE-2029: - Can you elaborate on how this retry feature works in datanucleus 3.0? The case that could be handled with the URL hook is as follows - a db host goes down. A failover is performed and a replica on a different host is promoted to be the new master. Using the hook, the client is able to re-execute the query on the new host and the Hive query succeeds without failure. Would it be possible to implement something similar in datanucleus 3.0? MetaStore ConnectionURL updates need to trigger creation of Default DB if it doesn't exist -- Key: HIVE-2029 URL: https://issues.apache.org/jira/browse/HIVE-2029 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.7.0 Reporter: Carl Steinbach Attachments: hive_2029.patch HIVE-1219 defined the JDOConnectionURLHook plugin, and integrated this feature into HiveMetaStore. On MetaStore operation failures, this plugin is used to update the metastore ConnectionURL configuration property. Currently this update triggers the reinitialization of the underlying JDO PersistenceManager, but it does not trigger checks to see if the default database exists, nor will it create the default database if it does not exist. It needs to do both. This ticket also covers removing the 'hive.metastore.force.reload.conf' property from HiveConf and HiveMetaStore. This property should not have been added in the first place since its sole purpose is to facilitate testing of the JDOConnectionURLHook mechanism by unnaturally forcing reinitialization of the PersistenceManager. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Review Request: HIVE-2194: Add actions to MetaStoreEventListener to be performed on alter table and alter partition operations.
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/853/#review758 --- trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java https://reviews.apache.org/r/853/#comment1598 This method should either succeed or throw an exception. Since it already throws checked exceptions, adding a boolean return value makes things more complicated for the caller, and signals the same type of failure as an exception but without the ability to include information about what caused the failure. I think it would be better to modify the code so that an exception is always thrown when success==FALSE. This comment also applies to the various alterTable and alterPartition methods located in other classes. - Carl On 2011-06-03 20:20:03, Sohan Jain wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/853/ --- (Updated 2011-06-03 20:20:03) Review request for hive and Paul Yang. Summary --- HIVE-2038 introduced the MetaStoreEventListener abstract class that defines actions to be performed after particular events on a metastore. Improve upon that class by adding events to be performed on alter table and alter partition actions. Also, update the hive metastore to call the appropriate functions of the listeners when the events happen. This addresses bug HIVE-2194. https://issues.apache.org/jira/browse/HIVE-2194 Diffs - trunk/metastore/src/java/org/apache/hadoop/hive/metastore/AlterHandler.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreEventListener.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java 1130342 trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/AlterPartitionEvent.java PRE-CREATION trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/AlterTableEvent.java PRE-CREATION trunk/metastore/src/test/org/apache/hadoop/hive/metastore/DummyListener.java 1130342 trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEventListener.java 1130342 Diff: https://reviews.apache.org/r/853/diff Testing --- Added test cases to TestMetaStoreEventListener. Thanks, Sohan
[jira] [Updated] (HIVE-2194) Add actions for alter table and alter partition events for metastore event listeners
[ https://issues.apache.org/jira/browse/HIVE-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2194: - Status: Open (was: Patch Available) Add actions for alter table and alter partition events for metastore event listeners Key: HIVE-2194 URL: https://issues.apache.org/jira/browse/HIVE-2194 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Sohan Jain Assignee: Sohan Jain Attachments: HIVE-2194.1.patch HIVE-2038 introduced the MetaStoreEventListener abstract class that defines actions to be performed after particular events on a metastore. Improve upon that class by adding events to be performed on alter table and alter partition actions. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2194) Add actions for alter table and alter partition events for metastore event listeners
[ https://issues.apache.org/jira/browse/HIVE-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13044041#comment-13044041 ] jirapos...@reviews.apache.org commented on HIVE-2194: - --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/853/#review758 --- trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java https://reviews.apache.org/r/853/#comment1598 This method should either succeed or throw an exception. Since it already throws checked exceptions, adding a boolean return value makes things more complicated for the caller, and signals the same type of failure as an exception but without the ability to include information about what caused the failure. I think it would be better to modify the code so that an exception is always thrown when success==FALSE. This comment also applies to the various alterTable and alterPartition methods located in other classes. - Carl On 2011-06-03 20:20:03, Sohan Jain wrote: bq. bq. --- bq. This is an automatically generated e-mail. To reply, visit: bq. https://reviews.apache.org/r/853/ bq. --- bq. bq. (Updated 2011-06-03 20:20:03) bq. bq. bq. Review request for hive and Paul Yang. bq. bq. bq. Summary bq. --- bq. bq. HIVE-2038 introduced the MetaStoreEventListener abstract class that defines actions to be performed after particular events on a metastore. Improve upon that class by adding events to be performed on alter table and alter partition actions. Also, update the hive metastore to call the appropriate functions of the listeners when the events happen. bq. bq. bq. This addresses bug HIVE-2194. bq. https://issues.apache.org/jira/browse/HIVE-2194 bq. bq. bq. Diffs bq. - bq. bq. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/AlterHandler.java 1130342 bq. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java 1130342 bq. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 1130342 bq. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreEventListener.java 1130342 bq. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 1130342 bq.trunk/metastore/src/java/org/apache/hadoop/hive/metastore/RawStore.java 1130342 bq. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/AlterPartitionEvent.java PRE-CREATION bq. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/events/AlterTableEvent.java PRE-CREATION bq. trunk/metastore/src/test/org/apache/hadoop/hive/metastore/DummyListener.java 1130342 bq. trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestMetaStoreEventListener.java 1130342 bq. bq. Diff: https://reviews.apache.org/r/853/diff bq. bq. bq. Testing bq. --- bq. bq. Added test cases to TestMetaStoreEventListener. bq. bq. bq. Thanks, bq. bq. Sohan bq. bq. Add actions for alter table and alter partition events for metastore event listeners Key: HIVE-2194 URL: https://issues.apache.org/jira/browse/HIVE-2194 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Sohan Jain Assignee: Sohan Jain Attachments: HIVE-2194.1.patch HIVE-2038 introduced the MetaStoreEventListener abstract class that defines actions to be performed after particular events on a metastore. Improve upon that class by adding events to be performed on alter table and alter partition actions. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive Contributor Day
Hey all, I've put together an eventbrite page for this upcoming event: http://hivecontribday2011.eventbrite.com/ (Free signups will be enabled once I've gotten some more info from Yahoo.) If you'd like to give a presentation in the morning, please let me know. These should be geared at helping people get going with Hive hacking, e.g. Do's and don'ts for getting your patch committed. JVS
[jira] [Created] (HIVE-2195) Hive queries hangs with first stage job created with zero mappers and 1 reducer,
Hive queries hangs with first stage job created with zero mappers and 1 reducer, -- Key: HIVE-2195 URL: https://issues.apache.org/jira/browse/HIVE-2195 Project: Hive Issue Type: Bug Affects Versions: 0.7.0 Reporter: vitthal (Suhas) Gogate This happens when query aggregate data w/ predicate selecting bunch of non-existing data partitions. e,g, Table XXX has five columns, A (int), B (int), C(string), date (int) and hour (int), where date/hour are the partition columns, select cast((100*date+hour) as BIGINT) as datehour, sum(A) as sumA, sum(B) as sumB from XXX where date=20110925 and C='test' group by date, hour order by datehour In the above query, make a note that selected date partition range does not exists in hive table i.e. no date partitions for date=20110925 The above query hangs with the first map reduce job it creates, with zero mappers and 1 reducer. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2190) WritableDoubleObjectInspector throws ClassCastException when is used in GenericUDF.
[
https://issues.apache.org/jira/browse/HIVE-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl Steinbach updated HIVE-2190:
-
Fix Version/s: (was: 0.7.1)
WritableDoubleObjectInspector throws ClassCastException when is used in
GenericUDF.
---
Key: HIVE-2190
URL: https://issues.apache.org/jira/browse/HIVE-2190
Project: Hive
Issue Type: Bug
Components: Serializers/Deserializers
Affects Versions: 0.7.0
Environment: Ubuntu 10.10
Reporter: Seoeun Park
Priority: Minor
WritableDoubleObjectInspector throws ClassCastException when I use it in
GenericUDF.
I think it is because the type of DoubleWritable is in
WritableDoubleObjectInspector is org.apache.hadoop.hive.serde2.io instead of
org.apache.hadoop.io.
In WritableDoubleObjectInspector,
org.apache.hadoop.hive.serde2.io.DoubleWritable works fine in GenericUDAF but
not in GenericUDF.
Here, it is query and sample code:
select to_double(1234.11) from src;
{code}
public class GenericUDFToDouble extends GenericUDF {
private ObjectInspectorConverters.Converter[] converters;
private ObjectInspector[] argumentOIs;
private ObjectInspector returnInspector;
@Override
public ObjectInspector initialize(ObjectInspector[] arguments) throws
UDFArgumentException {
converters = new
ObjectInspectorConverters.Converter[arguments.length];
for (int i = 0; i arguments.length; i++) {
converters[i] =
ObjectInspectorConverters.getConverter(arguments[i],
PrimitiveObjectInspectorFactory.writableStringObjectInspector);
}
argumentOIs = arguments;
returnInspector =
PrimitiveObjectInspectorFactory.writableDoubleObjectInspector;
return returnInspector;
}
private DoubleWritable doubleResult = new DoubleWritable();
@Override
public Object evaluate(DeferredObject[] arguments) throws HiveException
{
if (arguments[0].get() == null) {
return null;
}
try {
Text value1 = (Text)
converters[0].convert(arguments[0].get());
doubleResult.set(Double.parseDouble(value1.toString()));
return doubleResult;
} catch (Exception e) {
e.printStackTrace();
return null;
}
}
public String getDisplayString(String[] children) {
return to_double;
}
}
{code}
Exception trace
===
Caused by: java.lang.ClassCastException: org.apache.hadoop.io.DoubleWritable
cannot be cast to org.apache.hadoop.hive.serde2.io.DoubleWritable
at
org.apache.hadoop.hive.serde2.objectinspector.primitive.WritableDoubleObjectInspector.get(WritableDoubleObjectInspector.java:37)
at
org.apache.hadoop.hive.serde2.lazy.LazyUtils.writePrimitiveUTF8(LazyUtils.java:200)
at
org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serialize(LazySimpleSerDe.java:442)
at
org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serializeField(LazySimpleSerDe.java:396)
at
org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe.serialize(LazySimpleSerDe.java:383)
at
org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:553)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:744)
at
org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:744)
at
org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:78)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:744)
at
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:527)
... 5 more
===
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2169) Hive should have support for clover and findbugs
[ https://issues.apache.org/jira/browse/HIVE-2169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2169: - Fix Version/s: (was: 0.7.1) Hive should have support for clover and findbugs Key: HIVE-2169 URL: https://issues.apache.org/jira/browse/HIVE-2169 Project: Hive Issue Type: Improvement Components: Build Infrastructure Reporter: Iyappan Priority: Minor Hive should have support for clover and findbugs. Clover delivers actionable Java code coverage metrics to assess the impact of unit tests. Findbugs is a bug pattern detector for Java. Both of them can give useful information on the code coverage and potential bugs. Clover and findbugs support should be added as ant targets. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2171) Allow custom serdes to set field comments
[
https://issues.apache.org/jira/browse/HIVE-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl Steinbach updated HIVE-2171:
-
Fix Version/s: (was: 0.7.1)
Allow custom serdes to set field comments
-
Key: HIVE-2171
URL: https://issues.apache.org/jira/browse/HIVE-2171
Project: Hive
Issue Type: Improvement
Affects Versions: 0.7.0
Reporter: Jakob Homan
Assignee: Jakob Homan
Attachments: HIVE-2171.patch
Currently, while serde implementations can set a field's name, they can't set
its comment. These are set in the metastore utils to {{(from
deserializer)}}. For those serdes that can provide meaningful comments for a
field, they should be propagated to the table description. These
serde-provided comments could be prepended to (from deserializer) if others
feel that's a meaningful distinction. This change involves updating
{{StructField}} to support a (possibly null) comment field and then
propagating this change out to the myriad places {{StructField}} is thrown
around.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-1990) Logging fails due to moved EventCounter class in Hadoop 0.20.100
[
https://issues.apache.org/jira/browse/HIVE-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl Steinbach updated HIVE-1990:
-
Fix Version/s: (was: 0.6.0)
Logging fails due to moved EventCounter class in Hadoop 0.20.100
Key: HIVE-1990
URL: https://issues.apache.org/jira/browse/HIVE-1990
Project: Hive
Issue Type: Bug
Components: Logging
Affects Versions: 0.6.0
Environment: Red Hat 2.6.18
Reporter: Joep Rottinghuis
Attachments: hive-1990.patch
When compiling Hive against Hadoop 0.20.100 logging on command line and in
unit tests fails due to the EventCounter class being moved from
o.a.h.metrics.jvm.EventCounter to o.a.h.log.EventCounter.
{code}
[junit] Running org.apache.hadoop.hive.serde2.TestTCTLSeparatedProtocol
[junit] log4j:ERROR Could not instantiate class
[org.apache.hadoop.metrics.jvm.EventCounter].
[junit] java.lang.ClassNotFoundException:
org.apache.hadoop.metrics.jvm.EventCounter
[junit] at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
[junit] at java.security.AccessController.doPrivileged(Native Method)
[junit] at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
[junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
[junit] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
[junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
{code}
As a note: In order to re-produce I first applied patch as per HIVE-1264 to
0.6 branch in order to resolve jar naming issues in build.
Then I locally modified the build.properties to my locally built 0.20.100
Hadoop build:
{code}
hadoop.security.url=file:.../hadoop/core/hadoop-${hadoop.version}
hadoop.security.version=${hadoop.version}
{code}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-1992) NCDFE: o.a.commons/configuration/Configuration with Hadoop 0.20.100
[
https://issues.apache.org/jira/browse/HIVE-1992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl Steinbach updated HIVE-1992:
-
Fix Version/s: (was: 0.6.0)
NCDFE: o.a.commons/configuration/Configuration with Hadoop 0.20.100
---
Key: HIVE-1992
URL: https://issues.apache.org/jira/browse/HIVE-1992
Project: Hive
Issue Type: Bug
Components: CLI
Affects Versions: 0.6.0
Environment: Red Hat 2.6.18
Reporter: Joep Rottinghuis
Attachments: commons-configuration-1.6.jar, hive-1992.patch
When compiling Hive against Hadoop 0.20.100 all tests and CLI commands fail
with NoClassDefFoundError: org/apache/commons/configuration/Configuration
(see log output example below):
Hadoop classes depend on commons.configuration which is not available on
classpath with Hive 0.6.
Sample test case failure (one of many):
{code}
test:
[junit] Running org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore
[junit] Unable to open the metastore
[junit] java.lang.NoClassDefFoundError:
org/apache/commons/configuration/Configuration
[junit] at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:37)
[junit] at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.clinit(DefaultMetricsSystem.java:34)
[junit] at
org.apache.hadoop.security.UgiInstrumentation.create(UgiInstrumentation.java:51)
[junit] at
org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:196)
[junit] at
org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:159)
[junit] at
org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:216)
[junit] at
org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:409)
[junit] at
org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:395)
[junit] at
org.apache.hadoop.fs.FileSystem$Cache$Key.init(FileSystem.java:1418)
[junit] at
org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1319)
[junit] at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
[junit] at org.apache.hadoop.fs.Path.getFileSystem(Path.java:183)
[junit] at
org.apache.hadoop.hive.metastore.Warehouse.getFs(Warehouse.java:72)
[junit] at
org.apache.hadoop.hive.metastore.Warehouse.getDnsPath(Warehouse.java:104)
[junit] at
org.apache.hadoop.hive.metastore.Warehouse.getWhRoot(Warehouse.java:119)
{code}
As with HIVE-1990, I first applied HIVE-1264 and tweaked the build.properties
to compile Hive against locally built Hadoop 0.20.100 (see HADOOP-7108).
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1990) Logging fails due to moved EventCounter class in Hadoop 0.20.100
[
https://issues.apache.org/jira/browse/HIVE-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13044115#comment-13044115
]
Ashutosh Chauhan commented on HIVE-1990:
One potential solution is to use shims mechanism to specify different logging
settings for different hadoop versions.
Logging fails due to moved EventCounter class in Hadoop 0.20.100
Key: HIVE-1990
URL: https://issues.apache.org/jira/browse/HIVE-1990
Project: Hive
Issue Type: Bug
Components: Logging
Affects Versions: 0.6.0
Environment: Red Hat 2.6.18
Reporter: Joep Rottinghuis
Attachments: hive-1990.patch
When compiling Hive against Hadoop 0.20.100 logging on command line and in
unit tests fails due to the EventCounter class being moved from
o.a.h.metrics.jvm.EventCounter to o.a.h.log.EventCounter.
{code}
[junit] Running org.apache.hadoop.hive.serde2.TestTCTLSeparatedProtocol
[junit] log4j:ERROR Could not instantiate class
[org.apache.hadoop.metrics.jvm.EventCounter].
[junit] java.lang.ClassNotFoundException:
org.apache.hadoop.metrics.jvm.EventCounter
[junit] at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
[junit] at java.security.AccessController.doPrivileged(Native Method)
[junit] at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
[junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
[junit] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
[junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
{code}
As a note: In order to re-produce I first applied patch as per HIVE-1264 to
0.6 branch in order to resolve jar naming issues in build.
Then I locally modified the build.properties to my locally built 0.20.100
Hadoop build:
{code}
hadoop.security.url=file:.../hadoop/core/hadoop-${hadoop.version}
hadoop.security.version=${hadoop.version}
{code}
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2185) extend table statistics to store the size of uncompressed data (+extend interfaces for collecting other types of statistics)
[ https://issues.apache.org/jira/browse/HIVE-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13044142#comment-13044142 ] Hudson commented on HIVE-2185: -- Integrated in Hive-trunk-h0.21 #759 (See [https://builds.apache.org/hudson/job/Hive-trunk-h0.21/759/]) HIVE-2185. extend table statistics to store the size of uncompressed data (+extend interfaces for collecting other types of statistics) (Tomasz Nykiel via Ning Zhang) nzhang : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1131106 Files : * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsUtils.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/Serializer.java * /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin2.q.out * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinarySerDe.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/binarysortable/BinarySortableSerDe.java * /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin4.q.out * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/thrift/ThriftDeserializer.java * /hive/trunk/contrib/src/java/org/apache/hadoop/hive/contrib/serde2/s3/S3LogDeserializer.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/VirtualColumn.java * /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/TestStatsSerde.java * /hive/trunk/hbase-handler/src/test/results/hbase_stats.q.out * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsPublisher.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/serde2/TestSerDe.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/StatsPublisher.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/SerDeStatsStruct.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/columnar/ColumnarSerDe.java * /hive/trunk/hbase-handler/src/test/results/hbase_stats2.q.out * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsAggregator.java * /hive/trunk/hbase-handler/src/test/queries/hbase_stats.q * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java * /hive/trunk/ql/src/test/results/clientpositive/merge4.q.out * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyStruct.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStatsUtils.java * /hive/trunk/ql/src/test/queries/clientpositive/stats15.q * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/dynamic_type/DynamicSerDe.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/exec/TestStatsPublisher.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/ColumnPrunerProcFactory.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsSetupConstants.java * /hive/trunk/ql/src/test/results/clientpositive/stats14.q.out * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStatsPublisher.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/TableScanOperator.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Stat.java * /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin1.q.out * /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin3.q.out * /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin5.q.out * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSerDe.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/columnar/ColumnarStruct.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/StatsTask.java * /hive/trunk/ql/src/test/results/clientpositive/union22.q.out * /hive/trunk/ql/src/test/results/clientpositive/filter_join_breaktask.q.out * /hive/trunk/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java * /hive/trunk/hbase-handler/src/test/queries/hbase_stats2.q * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java * /hive/trunk/contrib/src/java/org/apache/hadoop/hive/contrib/serde2/RegexSerDe.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/TableScanDesc.java * /hive/trunk/ql/src/test/results/clientpositive/pcr.q.out * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/MetadataTypedColumnsetSerDe.java * /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStatsAggregator.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/exec/TestStatsPublisherEnhanced.java * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/Deserializer.java * /hive/trunk/ql/src/test/results/clientpositive/join_map_ppr.q.out * /hive/trunk/ql/src/test/results/clientpositive/merge3.q.out * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryStruct.java * /hive/trunk/ql/src/test/queries/clientpositive/stats14.q * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/MapOperator.java *
