[jira] [Updated] (HIVE-12976) MetaStoreDirectSql doesn't batch IN lists in all cases
[
https://issues.apache.org/jira/browse/HIVE-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gopal V updated HIVE-12976:
---
Description:
That means that some RDBMS products with arbitrary limits cannot run these
queries. I hope HBase metastore comes soon and delivers us from Oracle! For
now, though, we have to fix this.
{code}
hive> select * from lineitem where l_orderkey = 121201;
Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The incoming
request has too many parameters. The server supports a maximum of 2100
parameters. Reduce the number of parameters and resend the request.
at
com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:215)
~[sqljdbc41.jar:?]
at
com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1635)
~[sqljdbc41.jar:?]
at
com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:426)
~[sqljdbc41.jar:?]
{code}
{code}
at
org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:543)
~[datanucleus-api-jdo-4.2.1.jar:?]
at org.datanucleus.api.jdo.JDOQuery.executeInternal(JDOQuery.java:388)
~[datanucleus-api-jdo-4.2.1.jar:?]
at org.datanucleus.api.jdo.JDOQuery.executeWithArray(JDOQuery.java:264)
~[datanucleus-api-jdo-4.2.1.jar:?]
at
org.apache.hadoop.hive.metastore.MetaStoreDirectSql.executeWithArray(MetaStoreDirectSql.java:1681)
[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at
org.apache.hadoop.hive.metastore.MetaStoreDirectSql.partsFoundForPartitions(MetaStoreDirectSql.java:1266)
[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at
org.apache.hadoop.hive.metastore.MetaStoreDirectSql.aggrColStatsForPartitions(MetaStoreDirectSql.java:1196)
[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at
org.apache.hadoop.hive.metastore.ObjectStore$9.getSqlResult(ObjectStore.java:6742)
[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at
org.apache.hadoop.hive.metastore.ObjectStore$9.getSqlResult(ObjectStore.java:6738)
[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at
org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.run(ObjectStore.java:2525)
[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
at
org.apache.hadoop.hive.metastore.ObjectStore.get_aggr_stats_for(ObjectStore.java:6738)
[hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
{code}
was:That means that some RDBMS products with arbitrary limits cannot run
these queries. I hope HBase metastore comes soon and delivers us from Oracle!
For now, though, we have to fix this.
> MetaStoreDirectSql doesn't batch IN lists in all cases
> --
>
> Key: HIVE-12976
> URL: https://issues.apache.org/jira/browse/HIVE-12976
> Project: Hive
> Issue Type: Bug
>Reporter: Gopal V
>Assignee: Sergey Shelukhin
> Attachments: HIVE-12976.01.patch, HIVE-12976.02.patch,
> HIVE-12976.patch
>
>
> That means that some RDBMS products with arbitrary limits cannot run these
> queries. I hope HBase metastore comes soon and delivers us from Oracle! For
> now, though, we have to fix this.
> {code}
> hive> select * from lineitem where l_orderkey = 121201;
> Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The incoming
> request has too many parameters. The server supports a maximum of 2100
> parameters. Reduce the number of parameters and resend the request.
> at
> com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:215)
> ~[sqljdbc41.jar:?]
> at
> com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1635)
> ~[sqljdbc41.jar:?]
> at
> com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:426)
> ~[sqljdbc41.jar:?]
> {code}
> {code}
> at
> org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:543)
> ~[datanucleus-api-jdo-4.2.1.jar:?]
> at
> org.datanucleus.api.jdo.JDOQuery.executeInternal(JDOQuery.java:388)
> ~[datanucleus-api-jdo-4.2.1.jar:?]
> at
> org.datanucleus.api.jdo.JDOQuery.executeWithArray(JDOQuery.java:264)
> ~[datanucleus-api-jdo-4.2.1.jar:?]
> at
> org.apache.hadoop.hive.metastore.MetaStoreDirectSql.executeWithArray(MetaStoreDirectSql.java:1681)
> [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.MetaStoreDirectSql.partsFoundForPartitions(MetaStoreDirectSql.java:1266)
> [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.MetaStoreDirectSql.aggrColStatsForPartitions(MetaStoreDirectSql.java:1196)
>
[jira] [Updated] (HIVE-12976) MetaStoreDirectSql doesn't batch IN lists in all cases
[
https://issues.apache.org/jira/browse/HIVE-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sergey Shelukhin updated HIVE-12976:
Fix Version/s: 2.1.0
> MetaStoreDirectSql doesn't batch IN lists in all cases
> --
>
> Key: HIVE-12976
> URL: https://issues.apache.org/jira/browse/HIVE-12976
> Project: Hive
> Issue Type: Bug
>Reporter: Gopal V
>Assignee: Sergey Shelukhin
> Fix For: 2.1.0
>
> Attachments: HIVE-12976.01.patch, HIVE-12976.02.patch,
> HIVE-12976.patch
>
>
> That means that some RDBMS products with arbitrary limits cannot run these
> queries. I hope HBase metastore comes soon and delivers us from Oracle! For
> now, though, we have to fix this.
> {code}
> hive> select * from lineitem where l_orderkey = 121201;
> Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The incoming
> request has too many parameters. The server supports a maximum of 2100
> parameters. Reduce the number of parameters and resend the request.
> at
> com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:215)
> ~[sqljdbc41.jar:?]
> at
> com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1635)
> ~[sqljdbc41.jar:?]
> at
> com.microsoft.sqlserver.jdbc.SQLServerPreparedStatement.doExecutePreparedStatement(SQLServerPreparedStatement.java:426)
> ~[sqljdbc41.jar:?]
> {code}
> {code}
> at
> org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:543)
> ~[datanucleus-api-jdo-4.2.1.jar:?]
> at
> org.datanucleus.api.jdo.JDOQuery.executeInternal(JDOQuery.java:388)
> ~[datanucleus-api-jdo-4.2.1.jar:?]
> at
> org.datanucleus.api.jdo.JDOQuery.executeWithArray(JDOQuery.java:264)
> ~[datanucleus-api-jdo-4.2.1.jar:?]
> at
> org.apache.hadoop.hive.metastore.MetaStoreDirectSql.executeWithArray(MetaStoreDirectSql.java:1681)
> [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.MetaStoreDirectSql.partsFoundForPartitions(MetaStoreDirectSql.java:1266)
> [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.MetaStoreDirectSql.aggrColStatsForPartitions(MetaStoreDirectSql.java:1196)
> [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.ObjectStore$9.getSqlResult(ObjectStore.java:6742)
> [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.ObjectStore$9.getSqlResult(ObjectStore.java:6738)
> [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.run(ObjectStore.java:2525)
> [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.ObjectStore.get_aggr_stats_for(ObjectStore.java:6738)
> [hive-exec-2.1.0-SNAPSHOT.jar:2.1.0-SNAPSHOT]
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HIVE-12976) MetaStoreDirectSql doesn't batch IN lists in all cases
[ https://issues.apache.org/jira/browse/HIVE-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-12976: Attachment: HIVE-12976.02.patch Fixed > MetaStoreDirectSql doesn't batch IN lists in all cases > -- > > Key: HIVE-12976 > URL: https://issues.apache.org/jira/browse/HIVE-12976 > Project: Hive > Issue Type: Bug >Reporter: Gopal V >Assignee: Sergey Shelukhin > Attachments: HIVE-12976.01.patch, HIVE-12976.02.patch, > HIVE-12976.patch > > > That means that some RDBMS products with arbitrary limits cannot run these > queries. I hope HBase metastore comes soon and delivers us from Oracle! For > now, though, we have to fix this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12976) MetaStoreDirectSql doesn't batch IN lists in all cases
[ https://issues.apache.org/jira/browse/HIVE-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-12976: Attachment: HIVE-12976.01.patch Hmm, I could swear I updated this path... oh well. > MetaStoreDirectSql doesn't batch IN lists in all cases > -- > > Key: HIVE-12976 > URL: https://issues.apache.org/jira/browse/HIVE-12976 > Project: Hive > Issue Type: Bug >Reporter: Gopal V >Assignee: Sergey Shelukhin > Attachments: HIVE-12976.01.patch, HIVE-12976.patch > > > That means that some RDBMS products with arbitrary limits cannot run these > queries. I hope HBase metastore comes soon and delivers us from Oracle! For > now, though, we have to fix this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12976) MetaStoreDirectSql doesn't batch IN lists in all cases
[ https://issues.apache.org/jira/browse/HIVE-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-12976: Attachment: HIVE-12976.patch Add batching to everything. > MetaStoreDirectSql doesn't batch IN lists in all cases > -- > > Key: HIVE-12976 > URL: https://issues.apache.org/jira/browse/HIVE-12976 > Project: Hive > Issue Type: Bug >Reporter: Gopal V >Assignee: Sergey Shelukhin > Attachments: HIVE-12976.patch > > > That means that some RDBMS products with arbitrary limits cannot run these > queries. I hope HBase metastore comes soon and delivers us from Oracle! For > now, though, we have to fix this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12976) MetaStoreDirectSql doesn't batch IN lists in all cases
[ https://issues.apache.org/jira/browse/HIVE-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-12976: Attachment: HIVE-12976.patch > MetaStoreDirectSql doesn't batch IN lists in all cases > -- > > Key: HIVE-12976 > URL: https://issues.apache.org/jira/browse/HIVE-12976 > Project: Hive > Issue Type: Bug >Reporter: Gopal V >Assignee: Sergey Shelukhin > Attachments: HIVE-12976.patch > > > That means that some RDBMS products with arbitrary limits cannot run these > queries. I hope HBase metastore comes soon and delivers us from Oracle! For > now, though, we have to fix this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12976) MetaStoreDirectSql doesn't batch IN lists in all cases
[ https://issues.apache.org/jira/browse/HIVE-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-12976: Attachment: (was: HIVE-12976.patch) > MetaStoreDirectSql doesn't batch IN lists in all cases > -- > > Key: HIVE-12976 > URL: https://issues.apache.org/jira/browse/HIVE-12976 > Project: Hive > Issue Type: Bug >Reporter: Gopal V >Assignee: Sergey Shelukhin > Attachments: HIVE-12976.patch > > > That means that some RDBMS products with arbitrary limits cannot run these > queries. I hope HBase metastore comes soon and delivers us from Oracle! For > now, though, we have to fix this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
