[jira] [Commented] (HIVE-2646) Hive Ivy dependencies on Hadoop should depend on jars directly, not tarballs
[ https://issues.apache.org/jira/browse/HIVE-2646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254347#comment-13254347 ] Phabricator commented on HIVE-2646: --- thw has commented on the revision HIVE-2646 [jira] Hive Ivy dependencies on Hadoop should depend on jars directly, not tarballs. The following 3 tests fail: testNegativeCliDriver_alter_table_wrong_regex testNegativeCliDriver_create_table_wrong_regex testNegativeCliDriver_udfnull Looks like SerDe/UDFs are not found: ```Caused by: org.apache.hadoop.hive.serde2.SerDeException: SerDe org.apache.hadoop.hive.contrib.serde2.RegexSerDe does not exist at org.apache.hadoop.hive.serde2.SerDeUtils.lookupDeserializer(SerDeUtils.java:85) at org.apache.hadoop.hive.ql.exec.DDLTask.validateSerDe(DDLTask.java:3085)``` ... ```2012-04-15 00:59:58,643 INFO exec.FunctionTask (FunctionTask.java:createFunction(87)) - create function: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.udf.example.UDFExampleArraySum at java.net.URLClassLoader$1.run(URLClassLoader.java:202) ``` REVISION DETAIL https://reviews.facebook.net/D2133 Hive Ivy dependencies on Hadoop should depend on jars directly, not tarballs Key: HIVE-2646 URL: https://issues.apache.org/jira/browse/HIVE-2646 Project: Hive Issue Type: Bug Components: Build Infrastructure Affects Versions: 0.8.0 Reporter: Andrew Bayer Assignee: Andrew Bayer Priority: Critical Fix For: 0.9.0 Attachments: HIVE-2646.D2133.1.patch, HIVE-2646.D2133.10.patch, HIVE-2646.D2133.11.patch, HIVE-2646.D2133.12.patch, HIVE-2646.D2133.13.patch, HIVE-2646.D2133.14.patch, HIVE-2646.D2133.15.patch, HIVE-2646.D2133.2.patch, HIVE-2646.D2133.3.patch, HIVE-2646.D2133.4.patch, HIVE-2646.D2133.5.patch, HIVE-2646.D2133.6.patch, HIVE-2646.D2133.7.patch, HIVE-2646.D2133.8.patch, HIVE-2646.D2133.9.patch, HIVE-2646.diff.txt The current Hive Ivy dependency logic for its Hadoop dependencies is problematic - depending on the tarball and extracting the jars from there, rather than depending on the jars directly. It'd be great if this was fixed to actually have the jar dependencies defined directly. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 1375 - Still Failing
Changes for Build #1374 Changes for Build #1375 1 tests failed. REGRESSION: org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.testSaslWithHiveMetaStore Error Message: null Stack Trace: java.lang.NullPointerException at org.apache.hadoop.hive.metastore.HiveMetaStore.getDelegationToken(HiveMetaStore.java:2871) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.getDelegationTokenStr(TestHadoop20SAuthBridge.java:296) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.obtainTokenAndAddIntoUGI(TestHadoop20SAuthBridge.java:303) at org.apache.hadoop.hive.thrift.TestHadoop20SAuthBridge.testSaslWithHiveMetaStore(TestHadoop20SAuthBridge.java:212) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at junit.framework.TestCase.runTest(TestCase.java:168) at junit.framework.TestCase.runBare(TestCase.java:134) at junit.framework.TestResult$1.protect(TestResult.java:110) at junit.framework.TestResult.runProtected(TestResult.java:128) at junit.framework.TestResult.run(TestResult.java:113) at junit.framework.TestCase.run(TestCase.java:124) at junit.framework.TestSuite.runTest(TestSuite.java:232) at junit.framework.TestSuite.run(TestSuite.java:227) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:518) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052) at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906) The Apache Jenkins build system has built Hive-trunk-h0.21 (build #1375) Status: Still Failing Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/1375/ to view the results.
[jira] [Updated] (HIVE-2736) Hive UDFs cannot emit binary constants
[ https://issues.apache.org/jira/browse/HIVE-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philip Tromans updated HIVE-2736: - Attachment: HIVE-2736.2.patch.txt @Ashutosh - I've added a tiny test query as well. It throws an exception on the unpatched codebase. Let me know if it's sufficient, or if I should write a proper unit test. Hive UDFs cannot emit binary constants -- Key: HIVE-2736 URL: https://issues.apache.org/jira/browse/HIVE-2736 Project: Hive Issue Type: Bug Components: Query Processor, Serializers/Deserializers, UDF Affects Versions: 0.9.0 Reporter: Philip Tromans Assignee: Philip Tromans Priority: Minor Labels: newbie Fix For: 0.9.0 Attachments: HIVE-2736.1.patch.txt, HIVE-2736.2.patch.txt Original Estimate: 4h Remaining Estimate: 4h I recently wrote a UDF which emits BINARY values (as implemented in [HIVE-2380|https://issues.apache.org/jira/browse/HIVE-2380]). When testing this, I encountered the following exception (because I was evaluating f(g(constant string))) and g() was emitting a BytesWritable type. FAILED: Hive Internal Error: java.lang.RuntimeException(Internal error: Cannot find ConstantObjectInspector for BINARY) java.lang.RuntimeException: Internal error: Cannot find ConstantObjectInspector for BINARY at org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorFactory.getPrimitiveWritableConstantObjectInspector(PrimitiveObjectInspectorFactory.java:196) at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorUtils.getConstantObjectInspector(ObjectInspectorUtils.java:899) at org.apache.hadoop.hive.ql.udf.generic.GenericUDF.initializeAndFoldConstants(GenericUDF.java:128) at org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.newInstance(ExprNodeGenericFuncDesc.java:214) at org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.getXpathOrFuncExprNodeDesc(TypeCheckProcFactory.java:684) at org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.process(TypeCheckProcFactory.java:805) at org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:89) at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:88) at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.walk(DefaultGraphWalker.java:125) at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:102) at org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory.genExprNode(TypeCheckProcFactory.java:161) at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc(SemanticAnalyzer.java:7708) at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genSelectPlan(SemanticAnalyzer.java:2301) at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genSelectPlan(SemanticAnalyzer.java:2103) at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPostGroupByBodyPlan(SemanticAnalyzer.java:6126) at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBodyPlan(SemanticAnalyzer.java:6097) at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:6723) at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:7484) at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:243) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:430) at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:337) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:889) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:156) It looks like a pretty simple fix - add a case for BINARY in PrimitiveObjectInspectorFactory.getPrimitiveWritableConstantObjectInspector() and implement a WritableConstantByteArrayObjectInspector class (almost identical to the others). I'm happy to do this, although this is my first foray into the world of contributing to FOSS
[jira] [Commented] (HIVE-2646) Hive Ivy dependencies on Hadoop should depend on jars directly, not tarballs
[ https://issues.apache.org/jira/browse/HIVE-2646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254417#comment-13254417 ] Phabricator commented on HIVE-2646: --- abayer has commented on the revision HIVE-2646 [jira] Hive Ivy dependencies on Hadoop should depend on jars directly, not tarballs. Looks like the ql tests *do* need hive contrib in the classpath, at least for those tests. Hrm. Carl, any thoughts? REVISION DETAIL https://reviews.facebook.net/D2133 Hive Ivy dependencies on Hadoop should depend on jars directly, not tarballs Key: HIVE-2646 URL: https://issues.apache.org/jira/browse/HIVE-2646 Project: Hive Issue Type: Bug Components: Build Infrastructure Affects Versions: 0.8.0 Reporter: Andrew Bayer Assignee: Andrew Bayer Priority: Critical Fix For: 0.9.0 Attachments: HIVE-2646.D2133.1.patch, HIVE-2646.D2133.10.patch, HIVE-2646.D2133.11.patch, HIVE-2646.D2133.12.patch, HIVE-2646.D2133.13.patch, HIVE-2646.D2133.14.patch, HIVE-2646.D2133.15.patch, HIVE-2646.D2133.2.patch, HIVE-2646.D2133.3.patch, HIVE-2646.D2133.4.patch, HIVE-2646.D2133.5.patch, HIVE-2646.D2133.6.patch, HIVE-2646.D2133.7.patch, HIVE-2646.D2133.8.patch, HIVE-2646.D2133.9.patch, HIVE-2646.diff.txt The current Hive Ivy dependency logic for its Hadoop dependencies is problematic - depending on the tarball and extracting the jars from there, rather than depending on the jars directly. It'd be great if this was fixed to actually have the jar dependencies defined directly. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-0.8.1-SNAPSHOT-h0.21 - Build # 254 - Fixed
Changes for Build #253 Changes for Build #254 All tests passed The Apache Jenkins build system has built Hive-0.8.1-SNAPSHOT-h0.21 (build #254) Status: Fixed Check console output at https://builds.apache.org/job/Hive-0.8.1-SNAPSHOT-h0.21/254/ to view the results.
[jira] [Commented] (HIVE-2933) analyze command throw NPE when table doesn't exists
[ https://issues.apache.org/jira/browse/HIVE-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254442#comment-13254442 ] Namit Jain commented on HIVE-2933: -- Can you add a test ? analyze command throw NPE when table doesn't exists --- Key: HIVE-2933 URL: https://issues.apache.org/jira/browse/HIVE-2933 Project: Hive Issue Type: Bug Components: Statistics Affects Versions: 0.8.1 Reporter: alex gemini Priority: Minor Attachments: HIVE-2933-0.8.1-1.patch analyze command throw NPE when table doesn't exists -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2933) analyze command throw NPE when table doesn't exists
[ https://issues.apache.org/jira/browse/HIVE-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2933: - Status: Open (was: Patch Available) analyze command throw NPE when table doesn't exists --- Key: HIVE-2933 URL: https://issues.apache.org/jira/browse/HIVE-2933 Project: Hive Issue Type: Bug Components: Statistics Affects Versions: 0.8.1 Reporter: alex gemini Priority: Minor Attachments: HIVE-2933-0.8.1-1.patch analyze command throw NPE when table doesn't exists -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
ant test fails in Hive
Hi All, After running ant package, if I run ant test fails, I tried all, ant package ant clean package ant -Djavac.debug=on package I cannot run neither all test cases or positive test cases. ant test ant test -Dtestcase=TestCliDriver Both fails, And hive version that I am using is hive 0.8.1. and Operating System is MacOSX Lion. Error when I run ant test, [junit] 2012-04-15 13:16:25.951 java[39626:1803] Unable to load realm info from SCDynamicStore [junit] org.apache.thrift.transport.TTransportException: Could not create ServerSocket on address 0.0.0.0/0.0.0.0:1. [junit] at org.apache.thrift.transport.TServerSocket.init(TServerSocket.java:93) [junit] at org.apache.thrift.transport.TServerSocket.init(TServerSocket.java:75) [junit] at org.apache.hadoop.hive.metastore.TServerSocketKeepAlive.init(TServerSocketKeepAlive.java:34) [junit] at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:2994) [junit] at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:2970) [junit] at org.apache.hadoop.hive.metastore.MetaStoreUtils$1.run(MetaStoreUtils.java:740) [junit] at java.lang.Thread.run(Thread.java:680) [junit] Tests run: 3, Failures: 0, Errors: 2, Time elapsed: 1.235 sec And please tell me how much time it will take to run all test cases. And this is blocking my work. Please help me with this issue. -- Thanks Regards, Srinivasan Some People dream of success.. While others wake up and work hard at it..I am the later.
[jira] [Commented] (HIVE-2904) ant gen-test failed
[ https://issues.apache.org/jira/browse/HIVE-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254453#comment-13254453 ] Namit Jain commented on HIVE-2904: -- Otherwise, it looks good. Will commit after that ant gen-test failed --- Key: HIVE-2904 URL: https://issues.apache.org/jira/browse/HIVE-2904 Project: Hive Issue Type: Bug Affects Versions: 0.8.1 Reporter: Sho Shimauchi Labels: patch Attachments: HIVE-2904.1.patch, HIVE-2904.D2487.1.patch, HIVE-2904.D2487.2.patch When I ran the commands introduced in Getting Started page, ant gen-test failed with the following error. {quote} $ ant gen-test Buildfile: /Users/sho/src/apache/hive/ql/build.xml test-conditions: [echo] Project: ql test-init: [echo] Project: ql [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/data [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/logs/clientpositive [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/logs/clientnegative [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/logs/positive [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/logs/negative [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/data/warehouse [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/data/metadb gen-test: [echo] ql [qtestgen] Template Path:/Users/sho/src/apache/hive/ql/src/test/templates [qtestgen] 2012/03/25 15:27:10 org.apache.velocity.runtime.log.JdkLogChute log [qtestgen] ???: FileResourceLoader : adding path '/Users/sho/src/apache/hive/ql/src/test/templates' [qtestgen] Generated /Users/sho/src/apache/hive/build/ql/test/src/org/apache/hadoop/hive/ql/parse/TestParse.java from template TestParse.vm [qtestgen] Template Path:/Users/sho/src/apache/hive/ql/src/test/templates [qtestgen] 2012/03/25 15:27:10 org.apache.velocity.runtime.log.JdkLogChute log [qtestgen] ???: FileResourceLoader : adding path '/Users/sho/src/apache/hive/ql/src/test/templates' [qtestgen] Generated /Users/sho/src/apache/hive/build/ql/test/src/org/apache/hadoop/hive/ql/parse/TestParseNegative.java from template TestParseNegative.vm [qtestgen] Template Path:/Users/sho/src/apache/hive/ql/src/test/templates [qtestgen] 2012/03/25 15:27:10 org.apache.velocity.runtime.log.JdkLogChute log [qtestgen] ???: FileResourceLoader : adding path '/Users/sho/src/apache/hive/ql/src/test/templates' [qtestgen] Generated /Users/sho/src/apache/hive/build/ql/test/src/org/apache/hadoop/hive/cli/TestCliDriver.java from template TestCliDriver.vm BUILD FAILED /Users/sho/src/apache/hive/ql/build.xml:116: Problem: failed to create task or type if Cause: The name is undefined. Action: Check the spelling. Action: Check that any custom tasks/types have been declared. Action: Check that any presetdef/macrodef declarations have taken place. {quote} Getting Started: https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2942) substr on string containing UTF-8 characters produces StringIndexOutOfBoundsException
[ https://issues.apache.org/jira/browse/HIVE-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254459#comment-13254459 ] Namit Jain commented on HIVE-2942: -- +1 running tests substr on string containing UTF-8 characters produces StringIndexOutOfBoundsException - Key: HIVE-2942 URL: https://issues.apache.org/jira/browse/HIVE-2942 Project: Hive Issue Type: Bug Reporter: Kevin Wilfong Assignee: Kevin Wilfong Attachments: HIVE-2942.D2727.1.patch After HIVE-2792, the substr function produces a StringIndexOutOfBoundsException when called on a string containing UTF-8 characters without the length argument being present. E.g. select substr(str, 1) from table1; now fails with that exception if str contains a UTF-8 character for any row in the table. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2942) substr on string containing UTF-8 characters produces StringIndexOutOfBoundsException
[ https://issues.apache.org/jira/browse/HIVE-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-2942: Resolution: Fixed Fix Version/s: 0.10 Status: Resolved (was: Patch Available) Whoops, forgot to mention that I was running the tests too - sorry Namit. They passed, and I committed. Thanks Kevin! substr on string containing UTF-8 characters produces StringIndexOutOfBoundsException - Key: HIVE-2942 URL: https://issues.apache.org/jira/browse/HIVE-2942 Project: Hive Issue Type: Bug Reporter: Kevin Wilfong Assignee: Kevin Wilfong Fix For: 0.10 Attachments: HIVE-2942.D2727.1.patch After HIVE-2792, the substr function produces a StringIndexOutOfBoundsException when called on a string containing UTF-8 characters without the length argument being present. E.g. select substr(str, 1) from table1; now fails with that exception if str contains a UTF-8 character for any row in the table. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Hive-trunk-h0.21 - Build # 1376 - Still Failing
Changes for Build #1374 Changes for Build #1375 Changes for Build #1376 No tests ran. The Apache Jenkins build system has built Hive-trunk-h0.21 (build #1376) Status: Still Failing Check console output at https://builds.apache.org/job/Hive-trunk-h0.21/1376/ to view the results.
[jira] [Resolved] (HIVE-2934) desc command didn't print correct compression status
[ https://issues.apache.org/jira/browse/HIVE-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] alex gemini resolved HIVE-2934. --- Resolution: Duplicate duplicate with 2250 desc command didn't print correct compression status Key: HIVE-2934 URL: https://issues.apache.org/jira/browse/HIVE-2934 Project: Hive Issue Type: Bug Components: CLI Affects Versions: 0.8.1 Reporter: alex gemini Priority: Minor desc command always print compression status NO , test with lzo compression. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2646) Hive Ivy dependencies on Hadoop should depend on jars directly, not tarballs
[ https://issues.apache.org/jira/browse/HIVE-2646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254493#comment-13254493 ] Phabricator commented on HIVE-2646: --- thw has commented on the revision HIVE-2646 [jira] Hive Ivy dependencies on Hadoop should depend on jars directly, not tarballs. Only udfnull fails after adding back contrib into the test class path (resolves other 2 failures). ``` ant test -Dtestcase=TestNegativeCliDriver -Dqfile=udfnull.q -Dtest.silent=false ``` It looks from the hive history though as if the udfnull queries complete. Could not find out what is wrong with it yet. REVISION DETAIL https://reviews.facebook.net/D2133 Hive Ivy dependencies on Hadoop should depend on jars directly, not tarballs Key: HIVE-2646 URL: https://issues.apache.org/jira/browse/HIVE-2646 Project: Hive Issue Type: Bug Components: Build Infrastructure Affects Versions: 0.8.0 Reporter: Andrew Bayer Assignee: Andrew Bayer Priority: Critical Fix For: 0.9.0 Attachments: HIVE-2646.D2133.1.patch, HIVE-2646.D2133.10.patch, HIVE-2646.D2133.11.patch, HIVE-2646.D2133.12.patch, HIVE-2646.D2133.13.patch, HIVE-2646.D2133.14.patch, HIVE-2646.D2133.15.patch, HIVE-2646.D2133.2.patch, HIVE-2646.D2133.3.patch, HIVE-2646.D2133.4.patch, HIVE-2646.D2133.5.patch, HIVE-2646.D2133.6.patch, HIVE-2646.D2133.7.patch, HIVE-2646.D2133.8.patch, HIVE-2646.D2133.9.patch, HIVE-2646.diff.txt The current Hive Ivy dependency logic for its Hadoop dependencies is problematic - depending on the tarball and extracting the jars from there, rather than depending on the jars directly. It'd be great if this was fixed to actually have the jar dependencies defined directly. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-538) make hive_jdbc.jar self-containing
[ https://issues.apache.org/jira/browse/HIVE-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254511#comment-13254511 ] Phabricator commented on HIVE-538: -- njain has commented on the revision HIVE-538 [jira] make hive_jdbc.jar self-containing. INLINE COMMENTS build.xml:1262 Do you want to change it to jdo*api* REVISION DETAIL https://reviews.facebook.net/D2553 make hive_jdbc.jar self-containing -- Key: HIVE-538 URL: https://issues.apache.org/jira/browse/HIVE-538 Project: Hive Issue Type: Improvement Components: JDBC Affects Versions: 0.3.0, 0.4.0, 0.6.0 Reporter: Raghotham Murthy Assignee: Ashutosh Chauhan Attachments: HIVE-538.D2553.1.patch Currently, most jars in hive/build/dist/lib and the hadoop-*-core.jar are required in the classpath to run jdbc applications on hive. We need to do atleast the following to get rid of most unnecessary dependencies: 1. get rid of dynamic serde and use a standard serialization format, maybe tab separated, json or avro 2. dont use hadoop configuration parameters 3. repackage thrift and fb303 classes into hive_jdbc.jar -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2904) ant gen-test failed
[ https://issues.apache.org/jira/browse/HIVE-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-2904: -- Attachment: HIVE-2904.D2487.3.patch tamtam180 updated the revision HIVE-2904 [jira] ant gen-test failed. Reviewers: JIRA REVISION DETAIL https://reviews.facebook.net/D2487 AFFECTED FILES ql/build.xml ant gen-test failed --- Key: HIVE-2904 URL: https://issues.apache.org/jira/browse/HIVE-2904 Project: Hive Issue Type: Bug Affects Versions: 0.8.1 Reporter: Sho Shimauchi Labels: patch Attachments: HIVE-2904.1.patch, HIVE-2904.D2487.1.patch, HIVE-2904.D2487.2.patch, HIVE-2904.D2487.3.patch When I ran the commands introduced in Getting Started page, ant gen-test failed with the following error. {quote} $ ant gen-test Buildfile: /Users/sho/src/apache/hive/ql/build.xml test-conditions: [echo] Project: ql test-init: [echo] Project: ql [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/data [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/logs/clientpositive [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/logs/clientnegative [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/logs/positive [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/logs/negative [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/data/warehouse [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/data/metadb gen-test: [echo] ql [qtestgen] Template Path:/Users/sho/src/apache/hive/ql/src/test/templates [qtestgen] 2012/03/25 15:27:10 org.apache.velocity.runtime.log.JdkLogChute log [qtestgen] ???: FileResourceLoader : adding path '/Users/sho/src/apache/hive/ql/src/test/templates' [qtestgen] Generated /Users/sho/src/apache/hive/build/ql/test/src/org/apache/hadoop/hive/ql/parse/TestParse.java from template TestParse.vm [qtestgen] Template Path:/Users/sho/src/apache/hive/ql/src/test/templates [qtestgen] 2012/03/25 15:27:10 org.apache.velocity.runtime.log.JdkLogChute log [qtestgen] ???: FileResourceLoader : adding path '/Users/sho/src/apache/hive/ql/src/test/templates' [qtestgen] Generated /Users/sho/src/apache/hive/build/ql/test/src/org/apache/hadoop/hive/ql/parse/TestParseNegative.java from template TestParseNegative.vm [qtestgen] Template Path:/Users/sho/src/apache/hive/ql/src/test/templates [qtestgen] 2012/03/25 15:27:10 org.apache.velocity.runtime.log.JdkLogChute log [qtestgen] ???: FileResourceLoader : adding path '/Users/sho/src/apache/hive/ql/src/test/templates' [qtestgen] Generated /Users/sho/src/apache/hive/build/ql/test/src/org/apache/hadoop/hive/cli/TestCliDriver.java from template TestCliDriver.vm BUILD FAILED /Users/sho/src/apache/hive/ql/build.xml:116: Problem: failed to create task or type if Cause: The name is undefined. Action: Check the spelling. Action: Check that any custom tasks/types have been declared. Action: Check that any presetdef/macrodef declarations have taken place. {quote} Getting Started: https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2904) ant gen-test failed
[ https://issues.apache.org/jira/browse/HIVE-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tamtam180 updated HIVE-2904: Release Note: (was: For this error, You have to download Ant contrib file from http://ant-contrib.sourceforge.net/, And place this ant contrib file in ant installation directory, And add the following line, taskdef resource=net/sf/antcontrib/antcontrib.properties/ to the build.xml file under project name=ql default=jar line. Your ant gen-test will work!!) Status: Patch Available (was: Open) changed as follows - edit only ql/build.xml. - use to ant-contrib-1.0b3.jar from testlibs. ant gen-test failed --- Key: HIVE-2904 URL: https://issues.apache.org/jira/browse/HIVE-2904 Project: Hive Issue Type: Bug Affects Versions: 0.8.1 Reporter: Sho Shimauchi Labels: patch Attachments: HIVE-2904.1.patch, HIVE-2904.D2487.1.patch, HIVE-2904.D2487.2.patch, HIVE-2904.D2487.3.patch When I ran the commands introduced in Getting Started page, ant gen-test failed with the following error. {quote} $ ant gen-test Buildfile: /Users/sho/src/apache/hive/ql/build.xml test-conditions: [echo] Project: ql test-init: [echo] Project: ql [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/data [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/logs/clientpositive [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/logs/clientnegative [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/logs/positive [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/logs/negative [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/data/warehouse [mkdir] Created dir: /Users/sho/src/apache/hive/build/ql/test/data/metadb gen-test: [echo] ql [qtestgen] Template Path:/Users/sho/src/apache/hive/ql/src/test/templates [qtestgen] 2012/03/25 15:27:10 org.apache.velocity.runtime.log.JdkLogChute log [qtestgen] ???: FileResourceLoader : adding path '/Users/sho/src/apache/hive/ql/src/test/templates' [qtestgen] Generated /Users/sho/src/apache/hive/build/ql/test/src/org/apache/hadoop/hive/ql/parse/TestParse.java from template TestParse.vm [qtestgen] Template Path:/Users/sho/src/apache/hive/ql/src/test/templates [qtestgen] 2012/03/25 15:27:10 org.apache.velocity.runtime.log.JdkLogChute log [qtestgen] ???: FileResourceLoader : adding path '/Users/sho/src/apache/hive/ql/src/test/templates' [qtestgen] Generated /Users/sho/src/apache/hive/build/ql/test/src/org/apache/hadoop/hive/ql/parse/TestParseNegative.java from template TestParseNegative.vm [qtestgen] Template Path:/Users/sho/src/apache/hive/ql/src/test/templates [qtestgen] 2012/03/25 15:27:10 org.apache.velocity.runtime.log.JdkLogChute log [qtestgen] ???: FileResourceLoader : adding path '/Users/sho/src/apache/hive/ql/src/test/templates' [qtestgen] Generated /Users/sho/src/apache/hive/build/ql/test/src/org/apache/hadoop/hive/cli/TestCliDriver.java from template TestCliDriver.vm BUILD FAILED /Users/sho/src/apache/hive/ql/build.xml:116: Problem: failed to create task or type if Cause: The name is undefined. Action: Check the spelling. Action: Check that any custom tasks/types have been declared. Action: Check that any presetdef/macrodef declarations have taken place. {quote} Getting Started: https://cwiki.apache.org/confluence/display/Hive/GettingStarted+EclipseSetup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira