Daniel Dai created HIVE-5088:
--------------------------------

             Summary: Fix udf_translate.q on Windows
                 Key: HIVE-5088
                 URL: https://issues.apache.org/jira/browse/HIVE-5088
             Project: Hive
          Issue Type: Bug
          Components: Tests, Windows
            Reporter: Daniel Dai
            Assignee: Daniel Dai
             Fix For: 0.12.0


Test failed with message:
    [junit] Begin query: udf_translate.q
    [junit] 13/08/14 03:23:57 FATAL conf.Configuration: error parsing conf 
file: 
com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException: 
Invalid byte 1 of 1-byte UTF-8 sequence.
    [junit] Exception in thread "main" java.lang.RuntimeException: 
com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException: 
Invalid byte 1 of 1-byte UTF-8 sequence.
    [junit]     at 
org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1255)
    [junit]     at 
org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1117)
    [junit]     at 
org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1053)
    [junit]     at 
org.apache.hadoop.conf.Configuration.get(Configuration.java:397)
    [junit]     at 
org.apache.hadoop.conf.Configuration.getBoolean(Configuration.java:594)
    [junit]     at 
org.apache.hadoop.hive.conf.HiveConf.getBoolVar(HiveConf.java:1015)
    [junit]     at 
org.apache.hadoop.hive.ql.exec.mr.ExecDriver.main(ExecDriver.java:659)
    [junit]     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    [junit]     at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    [junit]     at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    [junit]     at java.lang.reflect.Method.invoke(Method.java:597)
    [junit]     at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
    [junit] Caused by: 
com.sun.org.apache.xerces.internal.impl.io.MalformedByteSequenceException: 
Invalid byte 1 of 1-byte UTF-8 sequence.
    [junit]     at 
com.sun.org.apache.xerces.internal.impl.io.UTF8Reader.invalidByte(UTF8Reader.java:684)
    [junit]     at 
com.sun.org.apache.xerces.internal.impl.io.UTF8Reader.read(UTF8Reader.java:554)
    [junit]     at 
com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.load(XMLEntityScanner.java:1742)
    [junit]     at 
com.sun.org.apache.xerces.internal.impl.XMLEntityScanner.peekChar(XMLEntityScanner.java:487)
    [junit]     at 
com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2688)
    [junit]     at 
com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:647)
    [junit]     at 
com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:140)
    [junit]     at 
com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:511)
    [junit]     at 
com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:808)
    [junit]     at 
com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:737)
    [junit]     at 
com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:119)
    [junit]     at 
com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:232)
    [junit]     at 
com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:284)
    [junit]     at 
javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:124)
    [junit]     at 
org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1181)
    [junit]     ... 11 more
    [junit] Exception: Client Execution failed with error code = 1
    [junit] See build/ql/tmp/hive.log, or try "ant test ... 
-Dtest.silent=false" to get more logs.
    [junit] junit.framework.AssertionFailedError: Client Execution failed with 
error code = 1
    [junit] See build/ql/tmp/hive.log, or try "ant test ... 
-Dtest.silent=false" to get more logs.
    [junit]     at junit.framework.Assert.fail(Assert.java:47)
    [junit]     at 
org.apache.hadoop.hive.cli.TestCliDriver.runTest(TestCliDriver.java:122)
    [junit]     at 
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_translate(TestCliDriver.java:104)
    [junit]     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    [junit]     at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    [junit]     at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    [junit]     at java.lang.reflect.Method.invoke(Method.java:597)
    [junit]     at junit.framework.TestCase.runTest(TestCase.java:154)
    [junit]     at junit.framework.TestCase.runBare(TestCase.java:127)
    [junit]     at junit.framework.TestResult$1.protect(TestResult.java:106)
    [junit]     at junit.framework.TestResult.runProtected(TestResult.java:124)
    [junit]     at junit.framework.TestResult.run(TestResult.java:109)
    [junit]     at junit.framework.TestCase.run(TestCase.java:118)
    [junit]     at junit.framework.TestSuite.runTest(TestSuite.java:208)
    [junit]     at junit.framework.TestSuite.run(TestSuite.java:203)
    [junit]     at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:520)
    [junit]     at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1060)
    [junit]     at 
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:911)
    [junit] Failed query: udf_translate.q

Whether or not get exception is environment dependent. But even no exception 
thrown, we still get wrong characters written to job.conf.

There is a similar bug on Hadoop side: HADOOP-9801

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to