sqoop column terminator "fields-terminated-by" needs to work with any of the 
following '\007', '0x7', '^G'
----------------------------------------------------------------------------------------------------------

                 Key: SQOOP-446
                 URL: https://issues.apache.org/jira/browse/SQOOP-446
             Project: Sqoop
          Issue Type: Bug
          Components: tools
    Affects Versions: 1.3.0
         Environment: currently using sqoop 1.3.x our data is UTF8 and since we 
have columns with most of the ascii keyboard char, it would be best to use the 
Bell char '\007'
            Reporter: mark monroe
            Priority: Minor



here is the command

sqoop export -conf /opt/hadoop/sqoop/sqoop-pdw-1.0/conf/pdwp.xml -libjars 
$SQOOP_HOME/lib/commons-net-2.2.jar 
-Dmapreduce.task.classpath.user.precedence=true --connect pdw://10.230.25.1 
--username ETL_TEST --password ***** --table 
OPS_TEST_DB.dbo.PROTO_TEST_FAILING_PINS_sqoop -m 1 --export-dir /tmp/mm_test3 
--input-fields-terminated-by "\007"


here is the error....

12/02/24 12:11:43 ERROR tool.ExportTool: Encountered IOException running export 
job: org.apache.hadoop.ipc.RemoteException: java.io.IOException: 
java.lang.RuntimeException: org.xml.sax.SAXParseException: Character reference 
"&#7" is an invalid XML character.
        at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3766)
        at sun.reflect.GeneratedMethodAccessor18.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1434)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1430)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1428)
Caused by: java.lang.RuntimeException: org.xml.sax.SAXParseException: Character 
reference "&#7" is an invalid XML character.
        at 
org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1393)
        at 
org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:1261)
        at 
org.apache.hadoop.conf.Configuration.getProps(Configuration.java:1192)
        at org.apache.hadoop.conf.Configuration.get(Configuration.java:415)
        at 
org.apache.hadoop.mapred.JobConf.checkAndWarnDeprecation(JobConf.java:1957)
        at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:386)
        at org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:414)
        at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3764)
        ... 10 more
Caused by: org.xml.sax.SAXParseException: Character reference "&#7" is an 
invalid XML character.
        at 
com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:249)
        at 
com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:284)
        at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:124)
        at 
org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:1313)
        ... 17 more


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to