Hi Eduardo You’re correct, there are no column names returned at that point of the Job setup. (The docs make no mention that this should happen, so it wasn’t obvious that I should expect it)
Also - Yes, this is sqoop2. I didn’t know it was deprecated, so I’ll spend a few minutes investigating the connection in sqoop2, and revert to sqoop 1 if I can’t find the problem. Is there any version of sqoop 1 that you recommend I should use? Thanks again. Tony From: Eduardo Mello [mailto:eedu.me...@gmail.com] Sent: 02 January 2018 17:20 To: user@sqoop.apache.org Subject: Re: please revise your input? Is this ofuscated? "Column names: There are currently 0 values in the list:" Seems like your connection does not return anything, can u check your connection? Are you running Sqoop2? Major companies like Cloudera/MapR/Hortonworks are deprecating Sqoop2 and recommend using Sqoop 1 ( example of warning of "sqoop2 deprecated" https://www.cloudera.com/documentation/enterprise/5-6-x/topics/cdh_ig_sqoop2_configure.html). Att, Eduardo Mello On Tue, Jan 2, 2018 at 2:33 PM, Tony Burton <tbur...@sportingsolutions.com<mailto:tbur...@sportingsolutions.com>> wrote: Hi Eduardo, Thanks for the reply. I’m not running a sqoop command yet, I’m setting up the Job object as described in the link below. Because I can never get further than the error message “There are issues with entered data, please revise your input:”, I can’t proceed to run the job, and without further guidance on what input to revise, I don’t know how to complete the creation of my Job object. Can you see anything wrong with the details I have entered? Here’s a copy of the info I’m entering (a blank line means I’ve entered hit CR at that prompt, also I have obfuscated my schema, table and column names for this email): sqoop:000> create job -f "sqoop-link-redshift" -t "sqoop-link-hdfs" Creating job for links with from name sqoop-link-redshift and to name sqoop-link-hdfs Please fill following values to create new job object Name: sqoop-job-import-test Database source Schema name: sqoop Table name: sqoop SQL statement: select distinct [field] from [schema].[table] where [date field]>20180101 and ${CONDITIONS}; Column names: There are currently 0 values in the list: element# Partition column: Partition column nullable: Boundary query: Incremental read Check column: Last value: Target configuration Override null value: Null value: File format: 0 : TEXT_FILE 1 : SEQUENCE_FILE 2 : PARQUET_FILE Choose: 0 Compression codec: 0 : NONE 1 : DEFAULT 2 : DEFLATE 3 : GZIP 4 : BZIP2 5 : LZO 6 : LZ4 7 : SNAPPY 8 : CUSTOM Choose: 0 Custom codec: 0 Output directory: /user/hadoop/redshift Append mode: Throttling resources Extractors: Loaders: Classpath configuration Extra mapper jars: There are currently 0 values in the list: element# There are issues with entered data, please revise your input: Name: sqoop-job-import-test Thanks! Tony From: Eduardo Mello [mailto:eedu.me...@gmail.com<mailto:eedu.me...@gmail.com>] Sent: 02 January 2018 13:43 To: user@sqoop.apache.org<mailto:user@sqoop.apache.org> Subject: Re: please revise your input? Hello Tony, Can u please send the sqoop command (or an example) that are u using? Att, Eduardo Mello On Tue, Jan 2, 2018 at 8:37 AM, Tony Burton <tbur...@sportingsolutions.com<mailto:tbur...@sportingsolutions.com>> wrote: Hi, Anyone got any suggestions for this? Thanks! Tony From: Tony Burton [mailto:tbur...@sportingsolutions.com<mailto:tbur...@sportingsolutions.com>] Sent: 19 December 2017 15:10 To: user@sqoop.apache.org<mailto:user@sqoop.apache.org> Subject: please revise your input? Hi, I’m using sqoop 1.99.7 with hadoop 2.6.4 for the first time, and I’m having trouble setting up a sqoop job. I’ve successfully created a couple of links, one is a JDCB connection to an AWS Redshift database, the other an HDFS connection to a local Hadoop installation. I’m following the guidelines at http://sqoop.apache.org/docs/1.99.7/user/Sqoop5MinutesDemo.html#creating-job-object and https://sqoop.apache.org/docs/1.99.7/user/CommandLineClient.html, and I am entering a simple sql command (select distinct [field] from [schema].[table] where date>[date] and ${CONDITIONS}) , a file format (text), a compression codec (none), and an output directory (/user/hadoop/redshift). When all the data is entered, I get the error message “There are issues with entered data, please revise your input:” How do I find out what is wrong, and what I need to change? Are there any non-optional parameters that I need to enter? Thanks, Tony Tony Burton e: tbur...@sportingindex.com<mailto:tbur...@sportingindex.com> [https://media.sportingindex.com/zmsmedia/vsporting%20index/rebrand/sportingsolutions_logotype_rgb_v2.png]<https://www.sportingsolutions.com/> This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Group nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Conduct Authority (reg. no. 150404) and UK Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd. Sporting Solutions is the trading name of SPIN Services Ltd, a company registered in England and Wales with company number 06268648, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Group nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Conduct Authority (reg. no. 150404) and UK Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd. Sporting Solutions is the trading name of SPIN Services Ltd, a company registered in England and Wales with company number 06268648, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Group nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Conduct Authority (reg. no. 150404) and UK Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd. Sporting Solutions is the trading name of SPIN Services Ltd, a company registered in England and Wales with company number 06268648, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. This email and any attachments are confidential, protected by copyright and may be legally privileged. If you are not the intended recipient, then the dissemination or copying of this email is prohibited. If you have received this in error, please notify the sender by replying by email and then delete the email completely from your system. Neither Sporting Group nor the sender accepts responsibility for any virus, or any other defect which might affect any computer or IT system into which the email is received and/or opened. It is the responsibility of the recipient to scan the email and no responsibility is accepted for any loss or damage arising in any way from receipt or use of this email. Sporting Index Ltd is a company registered in England and Wales with company number 2636842, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP. Sporting Index Ltd is authorised and regulated by the UK Financial Conduct Authority (reg. no. 150404) and UK Gambling Commission (reg. no. 000-027343-R-308898-001). Any financial promotion contained herein has been issued and approved by Sporting Index Ltd. Sporting Solutions is the trading name of SPIN Services Ltd, a company registered in England and Wales with company number 06268648, whose registered office is at Gateway House, Milverton Street, London, SE11 4AP.
