Re: Building Sqoop 1.4.7 from git repo

2018-02-09 Thread Greg Lindholm
should work. At least it works on my > machine :) > > Szabolcs > > On Thu, Feb 8, 2018 at 4:11 PM, Greg Lindholm <greg.lindh...@gmail.com> > wrote: > >> I'm attempting to build Sqoop 1.4.7 from the git repo using branch-1.4.7. >>

Sqoop import with HCatalog on AWS EMR

2018-02-14 Thread Greg Lindholm
Hi Sqoop Users, I was attempting to Sqoop import with HCat on an AWS EMR cluster. I was importing from a MySQL database and writing to a S3 location. sudo sqoop import \ --connect jdbc:mysql://xxx.us-east-2.compute.amazonaws.com:3306/test1 \ --username xxx -P\ --table sampledata1 \

Building Sqoop 1.4.7 from git repo

2018-02-08 Thread Greg Lindholm
I'm attempting to build Sqoop 1.4.7 from the git repo using branch-1.4.7. I'm getting errors that class SqoopVersion is not found. There is no org.apache.sqoop.SqoopVersion.java file. Can anyone help? Thanks /Greg

Sqoop with Hcat integration on AWS EMR with AWS Glue Data Catalog

2018-02-22 Thread Greg Lindholm
Has anyone managed to get Sqoop with hcatalog integration working on AWS EMR when Hive is configured to use AWS Glue Data Catalog? I'm attempting to import from a MySQL db into Hive on an AWS EMR cluster. Hive is configured to use AWS Glue Data Catalog as the metadata catalog. sqoop import \

Re: --schema option in connection to DB2 database.

2018-04-25 Thread Greg Lindholm
>From the documentation it appears that the --schema option is only available for PostgreSQL and Microsoft SQL, there is no mention of it for DB2. I've been using Sqoop with DB2 and have not needed this option, you can qualify the table with the schema name like this "--table MYSCHEMA.MYTABLE".

Re: Why the sequence file generated using sqoop contains only one type?

2018-03-22 Thread Greg Lindholm
Why are you using Sequence files? Sequence files are binary key/value stores, I haven't used them but it sounds from the docs that each 'value' is a record, so one type sounds correct. You might consider trying Textfile or ORC? You might get better results. /Greg On Thu, Mar 22, 2018 at 10:06