Re: Getting upper bound in --incremental mode

2017-07-20 Thread Jagrut Sharma
Hi Markus - I'm using Sqoop v1, but with a custom metastore (not the one that Sqoop provides). My original question was on deriving the --last-value based on table column values (and not time of job execution). Thanks. -- Jagrut On Thu, Jul 20, 2017 at 2:48 PM, Markus Kemper

Re: Getting upper bound in --incremental mode

2017-07-20 Thread Markus Kemper
Hey Jagrut, Are you using the Sqoop1 Metastore job tool (assuming yes)? Are you wanting to override the current stored --last-value when executing the Sqoop job? Markus Kemper Customer Operations Engineer [image: www.cloudera.com] On Thu, Jul 20, 2017 at 5:16 PM,

Re: Getting upper bound in --incremental mode

2017-07-20 Thread Jagrut Sharma
Hi Markus - The question was that --incremental with --lastmodified option always takes the current time as the upper bound, and this gets stored as the --last-value for the next run. In certain cases, it is desirable that the upper bound should come from the actual column values, and that should

Changing behavior on trunk

2017-07-20 Thread Anna Szonyi
Hi @dev list, Jilani has created a great patch for SQOOP-3149 : Sqoop incremental import - NULL column updates are not pulled into HBase table. This is a patch that (in my opinion) corrects previously incorrect behavior in sqoop, however it can

Re: Review Request 59346: SQOOP-3178 : Incremental Merging for Parquet File Format

2017-07-20 Thread Anna Szonyi
> On July 20, 2017, 5:40 p.m., Anna Szonyi wrote: > > Hi Sandish, > > > > Thanks for all the changes, they aid readability a lot! I found a missing > > semicolon, other than that the tests seem to be running and everything is > > green. > > > > Thanks, > > Anna Also please create the next

Re: Review Request 59346: SQOOP-3178 : Incremental Merging for Parquet File Format

2017-07-20 Thread Sandish Kumar HN
> On July 20, 2017, 5:40 p.m., Anna Szonyi wrote: > > Hi Sandish, > > > > Thanks for all the changes, they aid readability a lot! I found a missing > > semicolon, other than that the tests seem to be running and everything is > > green. > > > > Thanks, > > Anna > > Anna Szonyi wrote: >

Re: Review Request 59346: SQOOP-3178 : Incremental Merging for Parquet File Format

2017-07-20 Thread Sandish Kumar HN
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/59346/ --- (Updated July 20, 2017, 5:46 p.m.) Review request for Sqoop, Boglarka Egyed,

Re: Review Request 59346: SQOOP-3178 : Incremental Merging for Parquet File Format

2017-07-20 Thread Anna Szonyi
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/59346/#review181060 --- Hi Sandish, Thanks for all the changes, they aid readability a

[jira] [Commented] (SQOOP-3042) Sqoop does not clear compile directory under /tmp/sqoop-/compile automatically

2017-07-20 Thread Markus Kemper (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094664#comment-16094664 ] Markus Kemper commented on SQOOP-3042: -- As a possible workaround the Sqoop Environment script could

Re: Issue with sqoop

2017-07-20 Thread Akshay shet
When the split by done on the max and min value. the max value has single quotes within the data. Sent with Mailtrack On Wed, Jul 19, 2017 at 9:36 PM, Akshay shet