Re: Secure sqoop transfer

2017-03-14 Thread Attila Szabó
Hey Jagrut,

Do you have a specific RDBMS you'd like to use, or would you like to do it
in a generic way?

If A. You should check the specific JDBC driver for the driver/transport
level encryption options/properties, and feed it to the env execution your
Sqoop command (Sqoop itself right now cannot, and IMHO should not implement
it's own encryption solutions, as it has to happen on JDBC level).
if B. AFAIK there is no general solution for this in case of JDBC supported
Databases, but you could try to setup a secure + encrypted VPN network,
which will solve this to you out of the box.

My 2 cents,
Attila


On Tue, Mar 14, 2017 at 6:22 PM, Jagrut Sharma 
wrote:

> I'm trying to figure out if there is a way to do encrypted data transfer
> between the source rdbms system and cluster when importing data via sqoop
> (version 1.4.6). Any pointers would be helpful.
>
> Thanks!
>
> --
> Jagrut
>


Secure sqoop transfer

2017-03-14 Thread Jagrut Sharma
I'm trying to figure out if there is a way to do encrypted data transfer
between the source rdbms system and cluster when importing data via sqoop
(version 1.4.6). Any pointers would be helpful.

Thanks!

-- 
Jagrut


[jira] [Commented] (SQOOP-3100) Clean up expected exception logic in tests - part III.

2017-03-14 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924152#comment-15924152
 ] 

Hudson commented on SQOOP-3100:
---

SUCCESS: Integrated in Jenkins build Sqoop-hadoop100 #1058 (See 
[https://builds.apache.org/job/Sqoop-hadoop100/1058/])
SQOOP-3100: Clean up expected exception logic in tests - part III. (maugli: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git=commit=150843b26414ece3d9076c56c7d9caed63529380])
* (edit) ivy/libraries.properties
* (edit) src/test/com/cloudera/sqoop/metastore/TestSavedJobs.java
* (edit) src/test/com/cloudera/sqoop/TestIncrementalImport.java
* (edit) src/test/com/cloudera/sqoop/lib/TestRecordParser.java
* (edit) src/test/com/cloudera/sqoop/orm/TestClassWriter.java
Revert "SQOOP-3100: Clean up expected exception logic in tests - part (maugli: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git=commit=a5ae802388fb1dc1af74678e99311506f31d0a20])
* (edit) src/test/com/cloudera/sqoop/orm/TestClassWriter.java
* (edit) src/test/com/cloudera/sqoop/lib/TestRecordParser.java
* (edit) src/test/com/cloudera/sqoop/TestIncrementalImport.java
* (edit) src/test/com/cloudera/sqoop/metastore/TestSavedJobs.java
* (edit) ivy/libraries.properties
SQOOP-3100: Clean up expected exception logic in tests - part III. (maugli: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git=commit=281a87aed2a21d69e74e05ceb38b5e553f7b16de])
* (edit) src/test/com/cloudera/sqoop/lib/TestRecordParser.java
* (edit) ivy/libraries.properties
* (edit) src/test/com/cloudera/sqoop/metastore/TestSavedJobs.java
* (edit) src/test/com/cloudera/sqoop/orm/TestClassWriter.java
* (edit) src/test/com/cloudera/sqoop/TestIncrementalImport.java


> Clean up expected exception logic in tests - part III.
> --
>
> Key: SQOOP-3100
> URL: https://issues.apache.org/jira/browse/SQOOP-3100
> Project: Sqoop
>  Issue Type: Sub-task
>Affects Versions: 1.4.6
>Reporter: Boglarka Egyed
>Assignee: Boglarka Egyed
>Priority: Minor
> Attachments: SQOOP-3100.patch, SQOOP-3100.patch
>
>
> Test classes affected by this ticket:
> * TestIncrementalImport
> * TestClassWriter
> * TestRecordParser
> * TestSacedJobs
> * LobFileStressTest



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (SQOOP-3100) Clean up expected exception logic in tests - part III.

2017-03-14 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924108#comment-15924108
 ] 

Hudson commented on SQOOP-3100:
---

SUCCESS: Integrated in Jenkins build Sqoop-hadoop23 #1296 (See 
[https://builds.apache.org/job/Sqoop-hadoop23/1296/])
Revert "SQOOP-3100: Clean up expected exception logic in tests - part (maugli: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git=commit=a5ae802388fb1dc1af74678e99311506f31d0a20])
* (edit) src/test/com/cloudera/sqoop/orm/TestClassWriter.java
* (edit) src/test/com/cloudera/sqoop/metastore/TestSavedJobs.java
* (edit) src/test/com/cloudera/sqoop/TestIncrementalImport.java
* (edit) src/test/com/cloudera/sqoop/lib/TestRecordParser.java
* (edit) ivy/libraries.properties
SQOOP-3100: Clean up expected exception logic in tests - part III. (maugli: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git=commit=281a87aed2a21d69e74e05ceb38b5e553f7b16de])
* (edit) src/test/com/cloudera/sqoop/TestIncrementalImport.java
* (edit) ivy/libraries.properties
* (edit) src/test/com/cloudera/sqoop/metastore/TestSavedJobs.java
* (edit) src/test/com/cloudera/sqoop/orm/TestClassWriter.java
* (edit) src/test/com/cloudera/sqoop/lib/TestRecordParser.java


> Clean up expected exception logic in tests - part III.
> --
>
> Key: SQOOP-3100
> URL: https://issues.apache.org/jira/browse/SQOOP-3100
> Project: Sqoop
>  Issue Type: Sub-task
>Affects Versions: 1.4.6
>Reporter: Boglarka Egyed
>Assignee: Boglarka Egyed
>Priority: Minor
> Attachments: SQOOP-3100.patch, SQOOP-3100.patch
>
>
> Test classes affected by this ticket:
> * TestIncrementalImport
> * TestClassWriter
> * TestRecordParser
> * TestSacedJobs
> * LobFileStressTest



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (SQOOP-3100) Clean up expected exception logic in tests - part III.

2017-03-14 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924105#comment-15924105
 ] 

Hudson commented on SQOOP-3100:
---

SUCCESS: Integrated in Jenkins build Sqoop-hadoop20 #1095 (See 
[https://builds.apache.org/job/Sqoop-hadoop20/1095/])
Revert "SQOOP-3100: Clean up expected exception logic in tests - part (maugli: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git=commit=a5ae802388fb1dc1af74678e99311506f31d0a20])
* (edit) ivy/libraries.properties
* (edit) src/test/com/cloudera/sqoop/lib/TestRecordParser.java
* (edit) src/test/com/cloudera/sqoop/TestIncrementalImport.java
* (edit) src/test/com/cloudera/sqoop/orm/TestClassWriter.java
* (edit) src/test/com/cloudera/sqoop/metastore/TestSavedJobs.java
SQOOP-3100: Clean up expected exception logic in tests - part III. (maugli: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git=commit=281a87aed2a21d69e74e05ceb38b5e553f7b16de])
* (edit) src/test/com/cloudera/sqoop/TestIncrementalImport.java
* (edit) src/test/com/cloudera/sqoop/lib/TestRecordParser.java
* (edit) src/test/com/cloudera/sqoop/metastore/TestSavedJobs.java
* (edit) src/test/com/cloudera/sqoop/orm/TestClassWriter.java
* (edit) ivy/libraries.properties


> Clean up expected exception logic in tests - part III.
> --
>
> Key: SQOOP-3100
> URL: https://issues.apache.org/jira/browse/SQOOP-3100
> Project: Sqoop
>  Issue Type: Sub-task
>Affects Versions: 1.4.6
>Reporter: Boglarka Egyed
>Assignee: Boglarka Egyed
>Priority: Minor
> Attachments: SQOOP-3100.patch, SQOOP-3100.patch
>
>
> Test classes affected by this ticket:
> * TestIncrementalImport
> * TestClassWriter
> * TestRecordParser
> * TestSacedJobs
> * LobFileStressTest



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (SQOOP-3100) Clean up expected exception logic in tests - part III.

2017-03-14 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924084#comment-15924084
 ] 

Hudson commented on SQOOP-3100:
---

SUCCESS: Integrated in Jenkins build Sqoop-hadoop200 #1099 (See 
[https://builds.apache.org/job/Sqoop-hadoop200/1099/])
SQOOP-3100: Clean up expected exception logic in tests - part III. (maugli: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git=commit=150843b26414ece3d9076c56c7d9caed63529380])
* (edit) src/test/com/cloudera/sqoop/lib/TestRecordParser.java
* (edit) src/test/com/cloudera/sqoop/TestIncrementalImport.java
* (edit) src/test/com/cloudera/sqoop/orm/TestClassWriter.java
* (edit) ivy/libraries.properties
* (edit) src/test/com/cloudera/sqoop/metastore/TestSavedJobs.java
Revert "SQOOP-3100: Clean up expected exception logic in tests - part (maugli: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git=commit=a5ae802388fb1dc1af74678e99311506f31d0a20])
* (edit) src/test/com/cloudera/sqoop/metastore/TestSavedJobs.java
* (edit) src/test/com/cloudera/sqoop/TestIncrementalImport.java
* (edit) src/test/com/cloudera/sqoop/lib/TestRecordParser.java
* (edit) ivy/libraries.properties
* (edit) src/test/com/cloudera/sqoop/orm/TestClassWriter.java
SQOOP-3100: Clean up expected exception logic in tests - part III. (maugli: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git=commit=281a87aed2a21d69e74e05ceb38b5e553f7b16de])
* (edit) ivy/libraries.properties
* (edit) src/test/com/cloudera/sqoop/lib/TestRecordParser.java
* (edit) src/test/com/cloudera/sqoop/metastore/TestSavedJobs.java
* (edit) src/test/com/cloudera/sqoop/orm/TestClassWriter.java
* (edit) src/test/com/cloudera/sqoop/TestIncrementalImport.java


> Clean up expected exception logic in tests - part III.
> --
>
> Key: SQOOP-3100
> URL: https://issues.apache.org/jira/browse/SQOOP-3100
> Project: Sqoop
>  Issue Type: Sub-task
>Affects Versions: 1.4.6
>Reporter: Boglarka Egyed
>Assignee: Boglarka Egyed
>Priority: Minor
> Attachments: SQOOP-3100.patch, SQOOP-3100.patch
>
>
> Test classes affected by this ticket:
> * TestIncrementalImport
> * TestClassWriter
> * TestRecordParser
> * TestSacedJobs
> * LobFileStressTest



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (SQOOP-3100) Clean up expected exception logic in tests - part III.

2017-03-14 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924050#comment-15924050
 ] 

Hudson commented on SQOOP-3100:
---

SUCCESS: Integrated in Jenkins build Sqoop-hadoop23 #1295 (See 
[https://builds.apache.org/job/Sqoop-hadoop23/1295/])
SQOOP-3100: Clean up expected exception logic in tests - part III. (maugli: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git=commit=150843b26414ece3d9076c56c7d9caed63529380])
* (edit) src/test/com/cloudera/sqoop/orm/TestClassWriter.java
* (edit) src/test/com/cloudera/sqoop/lib/TestRecordParser.java
* (edit) src/test/com/cloudera/sqoop/metastore/TestSavedJobs.java
* (edit) ivy/libraries.properties
* (edit) src/test/com/cloudera/sqoop/TestIncrementalImport.java


> Clean up expected exception logic in tests - part III.
> --
>
> Key: SQOOP-3100
> URL: https://issues.apache.org/jira/browse/SQOOP-3100
> Project: Sqoop
>  Issue Type: Sub-task
>Affects Versions: 1.4.6
>Reporter: Boglarka Egyed
>Assignee: Boglarka Egyed
>Priority: Minor
> Attachments: SQOOP-3100.patch, SQOOP-3100.patch
>
>
> Test classes affected by this ticket:
> * TestIncrementalImport
> * TestClassWriter
> * TestRecordParser
> * TestSacedJobs
> * LobFileStressTest



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (SQOOP-3100) Clean up expected exception logic in tests - part III.

2017-03-14 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924046#comment-15924046
 ] 

Hudson commented on SQOOP-3100:
---

SUCCESS: Integrated in Jenkins build Sqoop-hadoop20 #1094 (See 
[https://builds.apache.org/job/Sqoop-hadoop20/1094/])
SQOOP-3100: Clean up expected exception logic in tests - part III. (maugli: 
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git=commit=150843b26414ece3d9076c56c7d9caed63529380])
* (edit) ivy/libraries.properties
* (edit) src/test/com/cloudera/sqoop/orm/TestClassWriter.java
* (edit) src/test/com/cloudera/sqoop/TestIncrementalImport.java
* (edit) src/test/com/cloudera/sqoop/lib/TestRecordParser.java
* (edit) src/test/com/cloudera/sqoop/metastore/TestSavedJobs.java


> Clean up expected exception logic in tests - part III.
> --
>
> Key: SQOOP-3100
> URL: https://issues.apache.org/jira/browse/SQOOP-3100
> Project: Sqoop
>  Issue Type: Sub-task
>Affects Versions: 1.4.6
>Reporter: Boglarka Egyed
>Assignee: Boglarka Egyed
>Priority: Minor
> Attachments: SQOOP-3100.patch, SQOOP-3100.patch
>
>
> Test classes affected by this ticket:
> * TestIncrementalImport
> * TestClassWriter
> * TestRecordParser
> * TestSacedJobs
> * LobFileStressTest



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (SQOOP-3100) Clean up expected exception logic in tests - part III.

2017-03-14 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924038#comment-15924038
 ] 

ASF subversion and git services commented on SQOOP-3100:


Commit 281a87aed2a21d69e74e05ceb38b5e553f7b16de in sqoop's branch 
refs/heads/trunk from [~maugli]
[ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=281a87a ]

SQOOP-3100: Clean up expected exception logic in tests - part III.

(Boglarka Egyed via Attila Szabo)


> Clean up expected exception logic in tests - part III.
> --
>
> Key: SQOOP-3100
> URL: https://issues.apache.org/jira/browse/SQOOP-3100
> Project: Sqoop
>  Issue Type: Sub-task
>Affects Versions: 1.4.6
>Reporter: Boglarka Egyed
>Assignee: Boglarka Egyed
>Priority: Minor
> Attachments: SQOOP-3100.patch, SQOOP-3100.patch
>
>
> Test classes affected by this ticket:
> * TestIncrementalImport
> * TestClassWriter
> * TestRecordParser
> * TestSacedJobs
> * LobFileStressTest



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (SQOOP-3100) Clean up expected exception logic in tests - part III.

2017-03-14 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924037#comment-15924037
 ] 

ASF subversion and git services commented on SQOOP-3100:


Commit a5ae802388fb1dc1af74678e99311506f31d0a20 in sqoop's branch 
refs/heads/trunk from [~maugli]
[ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=a5ae802 ]

Revert "SQOOP-3100: Clean up expected exception logic in tests - part III."

This reverts commit 150843b26414ece3d9076c56c7d9caed63529380.

I've mistakenly committed the previous change with incorrect author
information, and would not like to break any toolchain by rewriting the
history, thus I'm reverting this, and committing again the change with
proper header information

(Attila Szabo)


> Clean up expected exception logic in tests - part III.
> --
>
> Key: SQOOP-3100
> URL: https://issues.apache.org/jira/browse/SQOOP-3100
> Project: Sqoop
>  Issue Type: Sub-task
>Affects Versions: 1.4.6
>Reporter: Boglarka Egyed
>Assignee: Boglarka Egyed
>Priority: Minor
> Attachments: SQOOP-3100.patch, SQOOP-3100.patch
>
>
> Test classes affected by this ticket:
> * TestIncrementalImport
> * TestClassWriter
> * TestRecordParser
> * TestSacedJobs
> * LobFileStressTest



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (SQOOP-3100) Clean up expected exception logic in tests - part III.

2017-03-14 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924019#comment-15924019
 ] 

ASF subversion and git services commented on SQOOP-3100:


Commit 150843b26414ece3d9076c56c7d9caed63529380 in sqoop's branch 
refs/heads/trunk from [~maugli]
[ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=150843b ]

SQOOP-3100: Clean up expected exception logic in tests - part III.

(Boglarka Egyed via Attila Szabo)


> Clean up expected exception logic in tests - part III.
> --
>
> Key: SQOOP-3100
> URL: https://issues.apache.org/jira/browse/SQOOP-3100
> Project: Sqoop
>  Issue Type: Sub-task
>Affects Versions: 1.4.6
>Reporter: Boglarka Egyed
>Assignee: Boglarka Egyed
>Priority: Minor
> Attachments: SQOOP-3100.patch, SQOOP-3100.patch
>
>
> Test classes affected by this ticket:
> * TestIncrementalImport
> * TestClassWriter
> * TestRecordParser
> * TestSacedJobs
> * LobFileStressTest



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


Re: Review Request 55466: Clean up expected exception logic in tests - part III.

2017-03-14 Thread Attila Szabo

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/55466/#review168886
---


Ship it!




Ship It!

- Attila Szabo


On Feb. 27, 2017, 8:01 p.m., Boglarka Egyed wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/55466/
> ---
> 
> (Updated Feb. 27, 2017, 8:01 p.m.)
> 
> 
> Review request for Sqoop, Attila Szabo, Anna Szonyi, and Liz Szilagyi.
> 
> 
> Bugs: SQOOP-3100
> https://issues.apache.org/jira/browse/SQOOP-3100
> 
> 
> Repository: sqoop-trunk
> 
> 
> Description
> ---
> 
> Normalizing test cases where we except an exception using JUnit's 
> ExpectedException rule to make the code more clean and self-explanatory.
> 
> 
> Diffs
> -
> 
>   ivy/libraries.properties 05baa5cb46a841bbd686e950e575129820e7fcf2 
>   src/test/com/cloudera/sqoop/TestIncrementalImport.java 
> 57f4433d8f50b37f102a8a8ada7196d9287b5557 
>   src/test/com/cloudera/sqoop/lib/TestRecordParser.java 
> 57bdb5fe057f74dcaef9e2e3d6e1d26d3af7833a 
>   src/test/com/cloudera/sqoop/metastore/TestSavedJobs.java 
> 1fb732439dd2c8f187af726935a335c993895bc5 
>   src/test/com/cloudera/sqoop/orm/TestClassWriter.java 
> a27353df4ed84a7dfe7612662f3170c00951d2cf 
> 
> 
> Diff: https://reviews.apache.org/r/55466/diff/3/
> 
> 
> Testing
> ---
> 
> ant test, ant clean test
> 
> 
> Thanks,
> 
> Boglarka Egyed
> 
>



[jira] [Commented] (SQOOP-3100) Clean up expected exception logic in tests - part III.

2017-03-14 Thread Boglarka Egyed (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923992#comment-15923992
 ] 

Boglarka Egyed commented on SQOOP-3100:
---

[~maugli] could you please kindly review my latest patch? Thank you very much 
in advance!

> Clean up expected exception logic in tests - part III.
> --
>
> Key: SQOOP-3100
> URL: https://issues.apache.org/jira/browse/SQOOP-3100
> Project: Sqoop
>  Issue Type: Sub-task
>Affects Versions: 1.4.6
>Reporter: Boglarka Egyed
>Assignee: Boglarka Egyed
>Priority: Minor
> Attachments: SQOOP-3100.patch, SQOOP-3100.patch
>
>
> Test classes affected by this ticket:
> * TestIncrementalImport
> * TestClassWriter
> * TestRecordParser
> * TestSacedJobs
> * LobFileStressTest



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (SQOOP-3059) sqoop import into hive converting decimals to decimals

2017-03-14 Thread Eric Lin (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923954#comment-15923954
 ] 

Eric Lin commented on SQOOP-3059:
-

I believe this is duplicate of SQOOP-2272, which has a patch already on the way.

> sqoop import into hive converting decimals to decimals
> --
>
> Key: SQOOP-3059
> URL: https://issues.apache.org/jira/browse/SQOOP-3059
> Project: Sqoop
>  Issue Type: Improvement
>  Components: hive-integration
> Environment: Redhat 6.6, Sqoop 1.4.6
>Reporter: Ying Cao
>Priority: Minor
>
> By default sqoop import into hive converting decimals to double, Decimal type 
> provide more accurate values wider range than Double, so by default way some 
> data will be truncated.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (SQOOP-3149) Sqoop incremental import - NULL column updates are not pulled into HBase table

2017-03-14 Thread Szabolcs Vasas (JIRA)

[ 
https://issues.apache.org/jira/browse/SQOOP-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923930#comment-15923930
 ] 

Szabolcs Vasas commented on SQOOP-3149:
---

Hi [~jilani],

Thank you for your contribution! To make the review process easier can you 
please create a review on https://reviews.apache.org ?

Thanks,
Szabolcs

> Sqoop incremental import -  NULL column updates are not pulled into HBase 
> table
> ---
>
> Key: SQOOP-3149
> URL: https://issues.apache.org/jira/browse/SQOOP-3149
> Project: Sqoop
>  Issue Type: Bug
>  Components: connectors/generic, hbase-integration
>Affects Versions: 1.4.6
>Reporter: Jilani Shaik
> Attachments: hbase_delete_support_in_incremental_import
>
>
> Sqoop incremental import data from any database to HBase, if source table's 
> column from a row is updated to NULL, then target HBase table still showing 
> the previous value for that column. 
> So if you do a scan on the table for that row, HBase shows the previous 
> values of the column.
> Expected Result: Sqoop incremental import, If NULL columns are there in 
> source, then HBase need not store that and if it already exists need to 
> delete that column for a given row.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


Re: Support object store

2017-03-14 Thread Attila Szabó
Hey Angela,

AFAIK if you connect your S3 bucket under HDFS then it works out of the box.
Does this solution fit your requirements or are you looking for something
different/more specific?

Cheers,
Attila

On Tue, Mar 14, 2017 at 2:59 AM, Ying Cao  wrote:

> Hi Expert,
>
> Does Sqoop support object store? For example Amazon S3?
>
> Angela
>