[jira] [Comment Edited] (SQOOP-2192) SQOOP IMPORT/EXPORT for the ORC file HIVE TABLE Failing

2017-03-28 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945318#comment-15945318 ] Ruslan Dautkhanov edited comment on SQOOP-2192 at 3/28/17 2:59 PM

[jira] [Commented] (SQOOP-2192) SQOOP IMPORT/EXPORT for the ORC file HIVE TABLE Failing

2017-03-28 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945318#comment-15945318 ] Ruslan Dautkhanov commented on SQOOP-2192: -- [~venkatnrangan], I understand this part for `sqoop

[jira] [Commented] (SQOOP-2192) SQOOP IMPORT/EXPORT for the ORC file HIVE TABLE Failing

2017-03-28 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945263#comment-15945263 ] Ruslan Dautkhanov commented on SQOOP-2192: -- [~akshatthakar], SQOOP-931 is fixed in 1.4.4

[jira] [Created] (SQOOP-3032) `setBindValueAtName() may need to be updated to cope with the data-type: 1` in --verbose output fills logs

2016-10-19 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created SQOOP-3032: Summary: `setBindValueAtName() may need to be updated to cope with the data-type: 1` in --verbose output fills logs Key: SQOOP-3032 URL: https://issues.apache.org/jira

[jira] [Commented] (SQOOP-3030) Export to Oracle using (--direct + --hcatalog + --columns) with columns having the wrong case sensitivity fails with NPE

2016-10-18 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587519#comment-15587519 ] Ruslan Dautkhanov commented on SQOOP-3030: -- Hi [~markuskem...@me.com], {quote} unfortunately

[jira] [Resolved] (SQOOP-3022) sqoop export for Oracle generates tremendous amounts of redo logs

2016-10-18 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov resolved SQOOP-3022. -- Resolution: Not A Bug > sqoop export for Oracle generates tremendous amounts of r

[jira] [Commented] (SQOOP-3022) sqoop export for Oracle generates tremendous amounts of redo logs

2016-10-18 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587504#comment-15587504 ] Ruslan Dautkhanov commented on SQOOP-3022: -- Was able to test now. Mid-run on one of the mappers

[jira] [Commented] (SQOOP-3030) Export to Oracle using (--direct + --hcatalog + --columns) with columns having the wrong case sensitivity fails with NPE

2016-10-18 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586552#comment-15586552 ] Ruslan Dautkhanov commented on SQOOP-3030: -- thank you [~markuskem...@me.com] > Export to Ora

[jira] [Resolved] (SQOOP-3025) Oracle Direct export from HCatalog parquet table gives NPE in kerberized cluster

2016-10-18 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov resolved SQOOP-3025. -- Resolution: Duplicate underlying problem is SQOOP-3030 > Oracle Direct export f

[jira] [Commented] (SQOOP-2907) Export parquet files to RDBMS: don't require .metadata for parquet files

2016-10-17 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583729#comment-15583729 ] Ruslan Dautkhanov commented on SQOOP-2907: -- Any workarounds for this? Is any way we can generate

[jira] [Commented] (SQOOP-3025) Oracle Direct export from HCatalog parquet table gives NPE in kerberized cluster

2016-10-17 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15582881#comment-15582881 ] Ruslan Dautkhanov commented on SQOOP-3025: -- Thank you [~markuskem...@me.com] Our configs match

[jira] [Commented] (SQOOP-2907) Export parquet files to RDBMS: don't require .metadata for parquet files

2016-10-16 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15580833#comment-15580833 ] Ruslan Dautkhanov commented on SQOOP-2907: -- See last comment from [~b...@cloudera.com] at https

[jira] [Commented] (SQOOP-3025) Oracle Direct export from HCatalog parquet table gives NPE in kerberized cluster

2016-10-16 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15580186#comment-15580186 ] Ruslan Dautkhanov commented on SQOOP-3025: -- It looks like sqoop export breaks when it is used

[jira] [Commented] (SQOOP-3022) sqoop export for Oracle generates tremendous amounts of redo logs

2016-10-15 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15578492#comment-15578492 ] Ruslan Dautkhanov commented on SQOOP-3022: -- Hi [~maugli], I still wasn't able to run tests yet

[jira] [Commented] (SQOOP-3025) Oracle Direct export from HCatalog parquet table gives NPE in kerberized cluster

2016-10-15 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15578439#comment-15578439 ] Ruslan Dautkhanov commented on SQOOP-3025: -- Notice in the full log {quote

[jira] [Updated] (SQOOP-3025) Oracle Direct export from HCatalog parquet table gives NPE in kerberized cluster

2016-10-15 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SQOOP-3025: - Description: Getting following exception in one of the mappers stack when try to export

[jira] [Updated] (SQOOP-3025) Oracle Direct export from HCatalog parquet table gives NPE in kerberized cluster

2016-10-15 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SQOOP-3025: - Description: Getting following exception in one of the mappers stack when try to export

[jira] [Updated] (SQOOP-3025) Oracle Direct export from HCatalog parquet table gives NPE in kerberized cluster

2016-10-15 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SQOOP-3025: - Attachment: scoop_output.log > Oracle Direct export from HCatalog parquet table gives

[jira] [Comment Edited] (SQOOP-3025) Oracle Direct export from HCatalog parquet table gives NPE in kerberized cluster

2016-10-15 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15578380#comment-15578380 ] Ruslan Dautkhanov edited comment on SQOOP-3025 at 10/15/16 4:25 PM

[jira] [Updated] (SQOOP-3025) Oracle Direct export from HCatalog parquet table gives NPE in kerberized cluster

2016-10-15 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SQOOP-3025: - Attachment: sqoop_OracleDirect_mapper_nullPointer_exception.txt full log from failed

[jira] [Created] (SQOOP-3025) Oracle Direct export from HCatalog parquet table gives NPE in kerberized cluster

2016-10-15 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created SQOOP-3025: Summary: Oracle Direct export from HCatalog parquet table gives NPE in kerberized cluster Key: SQOOP-3025 URL: https://issues.apache.org/jira/browse/SQOOP-3025

[jira] [Commented] (SQOOP-3022) sqoop export for Oracle generates tremendous amounts of redo logs

2016-10-14 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577394#comment-15577394 ] Ruslan Dautkhanov commented on SQOOP-3022: -- [~markuskem...@me.com] helped me to find problem

[jira] [Created] (SQOOP-3024) add reference to oraoop.drop.table in documentation

2016-10-14 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created SQOOP-3024: Summary: add reference to oraoop.drop.table in documentation Key: SQOOP-3024 URL: https://issues.apache.org/jira/browse/SQOOP-3024 Project: Sqoop

[jira] [Commented] (SQOOP-3022) sqoop export for Oracle generates tremendous amounts of redo logs

2016-10-14 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576227#comment-15576227 ] Ruslan Dautkhanov commented on SQOOP-3022: -- I wasn't able yet to test that.. OraOOP is manager

[jira] [Commented] (SQOOP-3022) sqoop export for Oracle generates tremendous amounts of redo logs

2016-10-13 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573571#comment-15573571 ] Ruslan Dautkhanov commented on SQOOP-3022: -- Thank you [~maugli], I will definitely try and report

[jira] [Commented] (SQOOP-3022) sqoop export for Oracle generates tremendous amounts of redo logs

2016-10-12 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570941#comment-15570941 ] Ruslan Dautkhanov commented on SQOOP-3022: -- Thanks a lot [~david.robson]. Yes

[jira] [Commented] (SQOOP-3022) sqoop export for Oracle generates tremendous amounts of redo logs

2016-10-11 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567026#comment-15567026 ] Ruslan Dautkhanov commented on SQOOP-3022: -- Hi [~maugli], Thank you for pointing to addBatch

[jira] [Commented] (SQOOP-3022) sqoop export for Oracle generates tremendous amounts of redo logs

2016-10-07 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1869#comment-1869 ] Ruslan Dautkhanov commented on SQOOP-3022: -- It's not only a syntax sugar, it allows to save you

[jira] [Commented] (SQOOP-3022) sqoop export for Oracle generates tremendous amounts of redo logs

2016-10-06 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553578#comment-15553578 ] Ruslan Dautkhanov commented on SQOOP-3022: -- You're right on APPEND_VALUES hint. Thank you

[jira] [Commented] (SQOOP-3022) sqoop export for Oracle generates tremendous amounts of redo logs

2016-10-06 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553213#comment-15553213 ] Ruslan Dautkhanov commented on SQOOP-3022: -- I found this comment in source code https

[jira] [Commented] (SQOOP-3022) sqoop export for Oracle generates tremendous amounts of redo logs

2016-10-06 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553153#comment-15553153 ] Ruslan Dautkhanov commented on SQOOP-3022: -- Thank you Attila for your prompt response

[jira] [Created] (SQOOP-3022) sqoop export for Oracle generates tremendous amounts of redo logs

2016-10-06 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created SQOOP-3022: Summary: sqoop export for Oracle generates tremendous amounts of redo logs Key: SQOOP-3022 URL: https://issues.apache.org/jira/browse/SQOOP-3022 Project

[jira] [Commented] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-09-12 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485109#comment-15485109 ] Ruslan Dautkhanov commented on SQOOP-2981: -- {quote}Hi Ruslan, This is a courtesy follow-up

[jira] [Commented] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-08-09 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15413926#comment-15413926 ] Ruslan Dautkhanov commented on SQOOP-2981: -- Asked Rosmari to follow up directly here as they've

[jira] [Commented] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-07-29 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400131#comment-15400131 ] Ruslan Dautkhanov commented on SQOOP-2981: -- Thank you [~maugli]. Understood - thanks for looking

[jira] [Commented] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-07-15 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379526#comment-15379526 ] Ruslan Dautkhanov commented on SQOOP-2981: -- [~maugli], Rosmari from Oracle (SR 3-12981378661

[jira] [Commented] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-07-07 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15366712#comment-15366712 ] Ruslan Dautkhanov commented on SQOOP-2981: -- {quote} Sure, I can definitely test it here. Before

[jira] [Issue Comment Deleted] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-07-07 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SQOOP-2981: - Comment: was deleted (was: Created Oracle Support request to investigate this from Oracle

[jira] [Commented] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-07-07 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15366688#comment-15366688 ] Ruslan Dautkhanov commented on SQOOP-2981: -- Created Oracle Support request to investigate

[jira] [Commented] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-07-07 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15366687#comment-15366687 ] Ruslan Dautkhanov commented on SQOOP-2981: -- Created Oracle Support request to investigate

[jira] [Commented] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-07-07 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15366248#comment-15366248 ] Ruslan Dautkhanov commented on SQOOP-2981: -- Btw, I tried using --direct and not using

[jira] [Comment Edited] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-07-06 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365060#comment-15365060 ] Ruslan Dautkhanov edited comment on SQOOP-2981 at 7/6/16 9:06 PM: -- Hi

[jira] [Comment Edited] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-07-06 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365060#comment-15365060 ] Ruslan Dautkhanov edited comment on SQOOP-2981 at 7/6/16 8:57 PM: -- Hi

[jira] [Commented] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-07-06 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365060#comment-15365060 ] Ruslan Dautkhanov commented on SQOOP-2981: -- Hi [~maugli], Thanks a lot for prompt response

[jira] [Updated] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-07-05 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SQOOP-2981: - Description: Majority of time spent of sqoop import from Oracle was on converting Decimal

[jira] [Updated] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-07-05 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SQOOP-2981: - Description: Majority of time spent of sqoop import from Oracle was on converting Decimal

[jira] [Created] (SQOOP-2981) sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu

2016-07-05 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created SQOOP-2981: Summary: sqoop import from jdbc: JdbcWritableBridge.readBigDecimal() takes a ton of cpu Key: SQOOP-2981 URL: https://issues.apache.org/jira/browse/SQOOP-2981

[jira] [Updated] (SQOOP-2920) sqoop performance deteriorates significantly on wide datasets; sqoop 100% on cpu

2016-05-18 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SQOOP-2920: - Affects Version/s: 1.4.6 > sqoop performance deteriorates significantly on wide datas

[jira] [Commented] (SQOOP-2920) sqoop performance deteriorates significantly on wide datasets; sqoop 100% on cpu

2016-05-13 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283033#comment-15283033 ] Ruslan Dautkhanov commented on SQOOP-2920: -- Thank you [~maugli] for the patch. We tested

Re: Review Request 47108: Proposed changes for SQOOP-2920

2016-05-12 Thread Ruslan Dautkhanov
=486723493888 Total committed heap usage (bytes)=281407389696 That's a great improvement. - Ruslan Dautkhanov On May 9, 2016, 7:14 a.m., Attila Szabo wrote: > > --- > This is an automatically generated e-mail. To reply, visit

[jira] [Created] (SQOOP-2921) support for nested data types

2016-05-06 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created SQOOP-2921: Summary: support for nested data types Key: SQOOP-2921 URL: https://issues.apache.org/jira/browse/SQOOP-2921 Project: Sqoop Issue Type: New Feature

Re: sqoop performance gets 20x slower on very wide datasets

2016-05-03 Thread Ruslan Dautkhanov
uld please have a look into this? -- Ruslan Dautkhanov On Mon, May 2, 2016 at 11:09 PM, Ruslan Dautkhanov <dautkha...@gmail.com> wrote: > https://issues.apache.org/jira/browse/SQOOP-2920 > > Has anybody experienced this problem before? > Is any known workaround? > > We sq

sqoop performance gets 20x slower on very wide datasets

2016-05-02 Thread Ruslan Dautkhanov
f CPU time. Or 11219.57 per mapper. Which is roughly 3.11 hours of CPU time per mapper. So they are 100% on cpu. -- Ruslan Dautkhanov

[jira] [Commented] (SQOOP-2920) sqoop performance deteriorates significantly on wide datasets; sqoop 100% on cpu

2016-05-02 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15267668#comment-15267668 ] Ruslan Dautkhanov commented on SQOOP-2920: -- unified_dim in the above profiling output is name

[jira] [Commented] (SQOOP-2920) sqoop performance deteriorates significantly on wide datasets; sqoop 100% on cpu

2016-05-02 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15267641#comment-15267641 ] Ruslan Dautkhanov commented on SQOOP-2920: -- Ran JvmTop profiler for a couple of minutes on one

[jira] [Updated] (SQOOP-2920) sqoop performance deteriorates significantly on wide datasets; sqoop 100% on cpu

2016-05-02 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SQOOP-2920: - Environment: - sqoop export on a very wide dataset (over 700 columns) - sqoop export

[jira] [Updated] (SQOOP-2920) sqoop performance deteriorates significantly on wide datasets; sqoop 100% on cpu

2016-05-02 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SQOOP-2920: - Attachment: top - sqoop mappers hog cpu.png > sqoop performance deteriora

[jira] [Commented] (SQOOP-2920) sqoop performance deteriorates significantly on wide datasets; sqoop 100% on cpu

2016-05-02 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15267121#comment-15267121 ] Ruslan Dautkhanov commented on SQOOP-2920: -- This is CDH 5.5.2. > sqoop performance deteriora

[jira] [Updated] (SQOOP-2920) sqoop performance deteriorates significantly on wide datasets; sqoop 100% on cpu

2016-05-02 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SQOOP-2920: - Attachment: jstack.zip > sqoop performance deteriorates significantly on wide datas

[jira] [Created] (SQOOP-2920) sqoop performance deteriorates significantly on wide datasets; sqoop 100% on cpu

2016-05-02 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created SQOOP-2920: Summary: sqoop performance deteriorates significantly on wide datasets; sqoop 100% on cpu Key: SQOOP-2920 URL: https://issues.apache.org/jira/browse/SQOOP-2920

[jira] [Commented] (SQOOP-2907) Export parquet files to RDBMS: don't require .metadata for parquet files

2016-04-11 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SQOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236616#comment-15236616 ] Ruslan Dautkhanov commented on SQOOP-2907: -- https://issues.cloudera.org/browse/KITE-1121 "

[jira] [Created] (SQOOP-2907) Export parquet files to RDBMS: don't require .metadata for parquet files

2016-04-11 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created SQOOP-2907: Summary: Export parquet files to RDBMS: don't require .metadata for parquet files Key: SQOOP-2907 URL: https://issues.apache.org/jira/browse/SQOOP-2907