[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15176796#comment-15176796 ] Hudson commented on PHOENIX-1973: - FAILURE: Integrated in Phoenix-master #1165 (See

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15176209#comment-15176209 ] James Taylor commented on PHOENIX-1973: --- I filed PHOENIX-2733 for this cleanup. Would be great if

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15176190#comment-15176190 ] Gabriel Reid commented on PHOENIX-1973: --- My personal preference would be to wait until the

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15175900#comment-15175900 ] James Taylor commented on PHOENIX-1973: --- Thanks for reviewing and testing, [~gabriel.reid]. I'd

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15175888#comment-15175888 ] Gabriel Reid commented on PHOENIX-1973: --- I just took a look through it and gave it a test run on a

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174942#comment-15174942 ] James Taylor commented on PHOENIX-1973: --- FYI, looks like we may need to do another RC due to a

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174869#comment-15174869 ] James Taylor commented on PHOENIX-1973: --- Nice perf improvement, [~sergey.soldatov]! Would you have

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174463#comment-15174463 ] Enis Soztutar commented on PHOENIX-1973: Oh I was not following the discussions there, thanks.

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174178#comment-15174178 ] Enis Soztutar commented on PHOENIX-1973: This is already committed, no? Sergey do we need to do

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174209#comment-15174209 ] Sergey Soldatov commented on PHOENIX-1973: -- [~enis] it was rolled back because of PHOENIX-2716.

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15173430#comment-15173430 ] Hadoop QA commented on PHOENIX-1973: {color:red}-1 overall{color}. Here are the results of testing

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15170679#comment-15170679 ] Hudson commented on PHOENIX-1973: - FAILURE: Integrated in Phoenix-master #1161 (See

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149093#comment-15149093 ] Enis Soztutar commented on PHOENIX-1973: bq. There are about 200 tests listed as failing -

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148279#comment-15148279 ] Hudson commented on PHOENIX-1973: - SUCCESS: Integrated in Phoenix-master #1138 (See

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148161#comment-15148161 ] Rajeshbabu Chintaguntla commented on PHOENIX-1973: -- +1 on patch 6. Going to commit it

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148153#comment-15148153 ] Hadoop QA commented on PHOENIX-1973: {color:red}-1 overall{color}. Here are the results of testing

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15147789#comment-15147789 ] Sergey Soldatov commented on PHOENIX-1973: -- [~jamestaylor] It seems that you don't have

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15146294#comment-15146294 ] James Taylor commented on PHOENIX-1973: --- When applying the patch locally, I'm seeing failures in

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145196#comment-15145196 ] Enis Soztutar commented on PHOENIX-1973: Looks good. Will commit after qa. > Improve

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145802#comment-15145802 ] James Taylor commented on PHOENIX-1973: --- There are about 200 tests listed as failing - they're

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145426#comment-15145426 ] Enis Soztutar commented on PHOENIX-1973: Once the jira is in "patch available" state, attaching

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145225#comment-15145225 ] Hadoop QA commented on PHOENIX-1973: {color:red}-1 overall{color}. Here are the results of testing

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145502#comment-15145502 ] Hadoop QA commented on PHOENIX-1973: {color:red}-1 overall{color}. Here are the results of testing

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145705#comment-15145705 ] Sergey Soldatov commented on PHOENIX-1973: -- It seems that those tests are failing for several

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145673#comment-15145673 ] Enis Soztutar commented on PHOENIX-1973: Did you look at the failed tests? Are they related or

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15143735#comment-15143735 ] James Taylor commented on PHOENIX-1973: --- [~enis] - please review and commit soon if you'd like

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139382#comment-15139382 ] James Taylor commented on PHOENIX-1973: --- Would someone please check this in to 4.x and master

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139792#comment-15139792 ] Sergey Soldatov commented on PHOENIX-1973: -- Bulkload is building upserts using

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15139689#comment-15139689 ] Enis Soztutar commented on PHOENIX-1973: I think silently ignoring if findIndex() cannot find

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134494#comment-15134494 ] James Taylor commented on PHOENIX-1973: --- Is this good to go, [~sergey.soldatov]? > Improve

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134822#comment-15134822 ] Sergey Soldatov commented on PHOENIX-1973: -- I hope so. There is a shortcut that keeps tablename

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133647#comment-15133647 ] Devaraj Das commented on PHOENIX-1973: -- Yeah the numbers look nice. Did you try with map output

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133597#comment-15133597 ] James Taylor commented on PHOENIX-1973: --- Nice work, [~sergey.soldatov]. Reduce shuffle bytes went

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133666#comment-15133666 ] Sergey Soldatov commented on PHOENIX-1973: -- Honestly speaking I tested on 1 node local setup,

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131166#comment-15131166 ] Enis Soztutar commented on PHOENIX-1973: Thanks Gabriel for taking a look. bq. I would think

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131617#comment-15131617 ] James Taylor commented on PHOENIX-1973: --- Is this ready and if so should we try to get it in for

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131888#comment-15131888 ] Sergey Soldatov commented on PHOENIX-1973: -- We have discussed it offline and decided to improve

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129306#comment-15129306 ] Enis Soztutar commented on PHOENIX-1973: This is pretty important. An internal test to measure

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129331#comment-15129331 ] Sergey Soldatov commented on PHOENIX-1973: -- Mapper's output was comparable to the raw data

[jira] [Commented] (PHOENIX-1973) Improve CsvBulkLoadTool performance by moving keyvalue construction from map phase to reduce phase

[ https://issues.apache.org/jira/browse/PHOENIX-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129983#comment-15129983 ] Gabriel Reid commented on PHOENIX-1973: --- Thanks for those numbers [~enis]. Doing this makes a lot