[jira] [Commented] (KUDU-1973) Coalesce RPCs destined for the same server

2017-04-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967161#comment-15967161 ] Todd Lipcon commented on KUDU-1973: --- I think this should be more specific to the consensus system, not to

[jira] [Resolved] (KUDU-1969) Please tidy up incubator distribution files

2017-04-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved KUDU-1969. --- Resolution: Fixed Assignee: Todd Lipcon Fix Version/s: n/a Done, sorry for the delay.

[jira] [Updated] (KUDU-1972) Explore ways to reduce maintenance manager CPU load

2017-04-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated KUDU-1972: -- Description: The current design of the maintenance manager includes a dedicated thread that wakes up

[jira] [Created] (KUDU-1973) Coalesce RPCs destined for the same server

2017-04-12 Thread Adar Dembo (JIRA)
Adar Dembo created KUDU-1973: Summary: Coalesce RPCs destined for the same server Key: KUDU-1973 URL: https://issues.apache.org/jira/browse/KUDU-1973 Project: Kudu Issue Type: Sub-task

[jira] [Created] (KUDU-1972) Explore ways to reduce maintenance manager CPU load

2017-04-12 Thread Adar Dembo (JIRA)
Adar Dembo created KUDU-1972: Summary: Explore ways to reduce maintenance manager CPU load Key: KUDU-1972 URL: https://issues.apache.org/jira/browse/KUDU-1972 Project: Kudu Issue Type: Sub-task

[jira] [Updated] (KUDU-1971) Explore reducing number of data blocks by tuning existing parameters

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo updated KUDU-1971: - Labels: data-scalability (was: ) > Explore reducing number of data blocks by tuning existing parameters >

[jira] [Updated] (KUDU-383) Massive numbers of threads used by log append and GC

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo updated KUDU-383: Issue Type: Bug (was: Sub-task) Parent: (was: KUDU-1967) > Massive numbers of threads used by

[jira] [Resolved] (KUDU-383) Massive numbers of threads used by log append and GC

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo resolved KUDU-383. - Resolution: Duplicate Fix Version/s: n/a Yes, I'm closing a bug that's far older than it's

[jira] [Created] (KUDU-1971) Explore reducing number of data blocks by tuning existing parameters

2017-04-12 Thread Adar Dembo (JIRA)
Adar Dembo created KUDU-1971: Summary: Explore reducing number of data blocks by tuning existing parameters Key: KUDU-1971 URL: https://issues.apache.org/jira/browse/KUDU-1971 Project: Kudu

[jira] [Commented] (KUDU-1442) LBM should log startup progress periodically

2017-04-12 Thread Jean-Daniel Cryans (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967020#comment-15967020 ] Jean-Daniel Cryans commented on KUDU-1442: -- bq. That might be tricky to orchestrate across data

[jira] [Updated] (KUDU-38) bootstrap should not replay logs that are known to be fully flushed

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-38?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo updated KUDU-38: --- Issue Type: Sub-task (was: Improvement) Parent: KUDU-1967 > bootstrap should not replay logs that are

[jira] [Assigned] (KUDU-1830) Reduce Kudu WAL log disk usage

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo reassigned KUDU-1830: Assignee: (was: Adar Dembo) > Reduce Kudu WAL log disk usage > -- >

[jira] [Assigned] (KUDU-383) Massive numbers of threads used by log append and GC

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo reassigned KUDU-383: --- Assignee: (was: Adar Dembo) > Massive numbers of threads used by log append and GC >

[jira] [Assigned] (KUDU-1913) Tablet server runs out of threads when creating lots of tablets

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo reassigned KUDU-1913: Assignee: (was: Adar Dembo) > Tablet server runs out of threads when creating lots of tablets >

[jira] [Updated] (KUDU-1549) LBM should start up faster

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo updated KUDU-1549: - Summary: LBM should start up faster (was: recovery speed of kudu-tserver should be faster.) I'm

[jira] [Updated] (KUDU-1442) LBM should log startup progress periodically

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo updated KUDU-1442: - Labels: data-scalability newbie (was: data-scalability) Summary: LBM should log startup progress

[jira] [Commented] (KUDU-1442) kudu should have more log when starting up, user need to check the progress of starting.

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15967012#comment-15967012 ] Adar Dembo commented on KUDU-1442: -- Apart from fixing KUDU-1192, we should (as [~bruceSz] said) log more

[jira] [Updated] (KUDU-1442) kudu should have more log when starting up, user need to check the progress of starting.

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo updated KUDU-1442: - Issue Type: Sub-task (was: Improvement) Parent: KUDU-1967 > kudu should have more log when

[jira] [Updated] (KUDU-1125) Reduce impact of enabling fsync on the master

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo updated KUDU-1125: - Issue Type: Sub-task (was: Improvement) Parent: KUDU-1967 > Reduce impact of enabling fsync on

[jira] [Assigned] (KUDU-1913) Tablet server runs out of threads when creating lots of tablets

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo reassigned KUDU-1913: Assignee: Adar Dembo > Tablet server runs out of threads when creating lots of tablets >

[jira] [Updated] (KUDU-1830) Reduce Kudu WAL log disk usage

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo updated KUDU-1830: - Issue Type: Sub-task (was: Improvement) Parent: KUDU-1967 > Reduce Kudu WAL log disk usage >

[jira] [Updated] (KUDU-383) Massive numbers of threads used by log append and GC

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo updated KUDU-383: Issue Type: Sub-task (was: Bug) Parent: KUDU-1967 > Massive numbers of threads used by log append

[jira] [Updated] (KUDU-383) Massive numbers of threads used by log append and GC

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo updated KUDU-383: Labels: data-scalability (was: ) > Massive numbers of threads used by log append and GC >

[jira] [Assigned] (KUDU-383) Massive numbers of threads used by log append and GC

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo reassigned KUDU-383: --- Assignee: Adar Dembo (was: Mike Percy) > Massive numbers of threads used by log append and GC >

[jira] [Updated] (KUDU-1913) Tablet server runs out of threads when creating lots of tablets

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo updated KUDU-1913: - Issue Type: Sub-task (was: Bug) Parent: KUDU-1967 > Tablet server runs out of threads when

[jira] [Created] (KUDU-1970) Integration test for data scalability

2017-04-12 Thread Adar Dembo (JIRA)
Adar Dembo created KUDU-1970: Summary: Integration test for data scalability Key: KUDU-1970 URL: https://issues.apache.org/jira/browse/KUDU-1970 Project: Kudu Issue Type: Sub-task

[jira] [Comment Edited] (KUDU-1842) kudu-jepsen reports non-linearizable history for the 'all-random-halves' scenario

2017-04-12 Thread Alexey Serbin (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966919#comment-15966919 ] Alexey Serbin edited comment on KUDU-1842 at 4/13/17 12:33 AM: --- This bug is

[jira] [Comment Edited] (KUDU-1838) kudu-jepsen reports non-linearizable history for the hammer-3-tservers scenario

2017-04-12 Thread Alexey Serbin (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966914#comment-15966914 ] Alexey Serbin edited comment on KUDU-1838 at 4/13/17 12:32 AM: --- This bug is

[jira] [Commented] (KUDU-1838) kudu-jepsen reports non-linearizable history for the hammer-3-tservers scenario

2017-04-12 Thread David Alves (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966921#comment-15966921 ] David Alves commented on KUDU-1838: --- Should add that since that was fixed this error no longer occurs >

[jira] [Resolved] (KUDU-1837) kudu-jepsen reports non-linearizable history for the tserver-majorities-ring scenario

2017-04-12 Thread Alexey Serbin (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Serbin resolved KUDU-1837. - Resolution: Invalid Fix Version/s: 1.4.0 This bug is not valid since the kudu-jepsen ran in

[jira] [Resolved] (KUDU-1842) kudu-jepsen reports non-linearizable history for the 'all-random-halves' scenario

2017-04-12 Thread Alexey Serbin (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Serbin resolved KUDU-1842. - Resolution: Invalid Fix Version/s: 1.4.0 This bug is not valid since the kudu-jepsen ran in

[jira] [Resolved] (KUDU-1825) kudu-jepsen reports non-linearizable history for the kill-restart-all-tservers scenario

2017-04-12 Thread Alexey Serbin (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Serbin resolved KUDU-1825. - Resolution: Invalid Fix Version/s: 1.4.0 This bug is not valid since the kudu-jepsen ran in

[jira] [Resolved] (KUDU-1966) Data directories can be removed erroneously

2017-04-12 Thread Dan Burkert (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Burkert resolved KUDU-1966. --- Resolution: Fixed Fix Version/s: 1.4.0 > Data directories can be removed erroneously >

[jira] [Commented] (KUDU-1966) Data directories can be removed erroneously

2017-04-12 Thread Dan Burkert (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966899#comment-15966899 ] Dan Burkert commented on KUDU-1966: --- Resolved by

[jira] [Resolved] (KUDU-1968) Aborted tablet copies delete live blocks

2017-04-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved KUDU-1968. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Resolved by reverting the

[jira] [Reopened] (KUDU-1853) Error during tablet copy may orphan a bunch of stuff

2017-04-12 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adar Dembo reopened KUDU-1853: -- With the revert of 72541b47eb55b2df4eab5d6050f517476ed6d370 (see KUDU-1968), this bug is no longer fixed.

[jira] [Created] (KUDU-1969) Please tidy up incubator distribution files

2017-04-12 Thread Sebb (JIRA)
Sebb created KUDU-1969: -- Summary: Please tidy up incubator distribution files Key: KUDU-1969 URL: https://issues.apache.org/jira/browse/KUDU-1969 Project: Kudu Issue Type: Bug Environment:

[jira] [Resolved] (KUDU-1891) Uploading 100,000 rows x 20 columns results in not enough mutation buffer space when uploading data using Python

2017-04-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved KUDU-1891. --- Resolution: Not A Problem Fix Version/s: n/a > Uploading 100,000 rows x 20 columns results in

[jira] [Commented] (KUDU-1968) Aborted tablet copies delete live blocks

2017-04-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966491#comment-15966491 ] Todd Lipcon commented on KUDU-1968: --- I should note that I verified that with a revert, it went back to

[jira] [Commented] (KUDU-1968) Aborted tablet copies delete live blocks

2017-04-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966490#comment-15966490 ] Todd Lipcon commented on KUDU-1968: --- I'm able to repro with the following sequence: {code} rm -Rf /tmp/m

[jira] [Created] (KUDU-1968) Aborted tablet copies delete live blocks

2017-04-12 Thread Todd Lipcon (JIRA)
Todd Lipcon created KUDU-1968: - Summary: Aborted tablet copies delete live blocks Key: KUDU-1968 URL: https://issues.apache.org/jira/browse/KUDU-1968 Project: Kudu Issue Type: Bug

[jira] [Assigned] (KUDU-463) Add checksumming to cfile and other on-disk formats

2017-04-12 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KUDU-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke reassigned KUDU-463: Assignee: Grant Henke (was: Adar Dembo) > Add checksumming to cfile and other on-disk formats >