[jira] [Created] (KUDU-3168) Script or document how to identify tables that suffer from KUDU-1400

2020-07-15 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3168: - Summary: Script or document how to identify tables that suffer from KUDU-1400 Key: KUDU-3168 URL: https://issues.apache.org/jira/browse/KUDU-3168 Project: Kudu

[jira] [Created] (KUDU-3166) Tool to adjust the size of a tablet replica's data directory group

2020-07-14 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3166: - Summary: Tool to adjust the size of a tablet replica's data directory group Key: KUDU-3166 URL: https://issues.apache.org/jira/browse/KUDU-3166 Project: Kudu

[jira] [Created] (KUDU-3165) Add statistics to data directories that can be useful for performance debugging

2020-07-14 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3165: - Summary: Add statistics to data directories that can be useful for performance debugging Key: KUDU-3165 URL: https://issues.apache.org/jira/browse/KUDU-3165 Project: Kudu

[jira] [Resolved] (KUDU-2627) Automatically "fix" inconsistent data directories

2020-07-14 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-2627. --- Fix Version/s: 1.12.0 Resolution: Duplicate This is a dupe of KUDU-2993, which is resolved as

[jira] [Commented] (KUDU-3154) RangerClientTestBase.TestLogging sometimes fails

2020-07-08 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17154049#comment-17154049 ] Andrew Wong commented on KUDU-3154: --- Some updates here, given that we have other Ranger tests that

[jira] [Comment Edited] (KUDU-3154) RangerClientTestBase.TestLogging sometimes fails

2020-07-07 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17153156#comment-17153156 ] Andrew Wong edited comment on KUDU-3154 at 7/8/20, 12:59 AM: - I was able to

[jira] [Updated] (KUDU-3154) RangerClientTestBase.TestLogging sometimes fails

2020-07-07 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-3154: -- Attachment: kudu-3154_jstacks.txt > RangerClientTestBase.TestLogging sometimes fails >

[jira] [Commented] (KUDU-3154) RangerClientTestBase.TestLogging sometimes fails

2020-07-06 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17152289#comment-17152289 ] Andrew Wong commented on KUDU-3154: --- I've filed RANGER-2899 to get some Ranger eyes on this, in case

[jira] [Commented] (KUDU-3154) RangerClientTestBase.TestLogging sometimes fails

2020-07-06 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17152223#comment-17152223 ] Andrew Wong commented on KUDU-3154: --- I added some logging (see

[jira] [Updated] (KUDU-3154) RangerClientTestBase.TestLogging sometimes fails

2020-07-06 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-3154: -- Attachment: ranger_client-test.txt > RangerClientTestBase.TestLogging sometimes fails >

[jira] [Commented] (KUDU-3154) RangerClientTestBase.TestLogging sometimes fails

2020-07-02 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150477#comment-17150477 ] Andrew Wong commented on KUDU-3154: --- Re: the logging, the ordering can be explained by the fact that

[jira] [Commented] (KUDU-3154) RangerClientTestBase.TestLogging sometimes fails

2020-06-20 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17141178#comment-17141178 ] Andrew Wong commented on KUDU-3154: --- It's interesting, in the dumped Java logs, there's: {code}

[jira] [Updated] (KUDU-3153) Use full DRS size when considering rowsets to compact

2020-06-19 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-3153: -- Description: We sometimes encounter interesting behavior when viewing the rowset layout diagram, like

[jira] [Created] (KUDU-3153) Use full DRS size when considering rowsets to compact

2020-06-19 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3153: - Summary: Use full DRS size when considering rowsets to compact Key: KUDU-3153 URL: https://issues.apache.org/jira/browse/KUDU-3153 Project: Kudu Issue Type: Bug

[jira] [Updated] (KUDU-3151) segfault when repairing log block container with a missing LBM container data file

2020-06-18 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-3151: -- Summary: segfault when repairing log block container with a missing LBM container data file (was:

[jira] [Created] (KUDU-3151) segfault when starting repairing log block container with a missing LBM container data file

2020-06-18 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3151: - Summary: segfault when starting repairing log block container with a missing LBM container data file Key: KUDU-3151 URL: https://issues.apache.org/jira/browse/KUDU-3151

[jira] [Commented] (KUDU-3149) Lock contention between registering ops and computing maintenance op stats

2020-06-18 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139563#comment-17139563 ] Andrew Wong commented on KUDU-3149: --- {quote} In your thread dump it looks like Thread 4 is waiting on

[jira] [Updated] (KUDU-3149) Lock contention between registering ops and computing maintenance op stats

2020-06-18 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-3149: -- Description: We saw a bunch of tablets bootstrapping extremely slowly, and many stuck supposedly

[jira] [Updated] (KUDU-3149) Lock contention between registering ops and computing maintenance op stats

2020-06-18 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-3149: -- Description: We saw a bunch of tablets bootstrapping extremely slowly, and many stuck supposedly

[jira] [Updated] (KUDU-3149) Lock contention between registering ops and computing maintenance op stats

2020-06-17 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-3149: -- Description: We saw a bunch of tablets bootstrapping extremely slowly, and many stuck supposedly

[jira] [Updated] (KUDU-3149) Lock contention between registering ops and computing maintenance op stats

2020-06-17 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-3149: -- Description: We saw a bunch of tablets bootstrapping extremely slowly, and many stuck supposedly

[jira] [Created] (KUDU-3149) Lock contention between registering ops and computing maintenance op stats

2020-06-17 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3149: - Summary: Lock contention between registering ops and computing maintenance op stats Key: KUDU-3149 URL: https://issues.apache.org/jira/browse/KUDU-3149 Project: Kudu

[jira] [Commented] (KUDU-3144) Compile kudu in Release mode failed on aarch64 server

2020-06-04 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126304#comment-17126304 ] Andrew Wong commented on KUDU-3144: --- Thanks for reporting this. Can you try again with commit

[jira] [Commented] (KUDU-3110) tserver data folder too large

2020-06-04 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125606#comment-17125606 ] Andrew Wong commented on KUDU-3110: --- [~SeaAndHill] sorry we didn't get to the bottom of this earlier.

[jira] [Resolved] (KUDU-3011) Support for smooth maintenance window

2020-06-03 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-3011. --- Fix Version/s: 1.12.0 Resolution: Fixed 1.11 introduced a tserver maintenance state to prevent

[jira] [Resolved] (KUDU-2321) Allow Kudu to start up with different data directories

2020-06-03 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-2321. --- Fix Version/s: 1.12.0 Resolution: Duplicate This is KUDU-2993, which is fixed in 1.12.0. >

[jira] [Commented] (KUDU-2258) Create timeseries workload integration test

2020-06-02 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124355#comment-17124355 ] Andrew Wong commented on KUDU-2258: --- It's worth noting [Todd's

[jira] [Commented] (KUDU-1728) Parallelize tablet copy operations

2020-06-02 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124338#comment-17124338 ] Andrew Wong commented on KUDU-1728: --- To get a sense for how serial this process is, you can walk through

[jira] [Resolved] (KUDU-2047) Lazy cfile open and maintenance op stat caching cause fruitful delta compaction ops to never run

2020-06-02 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-2047. --- Fix Version/s: 1.12.0 Assignee: Andrew Wong (was: William Berkeley) Resolution: Fixed

[jira] [Commented] (KUDU-2050) Avoid peer eviction during block manager startup

2020-06-02 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124327#comment-17124327 ] Andrew Wong commented on KUDU-2050: --- As a workaround for now, folks can use {{kudu tserver state

[jira] [Resolved] (KUDU-2054) Rolling Restart and Upgrade

2020-06-02 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-2054. --- Fix Version/s: 1.12.0 Resolution: Fixed Rolling restart is documented here 

[jira] [Commented] (KUDU-1271) Column ordering constraint in Kudu

2020-06-02 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124182#comment-17124182 ] Andrew Wong commented on KUDU-1271: --- Todd posted a more recent WIP for this here:

[jira] [Commented] (KUDU-740) Add MemorySanitizer (MSAN) build

2020-06-02 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124174#comment-17124174 ] Andrew Wong commented on KUDU-740: -- Adar put up a WIP patch for this here, but mentioned the approach hit

[jira] [Created] (KUDU-3138) improve visibility into the bootstrapping status of a tablet server

2020-06-01 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3138: - Summary: improve visibility into the bootstrapping status of a tablet server Key: KUDU-3138 URL: https://issues.apache.org/jira/browse/KUDU-3138 Project: Kudu

[jira] [Created] (KUDU-3137) Allow RYW scan mode to return rows if the picked timestamp is lower than the ancient history mark

2020-06-01 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3137: - Summary: Allow RYW scan mode to return rows if the picked timestamp is lower than the ancient history mark Key: KUDU-3137 URL: https://issues.apache.org/jira/browse/KUDU-3137

[jira] [Commented] (KUDU-2612) Implement multi-row transactions

2020-05-28 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119169#comment-17119169 ] Andrew Wong commented on KUDU-2612: --- I posted this design doc to the dev mailing list and intend on

[jira] [Created] (KUDU-3130) add a tool to filter tables/tablets by replication factor

2020-05-21 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3130: - Summary: add a tool to filter tables/tablets by replication factor Key: KUDU-3130 URL: https://issues.apache.org/jira/browse/KUDU-3130 Project: Kudu Issue Type:

[jira] [Created] (KUDU-3129) ToolTest.TestHmsList can timeout

2020-05-21 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3129: - Summary: ToolTest.TestHmsList can timeout Key: KUDU-3129 URL: https://issues.apache.org/jira/browse/KUDU-3129 Project: Kudu Issue Type: Bug Components:

[jira] [Commented] (KUDU-3127) Have replica placement and rebalancing consider non-uniform hardware

2020-05-20 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112718#comment-17112718 ] Andrew Wong commented on KUDU-3127: --- Another thing to be wary of is that any capacity-based placement

[jira] [Created] (KUDU-3127) Have replica placement and rebalancing consider non-uniform hardware

2020-05-20 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3127: - Summary: Have replica placement and rebalancing consider non-uniform hardware Key: KUDU-3127 URL: https://issues.apache.org/jira/browse/KUDU-3127 Project: Kudu

[jira] [Created] (KUDU-3123) tracing.html doesn't render on newer browsers

2020-05-15 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3123: - Summary: tracing.html doesn't render on newer browsers Key: KUDU-3123 URL: https://issues.apache.org/jira/browse/KUDU-3123 Project: Kudu Issue Type: Bug

[jira] [Commented] (KUDU-3121) Allow users to pick the next best op

2020-05-13 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17106880#comment-17106880 ] Andrew Wong commented on KUDU-3121: --- Yeah, they're similar ideas, but with different motivations (I

[jira] [Created] (KUDU-3121) Allow users to pick the next best op

2020-05-13 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3121: - Summary: Allow users to pick the next best op Key: KUDU-3121 URL: https://issues.apache.org/jira/browse/KUDU-3121 Project: Kudu Issue Type: New Feature

[jira] [Resolved] (KUDU-2780) Rebalance Kudu cluster in background

2020-05-13 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-2780. --- Fix Version/s: 1.13.0 Resolution: Fixed Basically all of this landed in 1.12.0, though there

[jira] [Resolved] (KUDU-2548) Rebalancer tool should be able to run even if there are permanently dead tablet servers

2020-05-13 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-2548. --- Fix Version/s: 1.10.0 Resolution: Fixed Users can run the rebalancer with permanently dead

[jira] [Resolved] (KUDU-3113) auto rebalancer doesn't successfully execute moves

2020-05-06 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-3113. --- Fix Version/s: 1.13.0 Resolution: Fixed > auto rebalancer doesn't successfully execute moves >

[jira] [Resolved] (KUDU-2226) Tablets with too many DRSs will cause a huge DMS memory overhead

2020-05-04 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-2226. --- Fix Version/s: 1.12.0 Resolution: Fixed This is likely a dupe of KUDU-3002, which is fixed in

[jira] [Assigned] (KUDU-3113) auto rebalancer doesn't successfully execute moves

2020-05-01 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong reassigned KUDU-3113: - Assignee: Andrew Wong > auto rebalancer doesn't successfully execute moves >

[jira] [Created] (KUDU-3113) auto rebalancer doesn't successfully execute moves

2020-04-30 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3113: - Summary: auto rebalancer doesn't successfully execute moves Key: KUDU-3113 URL: https://issues.apache.org/jira/browse/KUDU-3113 Project: Kudu Issue Type: Bug

[jira] [Commented] (KUDU-3007) ARM/aarch64 platform support

2020-04-22 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090067#comment-17090067 ] Andrew Wong commented on KUDU-3007: --- [~aserbin] started taking a look at the patch a few iterations ago,

[jira] [Commented] (KUDU-1625) Schedule compaction on rowsets with high percentage of deleted data

2020-03-21 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064050#comment-17064050 ] Andrew Wong commented on KUDU-1625: --- In addition to the above patch, f4508ff and 58f7a30 also help

[jira] [Updated] (KUDU-3077) Have client scanners prune the default projection based on the contents of their authz tokens

2020-03-15 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-3077: -- Component/s: security client > Have client scanners prune the default projection based

[jira] [Created] (KUDU-3077) Have client scanners prune the default projection based on the contents of their authz tokens

2020-03-15 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3077: - Summary: Have client scanners prune the default projection based on the contents of their authz tokens Key: KUDU-3077 URL: https://issues.apache.org/jira/browse/KUDU-3077

[jira] [Created] (KUDU-3074) Consider putting a replica in some read-only, quarantined state if certain invariants are broken

2020-03-13 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3074: - Summary: Consider putting a replica in some read-only, quarantined state if certain invariants are broken Key: KUDU-3074 URL: https://issues.apache.org/jira/browse/KUDU-3074

[jira] [Created] (KUDU-3071) Expose splitKeyRanges in the C++ clients

2020-03-09 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3071: - Summary: Expose splitKeyRanges in the C++ clients Key: KUDU-3071 URL: https://issues.apache.org/jira/browse/KUDU-3071 Project: Kudu Issue Type: Improvement

[jira] [Commented] (KUDU-2432) isolate race creating directory via dist_test.py

2020-03-04 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051784#comment-17051784 ] Andrew Wong commented on KUDU-2432: --- Saw this again with an ASAN build on

[jira] [Assigned] (KUDU-801) Delta flush doesn't wait for transactions to commit

2020-02-24 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong reassigned KUDU-801: Assignee: Andrew Wong (was: Hao Hao) > Delta flush doesn't wait for transactions to commit >

[jira] [Commented] (KUDU-3057) Allow users to pass keytabs to CLI tooling

2020-02-20 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041554#comment-17041554 ] Andrew Wong commented on KUDU-3057: --- In many cases, that should work. In my particular scenario, I

[jira] [Created] (KUDU-3060) Add a tool to identify potential performance bottlenecks

2020-02-20 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3060: - Summary: Add a tool to identify potential performance bottlenecks Key: KUDU-3060 URL: https://issues.apache.org/jira/browse/KUDU-3060 Project: Kudu Issue Type:

[jira] [Created] (KUDU-3057) Allow users to pass keytabs to CLI tooling

2020-02-18 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3057: - Summary: Allow users to pass keytabs to CLI tooling Key: KUDU-3057 URL: https://issues.apache.org/jira/browse/KUDU-3057 Project: Kudu Issue Type: Improvement

[jira] [Created] (KUDU-3055) Lazily open cold tablets

2020-02-16 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3055: - Summary: Lazily open cold tablets Key: KUDU-3055 URL: https://issues.apache.org/jira/browse/KUDU-3055 Project: Kudu Issue Type: New Feature Components:

[jira] [Commented] (KUDU-1625) Schedule compaction on rowsets with high percentage of deleted data

2020-01-31 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-1625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027782#comment-17027782 ] Andrew Wong commented on KUDU-1625: --- We've heard requests for this for some time, so I started thinking

[jira] [Assigned] (KUDU-3046) TestQuiescingServerDoesntTriggerElections sometimes fails

2020-01-27 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong reassigned KUDU-3046: - Assignee: Andrew Wong > TestQuiescingServerDoesntTriggerElections sometimes fails >

[jira] [Resolved] (KUDU-2496) TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure is flaky

2020-01-13 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-2496. --- Fix Version/s: 1.12.0 Resolution: Fixed >

[jira] [Created] (KUDU-3040) linked_list-itest sometimes times out when curling various webpages

2020-01-13 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3040: - Summary: linked_list-itest sometimes times out when curling various webpages Key: KUDU-3040 URL: https://issues.apache.org/jira/browse/KUDU-3040 Project: Kudu

[jira] [Created] (KUDU-3039) ToolTest.TestHmsIgnoresDifferentMasters can time out

2020-01-13 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3039: - Summary: ToolTest.TestHmsIgnoresDifferentMasters can time out Key: KUDU-3039 URL: https://issues.apache.org/jira/browse/KUDU-3039 Project: Kudu Issue Type: Bug

[jira] [Commented] (KUDU-2404) Mitigate effects of full disks

2020-01-13 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014620#comment-17014620 ] Andrew Wong commented on KUDU-2404: --- Thinking about this in the context of the WAL, since out-of-space

[jira] [Assigned] (KUDU-2975) Spread WAL across multiple data directories

2020-01-10 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong reassigned KUDU-2975: - Assignee: YangSong > Spread WAL across multiple data directories >

[jira] [Updated] (KUDU-2975) Spread WAL across multiple data directories

2020-01-10 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-2975: -- Code Review: https://gerrit.cloudera.org/c/14920/ > Spread WAL across multiple data directories >

[jira] [Assigned] (KUDU-3011) Support for smooth maintenance window

2019-12-19 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong reassigned KUDU-3011: - Assignee: Andrew Wong > Support for smooth maintenance window >

[jira] [Resolved] (KUDU-3002) DMS may never flush when under memory pressure and there are on-going inserts

2019-12-17 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-3002. --- Fix Version/s: 1.12.0 Resolution: Fixed > DMS may never flush when under memory pressure and

[jira] [Resolved] (KUDU-2993) Allow Kudu to start up with a fresh data directory without running update_dirs

2019-12-17 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-2993. --- Fix Version/s: 1.12.0 Resolution: Fixed > Allow Kudu to start up with a fresh data directory

[jira] [Comment Edited] (KUDU-3002) DMS may never flush when under memory pressure and there are on-going inserts

2019-12-13 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995872#comment-16995872 ] Andrew Wong edited comment on KUDU-3002 at 12/13/19 8:04 PM: - With all of

[jira] [Commented] (KUDU-3002) DMS may never flush when under memory pressure and there are on-going inserts

2019-12-13 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16995872#comment-16995872 ] Andrew Wong commented on KUDU-3002: --- With all of these approaches, it's pretty easy to come up with

[jira] [Updated] (KUDU-3002) DMS may never flush when under memory pressure and there are on-going inserts

2019-12-13 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-3002: -- Summary: DMS may never flush when under memory pressure and there are on-going inserts (was: consider

[jira] [Commented] (KUDU-3018) Add tests for CLI tools

2019-12-11 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994042#comment-16994042 ] Andrew Wong commented on KUDU-3018: --- There are tests a decent number of loadgen tests in

[jira] [Commented] (KUDU-3018) Add tests for CLI tools

2019-12-11 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16994016#comment-16994016 ] Andrew Wong commented on KUDU-3018: --- There are many tooling-related tests: {code} [awong@va1022 kudu]$

[jira] [Commented] (KUDU-3013) Race in StopTabletITest.TestStoppedTabletsDontWrite

2019-12-05 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16989321#comment-16989321 ] Andrew Wong commented on KUDU-3013: --- Sorry this slipped through my notifications. [~helifu] thanks for

[jira] [Commented] (KUDU-3011) Support for smooth maintenance window

2019-11-27 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984151#comment-16984151 ] Andrew Wong commented on KUDU-3011: --- That said, a look at the kudu-scanner in Impala, it works in

[jira] [Commented] (KUDU-3011) Support for smooth maintenance window

2019-11-27 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984137#comment-16984137 ] Andrew Wong commented on KUDU-3011: --- The difficulty with making tservers non-scannable during

[jira] [Commented] (KUDU-3010) unsafe_change_config can lead to a crash

2019-11-27 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984114#comment-16984114 ] Andrew Wong commented on KUDU-3010: --- I spent some time rummaging through logs and pulled out the

[jira] [Updated] (KUDU-3010) unsafe_change_config can lead to a crash

2019-11-27 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-3010: -- Attachment: foo04.out foo03.out foo06.out > unsafe_change_config can

[jira] [Commented] (KUDU-3010) unsafe_change_config can lead to a crash

2019-11-27 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984052#comment-16984052 ] Andrew Wong commented on KUDU-3010: --- Yeah, more targeted logging would've been nice. Unfortunately it's

[jira] [Created] (KUDU-3010) unsafe_change_config can lead to a crash

2019-11-26 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3010: - Summary: unsafe_change_config can lead to a crash Key: KUDU-3010 URL: https://issues.apache.org/jira/browse/KUDU-3010 Project: Kudu Issue Type: Bug

[jira] [Created] (KUDU-3004) retain a history of PathSetPBs when updating directories

2019-11-20 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3004: - Summary: retain a history of PathSetPBs when updating directories Key: KUDU-3004 URL: https://issues.apache.org/jira/browse/KUDU-3004 Project: Kudu Issue Type:

[jira] [Resolved] (KUDU-26) Handle corrupt Tablets at startup

2019-11-19 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-26?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-26. - Fix Version/s: 1.5.0 Resolution: Fixed This was fixed a while ago in a series of commits. > Handle

[jira] [Updated] (KUDU-3002) consider compactions as a mechanism to flush many DMSs

2019-11-19 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-3002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-3002: -- Description: When under memory pressure, we'll aggressively perform the maintenance operation that

[jira] [Created] (KUDU-3002) consider compactions as a mechanism to flush many DMSs

2019-11-19 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-3002: - Summary: consider compactions as a mechanism to flush many DMSs Key: KUDU-3002 URL: https://issues.apache.org/jira/browse/KUDU-3002 Project: Kudu Issue Type:

[jira] [Commented] (KUDU-2929) Don't starve compactions under memory pressure

2019-11-19 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977885#comment-16977885 ] Andrew Wong commented on KUDU-2929: --- Also [~ZhangYao] good point about registering the DMS size as

[jira] [Comment Edited] (KUDU-2993) Allow Kudu to start up with a fresh data directory without running update_dirs

2019-11-17 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976239#comment-16976239 ] Andrew Wong edited comment on KUDU-2993 at 11/18/19 2:33 AM: - I chatted with

[jira] [Assigned] (KUDU-2993) Allow Kudu to start up with a fresh data directory without running update_dirs

2019-11-17 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong reassigned KUDU-2993: - Assignee: Andrew Wong > Allow Kudu to start up with a fresh data directory without running

[jira] [Commented] (KUDU-2993) Allow Kudu to start up with a fresh data directory without running update_dirs

2019-11-17 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976239#comment-16976239 ] Andrew Wong commented on KUDU-2993: --- I chatted with Adar about this, and we could probably get by

[jira] [Created] (KUDU-2993) Allow Kudu to start up with a fresh data directory without running update_dirs

2019-11-07 Thread Andrew Wong (Jira)
Andrew Wong created KUDU-2993: - Summary: Allow Kudu to start up with a fresh data directory without running update_dirs Key: KUDU-2993 URL: https://issues.apache.org/jira/browse/KUDU-2993 Project: Kudu

[jira] [Updated] (KUDU-2929) Don't starve compactions under memory pressure

2019-11-06 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-2929: -- Status: In Review (was: Open) > Don't starve compactions under memory pressure >

[jira] [Resolved] (KUDU-2356) Idle WALs can consume significant memory

2019-11-01 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-2356. --- Fix Version/s: 1.12.0 Assignee: Andrew Wong Resolution: Fixed Re-merged as 

[jira] [Commented] (KUDU-2975) Spread WAL across multiple data directories

2019-10-30 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963575#comment-16963575 ] Andrew Wong commented on KUDU-2975: --- I think the easiest path forward right now is to decouple the WAL

[jira] [Commented] (KUDU-2975) Spread WAL across multiple data directories

2019-10-17 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16954136#comment-16954136 ] Andrew Wong commented on KUDU-2975: --- I agree, this would be great to have. Most of my exploration

[jira] [Updated] (KUDU-2852) Push predicate evaluation into more CFile decoders

2019-10-14 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong updated KUDU-2852: -- Fix Version/s: 1.12.0 Bankim addressed RLE encoding for IntTypes in

[jira] [Resolved] (KUDU-2069) Add a maintenance mode

2019-10-09 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wong resolved KUDU-2069. --- Fix Version/s: 1.11.0 Resolution: Fixed This was implemented in a series of patches starting

[jira] [Commented] (KUDU-1235) Add Get API

2019-10-04 Thread Andrew Wong (Jira)
[ https://issues.apache.org/jira/browse/KUDU-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944761#comment-16944761 ] Andrew Wong commented on KUDU-1235: --- [~decster] I might have someone who might be interested in taking

<    1   2   3   4   5   6   >