[
https://issues.apache.org/jira/browse/KUDU-716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mike Percy updated KUDU-716:
----------------------------
Parent: KUDU-808
> Single-disk tpch_real_world with SF=500 should complete successfully
> --------------------------------------------------------------------
>
> Key: KUDU-716
> URL: https://issues.apache.org/jira/browse/KUDU-716
> Project: Kudu
> Issue Type: Sub-task
> Components: test
> Affects Versions: Private Beta
> Reporter: Todd Lipcon
> Assignee: Jean-Daniel Cryans
> Priority: Critical
> Labels: kudu-roadmap
> Attachments: data.tsv, inserts-over-time.png,
> inserts-vs-bytes-on-disk.png, memory usage.png, mrs-size.png,
> mrs-vs-bytes-on-disk.png
>
>
> We now have a "tpch_real_world" benchmark that loads lineitem for an
> arbitrary scale factor and runs queries against it. In trying to run this on
> a single-disk system, we are running into a number of issues that prevent it
> from completing successfully:
> - OOMs on the server side, due to:
> -- poor default MRS size throttling behavior (per-MRS limits, no default
> setting)
> -- live scanners retaining large amounts of memory from MRS (KUDU-18)
> - OOMs on the client side (bugs like KUDU-715)
> - timeouts during writes (eg due to client not respecting backpressure)
> - timeouts during scans (unclear why - perhaps the server went into swap?)
> We should make it a release criteria that tpch_real_world SF500 can complete
> even on underprovisioned hardware (single-HDD).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
