Xu Yao updated KUDU-2437:
    Comment: was deleted

(was: https://gerrit.cloudera.org/#/c/10406/)

> Generate ScanToken from small chunks in tablet
> ----------------------------------------------
>                 Key: KUDU-2437
>                 URL: https://issues.apache.org/jira/browse/KUDU-2437
>             Project: Kudu
>          Issue Type: Improvement
>          Components: client, master, tablet
>            Reporter: Xu Yao
>            Assignee: Xu Yao
>            Priority: Major
> When reading data in a kudu table using spark, if there is a large amount of 
> data in the tablet, reading the data takes a long time.
> The reason is that KuduRDD uses a tablet to generate the scanToken, so a 
> spark task needs to process all the data in a tablet. So:
>  # TS report the DRS bounds info to Master
>  # Client get the bounds info from Master
>  # Client generate the scanToken by bounds info of tablet(set 
> LowerBoundPrimaryKey and UpperBoundPrimaryKey)

This message was sent by Atlassian JIRA

Reply via email to