[ 
https://issues.apache.org/jira/browse/KUDU-1891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15876495#comment-15876495
 ] 

Todd Lipcon commented on KUDU-1891:
-----------------------------------

I think this is expected - with manual flush, if you try to buffer more than 
fits in the configured buffer, you'll get an error. I think switching to 
auto_flush_background is probably the right approach here, not sure if this 
should be considered a bug.

> Uploading 100,000 rows x 20 columns results in not enough mutation buffer 
> space when uploading data using Python
> ----------------------------------------------------------------------------------------------------------------
>
>                 Key: KUDU-1891
>                 URL: https://issues.apache.org/jira/browse/KUDU-1891
>             Project: Kudu
>          Issue Type: Bug
>          Components: python
>    Affects Versions: 1.2.0
>         Environment: Ubuntu 16.04
>            Reporter: Roger
>
> The table had one timestamp column and 19 single precision columns with only 
> the timestamp as the primary key.
> The tuples were uploaded in the following way:
> {code}
> table = client.table('new_table')
> session = client.new_session()
> for t in tuples[:100000]:
>     session.apply(table.new_insert(t))
> {code}
> Please note that the default flush mode in Python is manual.
> This resulted in the bellow error:
> {code}
> ---------------------------------------------------------------------------
> KuduBadStatus                             Traceback (most recent call last)
> <ipython-input-8-0dc8979dc1a0> in <module>()
>       2 session = client.new_session()
>       3 for t in tuples[:100000]:
> ----> 4     session.apply(table.new_insert(t))
>       5 
>       6 try:
> /root/anaconda3/envs/sifr-repository/lib/python3.5/site-packages/kudu/client.pyx
>  in kudu.client.Session.apply (kudu/client.cpp:15185)()
> /root/anaconda3/envs/sifr-repository/lib/python3.5/site-packages/kudu/client.pyx
>  in kudu.client.WriteOperation.add_to_session (kudu/client.cpp:27992)()
> /root/anaconda3/envs/sifr-repository/lib/python3.5/site-packages/kudu/errors.pyx
>  in kudu.errors.check_status (kudu/errors.cpp:1314)()
> KuduBadStatus: b'Incomplete: not enough mutation buffer space remaining for 
> operation: required additional 225 when 7339950 of 7340032 already used'
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to