[
https://issues.apache.org/jira/browse/CASSANDRA-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052537#comment-15052537
]
Stefania commented on CASSANDRA-9302:
-------------------------------------
bq. The snippet you show there is still using WhiteList instead of DCAware for
the inner policy.
Thanks, the DCAware policy fixed it, now we have only one session.
bq. If you're interested the cassandra.concurrent module shows this working
with bound methods
Also fixed now, thanks.
bq. This is a little surprising to me, but I trust your empirical observations
and don't want to make a science project out of it. Maybe we're bottlenecking
on server resources instead of per-python CPU. I must admit I haven't
completely characterized workloads that are better-suited for built strings –
I've just seen it in the wild.
I repeated again with the DC aware policy just to be sure and observed timeouts
again. They are server side timeouts, probably because we batch statements. I
did not pursue further and kept prepared statements.
I also fixed a problem with the COPY_*_OPTIONS sets in cqlsh.py, the completion
was broken with the existing code.
I've relaunched CI.
> Optimize cqlsh COPY FROM, part 3
> --------------------------------
>
> Key: CASSANDRA-9302
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9302
> Project: Cassandra
> Issue Type: Improvement
> Components: Tools
> Reporter: Jonathan Ellis
> Assignee: Stefania
> Priority: Critical
> Fix For: 2.1.x
>
>
> We've had some discussion moving to Spark CSV import for bulk load in 3.x,
> but people need a good bulk load tool now. One option is to add a separate
> Java bulk load tool (CASSANDRA-9048), but if we can match that performance
> from cqlsh I would prefer to leave COPY FROM as the preferred option to which
> we point people, rather than adding more tools that need to be supported
> indefinitely.
> Previous work on COPY FROM optimization was done in CASSANDRA-7405 and
> CASSANDRA-8225.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
