Sequential splits causing unbalanced MapReduce load
---------------------------------------------------
Key: CASSANDRA-1096
URL: https://issues.apache.org/jira/browse/CASSANDRA-1096
Project: Cassandra
Issue Type: Bug
Components: Hadoop
Affects Versions: 0.6
Reporter: Joost Ouwerkerk
Since CassandraInputFormat returns an ordered list of splits, when there are
many splits (e.g. hundreds or more) the load on cassandra is horribly
unbalanced. e.g. if I have 30 tasks processing 600 splits, then the rows for
the first 30 splits are all located on the same one or two nodes.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
