Junegunn Choi has uploaded this change for review. ( http://gerrit.cloudera.org:8080/8922
Change subject: [spark] Avoid using TraversableLike.map in RowIterator.next() ...................................................................... [spark] Avoid using TraversableLike.map in RowIterator.next() RowIterator.next() currently uses TraversableLike.map operation to iterate over the columns in a Kudu RowResult. However, it's a generic function that is not optimized for primitive integers, and profiling revealed that it adds non-trivial overhead to executor performance. By replacing it with Range.foreach (which is specialized for integers), we could reduce the response times of single-column aggregation queries by around 30%. e.g. "select max(col) from warmed_up_table" Change-Id: I85ab882d5695ccb2fee09fe7a124129cf4610d56 --- M java/kudu-spark/src/main/scala/org/apache/kudu/spark/kudu/KuduRDD.scala 1 file changed, 6 insertions(+), 1 deletion(-) git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/22/8922/1 -- To view, visit http://gerrit.cloudera.org:8080/8922 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I85ab882d5695ccb2fee09fe7a124129cf4610d56 Gerrit-Change-Number: 8922 Gerrit-PatchSet: 1 Gerrit-Owner: Junegunn Choi <[email protected]>
