Dan Burkert has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/8922 )
Change subject: [spark] Avoid using TraversableLike.map in RowIterator.next() ...................................................................... [spark] Avoid using TraversableLike.map in RowIterator.next() RowIterator.next() currently uses TraversableLike.map operation to iterate over the columns in a Kudu RowResult. However, it's a generic function that is not optimized for primitive integers, and profiling revealed that it adds non-trivial overhead to executor performance. By replacing it with Range.foreach (which is specialized for integers), we could reduce the response times of single-column aggregation queries by around 30%. e.g. "select max(col) from warmed_up_table" Change-Id: I85ab882d5695ccb2fee09fe7a124129cf4610d56 Reviewed-on: http://gerrit.cloudera.org:8080/8922 Reviewed-by: Dan Burkert <[email protected]> Tested-by: Kudu Jenkins --- M java/kudu-spark/src/main/scala/org/apache/kudu/spark/kudu/KuduRDD.scala 1 file changed, 6 insertions(+), 1 deletion(-) Approvals: Dan Burkert: Looks good to me, approved Kudu Jenkins: Verified -- To view, visit http://gerrit.cloudera.org:8080/8922 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I85ab882d5695ccb2fee09fe7a124129cf4610d56 Gerrit-Change-Number: 8922 Gerrit-PatchSet: 2 Gerrit-Owner: Junegunn Choi <[email protected]> Gerrit-Reviewer: Dan Burkert <[email protected]> Gerrit-Reviewer: Hao Hao <[email protected]> Gerrit-Reviewer: Kudu Jenkins
