Mike Percy has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/10839 )
Change subject: spark: Expose socketReadTimeoutMs to Spark connector ...................................................................... spark: Expose socketReadTimeoutMs to Spark connector This patch exposes socketReadTimeoutMs in the KuduContext and the DefaultSource. This patch also performs a bit of cleanup by renaming the KuduConnection object to KuduClientCache, which seems like a more appropriate name. Because socketReadTimeout is a KuduClient configuration parameter related to connection handling, socketReadTimeout was incorporated into the client cache key. Manually tested in spark-shell using spark-on-yarn. Added a basic test to ensure that the parameter is properly parsed by the DefaultSource and configured in the KuduRelation instance. Change-Id: I0ab0ff0b242790caffb7e2848958148ffe547c4d Reviewed-on: http://gerrit.cloudera.org:8080/10839 Tested-by: Kudu Jenkins Reviewed-by: Dan Burkert <danburk...@apache.org> --- M java/kudu-spark/src/main/scala/org/apache/kudu/spark/kudu/DefaultSource.scala M java/kudu-spark/src/main/scala/org/apache/kudu/spark/kudu/KuduContext.scala M java/kudu-spark/src/main/scala/org/apache/kudu/spark/kudu/KuduRDD.scala M java/kudu-spark/src/test/scala/org/apache/kudu/spark/kudu/DefaultSourceTest.scala M java/kudu-spark/src/test/scala/org/apache/kudu/spark/kudu/KuduContextTest.scala 5 files changed, 61 insertions(+), 27 deletions(-) Approvals: Kudu Jenkins: Verified Dan Burkert: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/10839 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I0ab0ff0b242790caffb7e2848958148ffe547c4d Gerrit-Change-Number: 10839 Gerrit-PatchSet: 6 Gerrit-Owner: Mike Percy <mpe...@apache.org> Gerrit-Reviewer: Dan Burkert <danburk...@apache.org> Gerrit-Reviewer: Grant Henke <granthe...@apache.org> Gerrit-Reviewer: Kudu Jenkins Gerrit-Reviewer: Mike Percy <mpe...@apache.org>
