----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/51895/ -----------------------------------------------------------
Review request for hive, Chaoyu Tang, Naveen Gangam, and Barna Zsombor Klara. Repository: hive-git Description ------- HIVE-14714 - Finishing Hive on Spark causes "java.io.IOException: Stream closed" Diffs ----- spark-client/src/main/java/org/apache/hive/spark/client/SparkClientImpl.java e8ca42aa22f0b312e009bea19e39adc8bd31e2b4 Diff: https://reviews.apache.org/r/51895/diff/ Testing ------- As the modification result is related to logging and the spark job submission it would require too much efforts to create unit tests. Tested manually by "highjacking" $SPARK_HOME/bin/spark-submit script to reproduce the following scenarios: - The submit process does not exit after the RemoteDriver stopped - Generating some output for less time than the actual redirector timeout - Generating output for more time than the actual redirector timeout - The submit process ends properly after the RemoteDriver stopped Expected behavior: After ending the actual session the client exits immediately (beeline). All the stdout/stderr of the RemoteDriver are captured properly in the hive.log until the redirector timeout. Thanks, Gabor Szadovszky
