[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-27 Thread BryanCutler
Github user BryanCutler commented on the issue:

https://github.com/apache/spark/pull/20839
  
merged to master


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-26 Thread BryanCutler
Github user BryanCutler commented on the issue:

https://github.com/apache/spark/pull/20839
  
Thanks @HyukjinKwon !  I'll merge later today if no more comments.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Merged build finished. Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88554/
Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-23 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/20839
  
**[Test build #88554 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88554/testReport)**
 for PR 20839 at commit 
[`5a43edf`](https://github.com/apache/spark/commit/5a43edf6c2ad0b6dda155a90e8831181376502e7).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 

https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1733/
Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Merged build finished. Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-23 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/20839
  
**[Test build #88554 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88554/testReport)**
 for PR 20839 at commit 
[`5a43edf`](https://github.com/apache/spark/commit/5a43edf6c2ad0b6dda155a90e8831181376502e7).


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Merged build finished. Test FAILed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88552/
Test FAILed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-23 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/20839
  
**[Test build #88552 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88552/testReport)**
 for PR 20839 at commit 
[`1a6be1d`](https://github.com/apache/spark/commit/1a6be1df25a41b5bdcfc0e47378a757be384efab).
 * This patch **fails PySpark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-23 Thread BryanCutler
Github user BryanCutler commented on the issue:

https://github.com/apache/spark/pull/20839
  
### After Reworded Warnings

```
In [2]: spark.createDataFrame(pd.DataFrame([[{u'a': 1}]]), "a: map")
/home/bryan/git/spark/python/pyspark/sql/session.py:688: UserWarning: 
createDataFrame attempted Arrow optimization because 
'spark.sql.execution.arrow.enabled' is set to true, but has reached the error 
below and will not continue because automatic fallback with 
'spark.sql.execution.arrow.fallback.enabled' has been set to false.
  PyArrow >= 0.8.0 must be installed; however, it was not found.
  warnings.warn(msg)
---
ImportError   Traceback (most recent call last)
 in ()
> 1 spark.createDataFrame(pd.DataFrame([[{u'a': 1}]]), "a: map")

~/git/spark/python/pyspark/sql/session.py in createDataFrame(self, data, 
schema, samplingRatio, verifySchema)
665 and len(data) > 0:
666 try:
--> 667 return 
self._create_from_pandas_with_arrow(data, schema, timezone)
668 except Exception as e:
669 from pyspark.util import _exception_message

~/git/spark/python/pyspark/sql/session.py in 
_create_from_pandas_with_arrow(self, pdf, schema, timezone)
508 
509 require_minimum_pandas_version()
--> 510 require_minimum_pyarrow_version()
511 
512 from pandas.api.types import is_datetime64_dtype, 
is_datetime64tz_dtype

~/git/spark/python/pyspark/sql/utils.py in require_minimum_pyarrow_version()
147 if not have_arrow:
148 raise ImportError("PyArrow >= %s must be installed; 
however, "
--> 149   "it was not found." % 
minimum_pyarrow_version)
150 if LooseVersion(pyarrow.__version__) < 
LooseVersion(minimum_pyarrow_version):
151 raise ImportError("PyArrow >= %s must be installed; 
however, "

ImportError: PyArrow >= 0.8.0 must be installed; however, it was not found.
```


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Merged build finished. Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-23 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/20839
  
**[Test build #88552 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88552/testReport)**
 for PR 20839 at commit 
[`1a6be1d`](https://github.com/apache/spark/commit/1a6be1df25a41b5bdcfc0e47378a757be384efab).


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 

https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1731/
Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-23 Thread BryanCutler
Github user BryanCutler commented on the issue:

https://github.com/apache/spark/pull/20839
  
Thanks @HyukjinKwon for reviewing! I agree with what you said about the 
rephrasing the warning message, I'll try to make that sound better.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue:

https://github.com/apache/spark/pull/20839
  
For the best and the min fix, can we rephrase the warning messages to make 
them look more like a warn not an error?


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue:

https://github.com/apache/spark/pull/20839
  
Yea, I agree that the warn way is the min fix. I actually attempted a try 
to fix this locally before and failed to make a clean fix, and I understand the 
complexity here, in particular, because of compatibility between Python 2 and 
Python 3.

I also took a look for `six` and `python-future` to wrap and reraise the 
exceptions in Python 2. The implementation of `six` was missing and 
implementation of `python-future` was incomplete. 

Also, I took a look for the complexity you mentioned when I initially 
proposed the changes in this logic. Looked not quite easy to wrap it manually 
too. 

Only one main concern is, if it makes sense to call it a warn because the 
message contains, for example, the warning message would contain:

```python
... 
"'spark.sql.execution.arrow.enabled' is set to 
true; however, "
 "failed unexpectedly:\n  %s\n"
...
```



---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread BryanCutler
Github user BryanCutler commented on the issue:

https://github.com/apache/spark/pull/20839
  
@HyukjinKwon and @ueshin I came close to a solution that would wrap the 
exception message like before but still keep the exception type and traceback.  
The problem was there are too many variations in python exceptions and it was 
getting too complicated to be foolproof.  For instance, `ImportError` does not 
use `args` for the message, but has another attribute `message` in Python 2 and 
`msg` in Python 3.

To keep things simple for this, I thought it would be fine when fallback is 
disabled, to still print a warning message to indicate the related conf, and 
then use `raise` to re-raise the exception which retains the original exception 
with traceback.  I manually ran tests of toPandas and createDataFrame with 
Python 2 & 3 and it looks cleaner imo.  What do you guys think?


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88488/
Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Merged build finished. Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/20839
  
**[Test build #88488 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88488/testReport)**
 for PR 20839 at commit 
[`55209b0`](https://github.com/apache/spark/commit/55209b0de21fb4ee812f71026d725e244b1d680f).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/20839
  
**[Test build #88488 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88488/testReport)**
 for PR 20839 at commit 
[`55209b0`](https://github.com/apache/spark/commit/55209b0de21fb4ee812f71026d725e244b1d680f).


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 

https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1693/
Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Merged build finished. Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Merged build finished. Test FAILed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Test FAILed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88487/
Test FAILed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/20839
  
**[Test build #88487 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88487/testReport)**
 for PR 20839 at commit 
[`17dd605`](https://github.com/apache/spark/commit/17dd6053e466f214c852807b0d11db0961062c0a).
 * This patch **fails PySpark unit tests**.
 * This patch merges cleanly.
 * This patch adds no public classes.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread BryanCutler
Github user BryanCutler commented on the issue:

https://github.com/apache/spark/pull/20839
  
### Before with Python 2, missing traceback and doesn't show as 
`ImportError`

```
In [4]: spark.createDataFrame(pd.DataFrame([[{u'a': 1}]]), "a: map")
---
RuntimeError  Traceback (most recent call last)
 in ()
> 1 spark.createDataFrame(pd.DataFrame([[{u'a': 1}]]), "a: map")

/home/bryan/git/spark/python/pyspark/sql/session.py in 
createDataFrame(self, data, schema, samplingRatio, verifySchema)
686 "For fallback to non-optimization 
automatically, please set true to "
687 
"'spark.sql.execution.arrow.fallback.enabled'." % _exception_message(e))
--> 688 raise RuntimeError(msg)
689 data = self._convert_from_pandas(data, schema, timezone)
690 

RuntimeError: createDataFrame attempted Arrow optimization because 
'spark.sql.execution.arrow.enabled' is set to true; however, failed by the 
reason below:
  PyArrow >= 0.8.0 must be installed; however, it was not found.
For fallback to non-optimization automatically, please set true to 
'spark.sql.execution.arrow.fallback.enabled'.
```

### Before with Python 3, each time another error is raised in the catch 
block it gets chained

```
In [2]: spark.createDataFrame(pd.DataFrame([[{u'a': 1}]]), "a: map")
---
ModuleNotFoundError   Traceback (most recent call last)
~/git/spark/python/pyspark/sql/utils.py in require_minimum_pyarrow_version()
139 try:
--> 140 import pyarrow
141 except ImportError:

ModuleNotFoundError: No module named 'pyarrow'

During handling of the above exception, another exception occurred:

ImportError   Traceback (most recent call last)
~/git/spark/python/pyspark/sql/session.py in createDataFrame(self, data, 
schema, samplingRatio, verifySchema)
666 try:
--> 667 return 
self._create_from_pandas_with_arrow(data, schema, timezone)
668 except Exception as e:

~/git/spark/python/pyspark/sql/session.py in 
_create_from_pandas_with_arrow(self, pdf, schema, timezone)
509 require_minimum_pandas_version()
--> 510 require_minimum_pyarrow_version()
511 

~/git/spark/python/pyspark/sql/utils.py in require_minimum_pyarrow_version()
142 raise ImportError("PyArrow >= %s must be installed; 
however, "
--> 143   "it was not found." % 
minimum_pyarrow_version)
144 if LooseVersion(pyarrow.__version__) < 
LooseVersion(minimum_pyarrow_version):

ImportError: PyArrow >= 0.8.0 must be installed; however, it was not found.

During handling of the above exception, another exception occurred:

RuntimeError  Traceback (most recent call last)
 in ()
> 1 spark.createDataFrame(pd.DataFrame([[{u'a': 1}]]), "a: map")

~/git/spark/python/pyspark/sql/session.py in createDataFrame(self, data, 
schema, samplingRatio, verifySchema)
686 "For fallback to non-optimization 
automatically, please set true to "
687 
"'spark.sql.execution.arrow.fallback.enabled'." % _exception_message(e))
--> 688 raise RuntimeError(msg)
689 data = self._convert_from_pandas(data, schema, timezone)
690 

RuntimeError: createDataFrame attempted Arrow optimization because 
'spark.sql.execution.arrow.enabled' is set to true; however, failed by the 
reason below:
  PyArrow >= 0.8.0 must be installed; however, it was not found.
For fallback to non-optimization automatically, please set true to 
'spark.sql.execution.arrow.fallback.enabled'.
```

### After change with Python 2 & 3, warning is printed then error is 
re-raised

```
In [2]: spark.createDataFrame(pd.DataFrame([[{u'a': 1}]]), "a: map")
/home/bryan/git/spark/python/pyspark/sql/session.py:686: UserWarning: 
createDataFrame attempted Arrow optimization because 
'spark.sql.execution.arrow.enabled' is set to true; however, failed by the 
reason below:
  PyArrow >= 0.8.0 must be installed; however, it was not found.
For fallback to non-optimization automatically, please set true to 
'spark.sql.execution.arrow.fallback.enabled'.
  warnings.warn(msg)
---
ImportError   Traceback (most recent call last)
 in ()
> 1 spark.cr

[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Merged build finished. Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 

https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1692/
Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-21 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/20839
  
**[Test build #88487 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88487/testReport)**
 for PR 20839 at commit 
[`17dd605`](https://github.com/apache/spark/commit/17dd6053e466f214c852807b0d11db0961062c0a).


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-15 Thread BryanCutler
Github user BryanCutler commented on the issue:

https://github.com/apache/spark/pull/20839
  
@HyukjinKwon, @ueshin please take a look when you can


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Merged build finished. Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88281/
Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-15 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/20839
  
**[Test build #88281 has 
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88281/testReport)**
 for PR 20839 at commit 
[`5caf63c`](https://github.com/apache/spark/commit/5caf63cc32a7546823e64d774faee9fb63a6b286).
 * This patch passes all tests.
 * This patch merges cleanly.
 * This patch adds no public classes.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-15 Thread SparkQA
Github user SparkQA commented on the issue:

https://github.com/apache/spark/pull/20839
  
**[Test build #88281 has 
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88281/testReport)**
 for PR 20839 at commit 
[`5caf63c`](https://github.com/apache/spark/commit/5caf63cc32a7546823e64d774faee9fb63a6b286).


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Merged build finished. Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org



[GitHub] spark issue #20839: [SPARK-23699][PYTHON][SQL] Raise same type of error caug...

2018-03-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue:

https://github.com/apache/spark/pull/20839
  
Test PASSed.
Refer to this link for build results (access rights to CI server needed): 

https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1543/
Test PASSed.


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org