Github user eatoncys commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132368646
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -572,6 +572,14 @@ object SQLConf {
"disable logging or
Github user eatoncys commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132368484
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala
---
@@ -370,6 +370,14 @@ case class
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/18810
Btw, can you change `[sql]` to `[SQL]` in title?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132367400
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -572,6 +572,14 @@ object SQLConf {
"disable logging or
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132367041
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -572,6 +572,14 @@ object SQLConf {
"disable logging or
Github user zhengruifeng closed the pull request at:
https://github.com/apache/spark/pull/17995
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132366896
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeFormatter.scala
---
@@ -89,6 +89,14 @@ object CodeFormatter {
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132366187
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala
---
@@ -370,6 +370,14 @@ case class
Github user eatoncys commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132365359
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -572,6 +572,13 @@ object SQLConf {
"disable logging or
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18810
**[Test build #80475 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80475/testReport)**
for PR 18810 at commit
Github user eatoncys commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132365401
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala
---
@@ -356,6 +356,19 @@ class CodegenContext
Github user eatoncys commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132365436
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala
---
@@ -356,6 +356,19 @@ class CodegenContext
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/18865#discussion_r132364612
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JsonFileFormat.scala
---
@@ -114,7 +114,16 @@ class JsonFileFormat
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132363994
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala
---
@@ -356,6 +356,19 @@ class
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/18865#discussion_r132363687
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JsonFileFormat.scala
---
@@ -114,7 +114,16 @@ class JsonFileFormat
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/18865#discussion_r132363283
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JsonFileFormat.scala
---
@@ -114,7 +114,16 @@ class JsonFileFormat
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/18865#discussion_r132361425
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JsonFileFormat.scala
---
@@ -114,7 +114,16 @@ class JsonFileFormat
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18810
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18810
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80472/
Test FAILed.
---
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/17849#discussion_r132361043
--- Diff: python/pyspark/ml/tests.py ---
@@ -1572,7 +1588,8 @@ def test_java_params(self):
for name, cls in inspect.getmembers(module,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18810
**[Test build #80472 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80472/testReport)**
for PR 18810 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18900
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132360895
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala
---
@@ -356,6 +356,19 @@ class
Github user debugger87 commented on the issue:
https://github.com/apache/spark/pull/18900
@cloud-fan could you please help me to review this PR?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
GitHub user debugger87 opened a pull request:
https://github.com/apache/spark/pull/18900
[SPARK-21687][SQL] Spark SQL should set createTime for Hive partition
## What changes were proposed in this pull request?
Set createTime for every hive partition created in Spark SQL,
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132360710
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -572,6 +572,13 @@ object SQLConf {
"disable logging
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/17849#discussion_r132360643
--- Diff: python/pyspark/ml/classification.py ---
@@ -1325,7 +1325,7 @@ def __init__(self, featuresCol="features",
labelCol="label", predictionCol="pred
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18810
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18810
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80471/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18810
**[Test build #80471 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80471/testReport)**
for PR 18810 at commit
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/17849#discussion_r132360069
--- Diff: python/pyspark/ml/tests.py ---
@@ -417,6 +417,54 @@ def test_logistic_regression_check_thresholds(self):
LogisticRegression,
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132359678
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegenExec.scala
---
@@ -370,6 +370,15 @@ case class
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/17849#discussion_r132359369
--- Diff: python/pyspark/ml/wrapper.py ---
@@ -144,7 +158,9 @@ def _transfer_params_from_java(self):
if self._java_obj.hasParam(param.name):
Github user phatak-dev commented on the issue:
https://github.com/apache/spark/pull/17972
@MLnick Any updates on this?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/17849#discussion_r132358656
--- Diff: python/pyspark/ml/wrapper.py ---
@@ -263,7 +284,8 @@ def _fit_java(self, dataset):
def _fit(self, dataset):
java_model
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18810
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80470/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18810
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18810
**[Test build #80470 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80470/testReport)**
for PR 18810 at commit
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/17849
Sorry, let me try and take a look tomorrow.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/17849#discussion_r132357684
--- Diff: python/pyspark/ml/wrapper.py ---
@@ -135,6 +135,20 @@ def _transfer_param_map_to_java(self, pyParamMap):
paramMap.put([pair])
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18544
**[Test build #80474 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80474/testReport)**
for PR 18544 at commit
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/18865#discussion_r132357070
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JsonFileFormat.scala
---
@@ -114,7 +114,16 @@ class JsonFileFormat
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18899
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18899
**[Test build #80473 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80473/testReport)**
for PR 18899 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18899
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80473/
Test PASSed.
---
Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/17849#discussion_r132355421
--- Diff: python/pyspark/ml/wrapper.py ---
@@ -135,6 +135,20 @@ def _transfer_param_map_to_java(self, pyParamMap):
Github user weiqingy commented on the issue:
https://github.com/apache/spark/pull/17342
@steveloughran Thanks Steve.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user ajbozarth commented on the issue:
https://github.com/apache/spark/pull/18893
Since they're both small and this is already open I'd say leave it, unless
someone ends up having issues with one of the fixes
---
If your project is set up for it, you can reply to this email
Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/18865#discussion_r132352189
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/json/JsonFileFormat.scala
---
@@ -114,7 +114,16 @@ class JsonFileFormat
Github user lvdongr commented on the issue:
https://github.com/apache/spark/pull/18756
You mean we can provide the different type of values with different
default values? like int with 0 ,and string with "" ?Or we set the default
values when define the table? @gatorsmile @maropu
Github user viirya commented on the issue:
https://github.com/apache/spark/pull/18895
@byakuinss Please add a doc test in `DataFrame.replace`. There is an
example `df4.na.replace('Alice', None).show()`. We want to make sure it works
with default value. Thanks.
---
If your
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/17849
Oh, wait, this looks not requiring ML bit much. Will try to give a pass.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/17849
I am rather a backend developer and work together with data scientists. So,
my ML knowledge is limited (am studying hard :)). Will leave few comments
together if there are some nits and someone
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18899
**[Test build #80473 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80473/testReport)**
for PR 18899 at commit
GitHub user mpjlu opened a pull request:
https://github.com/apache/spark/pull/18899
[SPARK-21680][ML][MLLIB]optimzie Vector coompress
## What changes were proposed in this pull request?
When use Vector.compressed to change a Vector to SparseVector, the
performance is very
Github user yaooqinn commented on the issue:
https://github.com/apache/spark/pull/18648
ping @jiangxb1987 @cloud-fan anymore suggestionsï¼
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18630
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80468/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18630
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18630
**[Test build #80468 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80468/testReport)**
for PR 18630 at commit
Github user yaooqinn commented on the issue:
https://github.com/apache/spark/pull/18893
@ajbozarth do we need another pr to separate these? if necessary, I will
do that.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well.
Github user eatoncys commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132347436
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala
---
@@ -356,6 +356,18 @@ class CodegenContext
Github user eatoncys commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132347148
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeGenerator.scala
---
@@ -356,6 +356,18 @@ class CodegenContext
Github user eatoncys commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132347198
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -572,6 +572,13 @@ object SQLConf {
"disable logging or
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18810
**[Test build #80472 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80472/testReport)**
for PR 18810 at commit
Github user eatoncys commented on a diff in the pull request:
https://github.com/apache/spark/pull/18810#discussion_r132347018
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/AggregateBenchmark.scala
---
@@ -301,6 +301,61 @@ class AggregateBenchmark
Github user yaooqinn commented on the issue:
https://github.com/apache/spark/pull/18893
test this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so,
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18810
**[Test build #80471 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80471/testReport)**
for PR 18810 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18895
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18895
**[Test build #80469 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80469/testReport)**
for PR 18895 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18895
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80469/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18810
**[Test build #80470 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80470/testReport)**
for PR 18810 at commit
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/18756
In the most cases of `SELECT` statements, `default_value` is `NULL` by
default. So, I firstly thought non-specified columns were filled with `NULL`.
Anyway, we still have any chance to implement
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/18895
**[Test build #80469 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80469/testReport)**
for PR 18895 at commit
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/18895
ok to test
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/18895
Could we add the example in the doctest (under 1362L) so that this can be
tested and shown in the documentation?
---
If your project is set up for it, you can reply to this email and have your
Github user maropu commented on the issue:
https://github.com/apache/spark/pull/18882
Any activity for cost-based inference? Anyway, thanks! I'll close this for
now.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user maropu closed the pull request at:
https://github.com/apache/spark/pull/18882
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/18882
Thanks for working on it, but the inferred one is not useless. The removal
has to be cost based.
---
If your project is set up for it, you can reply to this email and have your
reply appear on
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/18820
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/18820
Thanks! Merging to master.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/18898
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
GitHub user bravo-zhang opened a pull request:
https://github.com/apache/spark/pull/18898
[SPARK-21245][ML] Resolve code duplication for classification/regression
summarizers
## Why the change?
In several places (LogReg, LinReg, SVC) in Spark ML, we collect summary
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/18630
Ok, thanks for checking. It doesn't look like it's coming from your
changes, so I'm sure it's just me.
---
If your project is set up for it, you can reply to this email and have your
reply
Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/18734
huzzah! I'm in the middle of getting some code working for a talk tomorrow
so I'll circle back on this on Friday. If @davies has any opinions though it
would be great to hear them.
---
If your
Github user holdenk commented on a diff in the pull request:
https://github.com/apache/spark/pull/18734#discussion_r132334455
--- Diff: python/pyspark/cloudpickle.py ---
@@ -397,42 +625,7 @@ def save_global(self, obj, name=None,
pack=struct.pack):
typ =
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/18630
This is how I build things:
./build/mvn -Pmesos -Phadoop-2.7 -Dhadoop.version=2.7.0 -DskipTests clean
package
# -DskipTests clean package
export
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/18630
@BryanCutler sure check here, it works:
https://gist.github.com/skonto/dc2070d1529c97ec5de32e99983a834f
---
If your project is set up for it, you can reply to this email and have your
reply
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/18630
Maybe it was just something with my env - but I was running it locally, can
you just verify that works too? Just don't specify the `--master` conf and run
out of your spark home dir
---
If
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16158
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/18630
> spark-2.3.0-SNAPSHOT-bin-18630/bin$ ./spark-shell --verbose --master
spark://ip-10-10-1-79:7077
Using properties file: null
Parsed arguments:
master
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/16158
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80467/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/16158
**[Test build #80467 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80467/testReport)**
for PR 16158 at commit
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/18630
Yeah, just by running `bin/spark-shell` it failed immediately with that
error. I double-check by rebuilding and same thing but I'm not sure if was
something from your changes or not. Are you
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/18630
@BryanCutler you just started spark shell and it failed? How can I
reproduce it?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/18630
Sure, python support could be added at a later point, I was just thinking
if it was only a small addition to what's already here, but no problem. Btw,
after checking out this PR I tried
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/18630
I wasn't really expecting python support to be added here. I wonder if
there's a bug open for that.
---
If your project is set up for it, you can reply to this email and have your
reply appear on
Github user BryanCutler commented on a diff in the pull request:
https://github.com/apache/spark/pull/17849#discussion_r132330891
--- Diff: python/pyspark/ml/wrapper.py ---
@@ -263,7 +284,8 @@ def _fit_java(self, dataset):
def _fit(self, dataset):
Github user skonto commented on the issue:
https://github.com/apache/spark/pull/18630
@BryanCutler @vanzin to make things testable DriverWrapper needs
refactoring from a quick look I took.
py files are resolved in client mode, let's fix it in another PR (I could
do it). The
Github user rgbkrk commented on the issue:
https://github.com/apache/spark/pull/18734
Just a note that we just shipped the fixes from @HyukjinKwon within
cloudpickle (as v0.4.0), so we're at least roughly in sync now. ð
---
If your project is set up for it, you can reply to this
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/17849
ping @holdenk , also @HyukjinKwon if you are able to take a look
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
1 - 100 of 392 matches
Mail list logo
