[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19876 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19876 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1727/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19876 **[Test build #88546 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88546/testReport)** for PR 19876 at commit [`cb6fd70`](https://github.com/apache/spark/commit/cb6fd70d0c61b6477f7514431ee2e1c097ec0aff). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19876 LGTM pending Jenkins will merge. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19876 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19876 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88534/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19876 **[Test build #88534 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88534/testReport)** for PR 19876 at commit [`9075626`](https://github.com/apache/spark/commit/9075627f708e271f3bf502a67c28c8810fa7). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19876 **[Test build #88534 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88534/testReport)** for PR 19876 at commit [`9075626`](https://github.com/apache/spark/commit/9075627f708e271f3bf502a67c28c8810fa7). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19876 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19876 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1716/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19876 See some related thoughts in how to support Spark in kubeflow: https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/issues/119 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19876 Will do a last pass myself and merge on Friday if no one else has opinions. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19876 March 15th is soon, any thoughts @MLnick @jkbradley @sethah ? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19876 So if no one has comments by March 15th I'm going update the tags & push forward with this API since we need something and this is the design most folks seems to be interested in from the last proposal. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19876 So now that it looks like 2.3 is pretty much wrapped up do folks have any thoughts? @mlnick @jkbradley @sethah ? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19876 re-ping folks ? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19876 also maybe @dbtsai ? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19876 re-ping @MLnick + ping @jkbradley , thoughts? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19876 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19876 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86230/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19876 **[Test build #86230 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86230/testReport)** for PR 19876 at commit [`41312e7`](https://github.com/apache/spark/commit/41312e7fcd6d706323fecb828776fced5e5a769c). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19876 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86229/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19876 **[Test build #86229 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86229/testReport)** for PR 19876 at commit [`cd330f3`](https://github.com/apache/spark/commit/cd330f3f37796f61b8b62a24c5600cf2868b6470). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19876 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19876 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86228/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19876 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19876 **[Test build #86228 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86228/testReport)** for PR 19876 at commit [`4047239`](https://github.com/apache/spark/commit/40472390fe2932900c4d788bf2e19bcfbff12c92). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19876 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86226/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19876 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19876 **[Test build #86226 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86226/testReport)** for PR 19876 at commit [`6411054`](https://github.com/apache/spark/commit/6411054d12ea3d4b98bdc7ad409b392a8cc16a8f). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19876 **[Test build #86230 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86230/testReport)** for PR 19876 at commit [`41312e7`](https://github.com/apache/spark/commit/41312e7fcd6d706323fecb828776fced5e5a769c). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19876 **[Test build #86229 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86229/testReport)** for PR 19876 at commit [`cd330f3`](https://github.com/apache/spark/commit/cd330f3f37796f61b8b62a24c5600cf2868b6470). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19876 **[Test build #86228 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86228/testReport)** for PR 19876 at commit [`4047239`](https://github.com/apache/spark/commit/40472390fe2932900c4d788bf2e19bcfbff12c92). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19876 @MLnick I think the read path could follow a similar approach, but for models which we export from Spark and wish to load back into Spark the internal format is probably the best option. As far as options, this keeps the same stringly typed options interface as we have with Datasources, and individual writers are free to specialize and add their own special methods. I'm open to the idea of punting this, but we've punted PMML export since we introduced ML pipelines and users are still asking for general export support so the feature req hasn't gone away either. If we think the design needs another pass that's fine, but I'd like to suggest that this is probably a good starting block from which we can add more things on top off. If folks agree the foundation isn't bad I think putting it in for 2.3 would be useful (and it's not like we haven't had a long time to consider this design). This specific PR has been open since Dec 4th but we've been looking at variants on this idea for years. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19876 **[Test build #86226 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86226/testReport)** for PR 19876 at commit [`6411054`](https://github.com/apache/spark/commit/6411054d12ea3d4b98bdc7ad409b392a8cc16a8f). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/19876 Do we want to think about an `options` / `option` interface too? I'm not that familiar with whether there could be important options for PMML export, but custom user formats may need it (I could envisage a format for exporting to plain JSON, H2O say, TensorFlow, etc etc that may need to customize the behavior through options) --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user MLnick commented on the issue: https://github.com/apache/spark/pull/19876 So to be clear this doesn't handle the `read` path at all? Would there be a plan to implement a similar read API? Overall I like the idea of an open API for plugging in model serialization formats. This might be a bit too much to put in for 2.3 though? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19876 I'm going to update this tomorrow, but if no one has anything by EOW would folks be OK with this as an experimental developer API for 2.3? cc @JoshRosen ? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #19876: [ML][SPARK-11171][SPARK-11239] Add PMML export to Spark ...
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19876 So @MLnick / @sethah I'd like to put something like this in before we roll 2.3 RC1. Do y'all have any feedback before that? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
