[jira] [Commented] (SPARK-38174) SparkR documentation build fails in CI

[ https://issues.apache.org/jira/browse/SPARK-38174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17490344#comment-17490344 ] Maciej Szymkiewicz commented on SPARK-38174: And now, it is green again :/

[jira] [Commented] (SPARK-38174) SparkR documentation build fails in CI

[ https://issues.apache.org/jira/browse/SPARK-38174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17490574#comment-17490574 ] Maciej Szymkiewicz commented on SPARK-38174: I also compared the last failin

[jira] [Commented] (SPARK-38174) SparkR documentation build fails in CI

[ https://issues.apache.org/jira/browse/SPARK-38174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17490877#comment-17490877 ] Maciej Szymkiewicz commented on SPARK-38174: Done some more digging, and I b

[jira] [Commented] (SPARK-37405) Inline type hints for python/pyspark/ml/feature.py

[ https://issues.apache.org/jira/browse/SPARK-37405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17491363#comment-17491363 ] Maciej Szymkiewicz commented on SPARK-37405: I am gonna handle this one. >

[jira] [Resolved] (SPARK-37413) Inline type hints for python/pyspark/ml/tree.py

[ https://issues.apache.org/jira/browse/SPARK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37413. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35420

[jira] [Assigned] (SPARK-37413) Inline type hints for python/pyspark/ml/tree.py

[ https://issues.apache.org/jira/browse/SPARK-37413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37413: -- Assignee: dch nguyen > Inline type hints for python/pyspark/ml/tree.py >

[jira] [Commented] (SPARK-37425) Inline type hints for python/pyspark/mllib/recommendation.py

[ https://issues.apache.org/jira/browse/SPARK-37425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492616#comment-17492616 ] Maciej Szymkiewicz commented on SPARK-37425: Hi [~amirkdv] Just FYI ‒ most

[jira] [Assigned] (SPARK-37155) Inline type hints for python/pyspark/statcounter.py

[ https://issues.apache.org/jira/browse/SPARK-37155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37155: -- Assignee: dch nguyen > Inline type hints for python/pyspark/statcounter.py >

[jira] [Assigned] (SPARK-37155) Inline type hints for python/pyspark/statcounter.py

[ https://issues.apache.org/jira/browse/SPARK-37155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37155: -- Assignee: (was: Byron Hsu) > Inline type hints for python/pyspark/statcou

[jira] [Assigned] (SPARK-37156) Inline type hints for python/pyspark/storagelevel.py

[ https://issues.apache.org/jira/browse/SPARK-37156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37156: -- Assignee: dch nguyen (was: Apache Spark) > Inline type hints for python/pysp

[jira] [Resolved] (SPARK-37411) Inline type hints for python/pyspark/ml/regression.py

[ https://issues.apache.org/jira/browse/SPARK-37411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37411. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35427

[jira] [Assigned] (SPARK-37411) Inline type hints for python/pyspark/ml/regression.py

[ https://issues.apache.org/jira/browse/SPARK-37411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37411: -- Assignee: Maciej Szymkiewicz > Inline type hints for python/pyspark/ml/regres

[jira] [Assigned] (SPARK-37410) Inline type hints for python/pyspark/ml/recommendation.py

[ https://issues.apache.org/jira/browse/SPARK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37410: -- Assignee: Maciej Szymkiewicz > Inline type hints for python/pyspark/ml/recomm

[jira] [Resolved] (SPARK-37410) Inline type hints for python/pyspark/ml/recommendation.py

[ https://issues.apache.org/jira/browse/SPARK-37410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37410. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35429

[jira] [Created] (SPARK-38239) AttributeError: 'LogisticRegressionModel' object has no attribute '_call_java'

Maciej Szymkiewicz created SPARK-38239: -- Summary: AttributeError: 'LogisticRegressionModel' object has no attribute '_call_java' Key: SPARK-38239 URL: https://issues.apache.org/jira/browse/SPARK-38239

[jira] [Created] (SPARK-38243) Unintended exception thrown in pyspark.ml.LogisticRegression.getThreshold

Maciej Szymkiewicz created SPARK-38243: -- Summary: Unintended exception thrown in pyspark.ml.LogisticRegression.getThreshold Key: SPARK-38243 URL: https://issues.apache.org/jira/browse/SPARK-38243

[jira] [Updated] (SPARK-38243) Unintended exception thrown in pyspark.ml.LogisticRegression.getThreshold

[ https://issues.apache.org/jira/browse/SPARK-38243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-38243: --- Description: If {{LogisticRegression.getThreshold}} is called with model having mult

[jira] [Updated] (SPARK-38243) Unintended exception thrown in pyspark.ml.LogisticRegression.getThreshold

[ https://issues.apache.org/jira/browse/SPARK-38243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-38243: --- Description: If {{LogisticRegression.getThreshold}} is called with model having mult

[jira] [Assigned] (SPARK-37154) Inline type hints for python/pyspark/rdd.py

[ https://issues.apache.org/jira/browse/SPARK-37154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37154: -- Assignee: Maciej Szymkiewicz > Inline type hints for python/pyspark/rdd.py >

[jira] [Resolved] (SPARK-37154) Inline type hints for python/pyspark/rdd.py

[ https://issues.apache.org/jira/browse/SPARK-37154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37154. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35252

[jira] [Resolved] (SPARK-37094) Inline type hints for files in python/pyspark

[ https://issues.apache.org/jira/browse/SPARK-37094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37094. Fix Version/s: 3.3.0 Resolution: Fixed > Inline type hints for files in pyt

[jira] [Commented] (SPARK-37430) Inline type hints for python/pyspark/mllib/linalg/distributed.py

[ https://issues.apache.org/jira/browse/SPARK-37430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17494939#comment-17494939 ] Maciej Szymkiewicz commented on SPARK-37430: [~jyoti_08] Hard prerequisites

[jira] [Assigned] (SPARK-37428) Inline type hints for python/pyspark/mllib/util.py

[ https://issues.apache.org/jira/browse/SPARK-37428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37428: -- Assignee: Maciej Szymkiewicz > Inline type hints for python/pyspark/mllib/uti

[jira] [Resolved] (SPARK-37428) Inline type hints for python/pyspark/mllib/util.py

[ https://issues.apache.org/jira/browse/SPARK-37428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37428. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35532

[jira] [Assigned] (SPARK-37427) Inline type hints for python/pyspark/mllib/tree.py

[ https://issues.apache.org/jira/browse/SPARK-37427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37427: -- Assignee: Maciej Szymkiewicz > Inline type hints for python/pyspark/mllib/tre

[jira] [Resolved] (SPARK-37427) Inline type hints for python/pyspark/mllib/tree.py

[ https://issues.apache.org/jira/browse/SPARK-37427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37427. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35545

[jira] [Resolved] (SPARK-37422) Inline type hints for python/pyspark/mllib/feature.py

[ https://issues.apache.org/jira/browse/SPARK-37422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37422. Fix Version/s: 3.3.0 Assignee: Maciej Szymkiewicz Resolution: Fixed

[jira] [Assigned] (SPARK-37400) Inline type hints for python/pyspark/mllib/classification.py

[ https://issues.apache.org/jira/browse/SPARK-37400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37400: -- Assignee: Maciej Szymkiewicz > Inline type hints for python/pyspark/mllib/cla

[jira] [Resolved] (SPARK-37426) Inline type hints for python/pyspark/mllib/regression.py

[ https://issues.apache.org/jira/browse/SPARK-37426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37426. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35585

[jira] [Resolved] (SPARK-37400) Inline type hints for python/pyspark/mllib/classification.py

[ https://issues.apache.org/jira/browse/SPARK-37400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37400. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35585

[jira] [Assigned] (SPARK-37426) Inline type hints for python/pyspark/mllib/regression.py

[ https://issues.apache.org/jira/browse/SPARK-37426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37426: -- Assignee: Maciej Szymkiewicz > Inline type hints for python/pyspark/mllib/reg

[jira] [Created] (SPARK-38424) Disallow unused casts and ignores

Maciej Szymkiewicz created SPARK-38424: -- Summary: Disallow unused casts and ignores Key: SPARK-38424 URL: https://issues.apache.org/jira/browse/SPARK-38424 Project: Spark Issue Type: Imp

[jira] [Assigned] (SPARK-37421) Inline type hints for python/pyspark/mllib/evaluation.py

[ https://issues.apache.org/jira/browse/SPARK-37421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37421: -- Assignee: dch nguyen > Inline type hints for python/pyspark/mllib/evaluation.

[jira] [Resolved] (SPARK-37421) Inline type hints for python/pyspark/mllib/evaluation.py

[ https://issues.apache.org/jira/browse/SPARK-37421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37421. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34680

[jira] [Assigned] (SPARK-37430) Inline type hints for python/pyspark/mllib/linalg/distributed.py

[ https://issues.apache.org/jira/browse/SPARK-37430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37430: -- Assignee: alper tankut turker > Inline type hints for python/pyspark/mllib/li

[jira] [Resolved] (SPARK-37430) Inline type hints for python/pyspark/mllib/linalg/distributed.py

[ https://issues.apache.org/jira/browse/SPARK-37430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37430. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35739

[jira] [Resolved] (SPARK-37425) Inline type hints for python/pyspark/mllib/recommendation.py

[ https://issues.apache.org/jira/browse/SPARK-37425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37425. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35766

[jira] [Assigned] (SPARK-37425) Inline type hints for python/pyspark/mllib/recommendation.py

[ https://issues.apache.org/jira/browse/SPARK-37425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37425: -- Assignee: dch nguyen > Inline type hints for python/pyspark/mllib/recommendat

[jira] [Updated] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-2620: -- Affects Version/s: 2.2.0 > case class cannot be used as key for reduce > ---

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487209#comment-16487209 ] Maciej Szymkiewicz commented on SPARK-24359: Just my two cents: * As propose

[jira] [Comment Edited] (SPARK-17333) Make pyspark interface friendly with static analysis

[ https://issues.apache.org/jira/browse/SPARK-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16751040#comment-16751040 ] Maciej Szymkiewicz edited comment on SPARK-17333 at 1/24/19 11:53 AM:

[jira] [Comment Edited] (SPARK-17333) Make pyspark interface friendly with static analysis

[ https://issues.apache.org/jira/browse/SPARK-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16751040#comment-16751040 ] Maciej Szymkiewicz edited comment on SPARK-17333 at 1/24/19 11:53 AM:

[jira] [Comment Edited] (SPARK-17333) Make pyspark interface friendly with static analysis

[ https://issues.apache.org/jira/browse/SPARK-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16751040#comment-16751040 ] Maciej Szymkiewicz edited comment on SPARK-17333 at 1/24/19 11:54 AM:

[jira] [Commented] (SPARK-17333) Make pyspark interface friendly with static analysis

[ https://issues.apache.org/jira/browse/SPARK-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16751040#comment-16751040 ] Maciej Szymkiewicz commented on SPARK-17333: [~Alexander_Gorokhov] Personall

[jira] [Comment Edited] (SPARK-17333) Make pyspark interface friendly with static analysis

[ https://issues.apache.org/jira/browse/SPARK-17333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16751040#comment-16751040 ] Maciej Szymkiewicz edited comment on SPARK-17333 at 1/24/19 11:58 AM:

[jira] [Commented] (SPARK-19161) Improving UDF Docstrings

[ https://issues.apache.org/jira/browse/SPARK-19161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15817902#comment-15817902 ] Maciej Szymkiewicz commented on SPARK-19161: If we decide to use function and

[jira] [Comment Edited] (SPARK-19161) Improving UDF Docstrings

[ https://issues.apache.org/jira/browse/SPARK-19161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15817902#comment-15817902 ] Maciej Szymkiewicz edited comment on SPARK-19161 at 1/11/17 10:20 AM: -

[jira] [Commented] (SPARK-19164) Review of UserDefinedFunction._broadcast

[ https://issues.apache.org/jira/browse/SPARK-19164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15820529#comment-15820529 ] Maciej Szymkiewicz commented on SPARK-19164: [~rxin] I am particularly intere

[jira] [Updated] (SPARK-19224) [PYSPARK] Python tests organization

[ https://issues.apache.org/jira/browse/SPARK-19224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-19224: --- Target Version/s: (was: 2.2.0) Fix Version/s: (was: 2.2.0) > [PYSPARK] P

[jira] [Commented] (SPARK-12157) Support numpy types as return values of Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832907#comment-15832907 ] Maciej Szymkiewicz commented on SPARK-12157: I've been looking at this in con

[jira] (SPARK-15559) TopicAndPartition should provide __hash__ method

Title: Message Title Maciej Szymkiewicz closed an issue as Duplicate

[jira] (SPARK-15559) TopicAndPartition should provide __hash__ method

Title: Message Title Maciej Szymkiewicz commented on SPARK-15559

[jira] (SPARK-19403) pyspark.sql.column exports non-existent names

Title: Message Title Maciej Szymkiewicz created an issue

[jira] (SPARK-13802) Fields order in Row(**kwargs) is not consistent with Schema.toInternal method

Title: Message Title Maciej Szymkiewicz commented on SPARK-13802

[jira] [Created] (SPARK-19427) UserDefinedFunction should support data types strings

Maciej Szymkiewicz created SPARK-19427: -- Summary: UserDefinedFunction should support data types strings Key: SPARK-19427 URL: https://issues.apache.org/jira/browse/SPARK-19427 Project: Spark

[jira] [Created] (SPARK-19429) Column.__getitem__ should support slice arguments

Maciej Szymkiewicz created SPARK-19429: -- Summary: Column.__getitem__ should support slice arguments Key: SPARK-19429 URL: https://issues.apache.org/jira/browse/SPARK-19429 Project: Spark

[jira] [Created] (SPARK-19453) Correct

Maciej Szymkiewicz created SPARK-19453: -- Summary: Correct Key: SPARK-19453 URL: https://issues.apache.org/jira/browse/SPARK-19453 Project: Spark Issue Type: Improvement Compon

[jira] [Updated] (SPARK-19453) Correct Column.replace docs

[ https://issues.apache.org/jira/browse/SPARK-19453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-19453: --- Summary: Correct Column.replace docs (was: Correct ) > Correct Column.replace docs >

[jira] [Updated] (SPARK-19453) Correct DataFrame.replace docs

[ https://issues.apache.org/jira/browse/SPARK-19453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-19453: --- Summary: Correct DataFrame.replace docs (was: Correct Column.replace docs) > Correct

[jira] [Created] (SPARK-19454) Improve DataFrame.replace API

Maciej Szymkiewicz created SPARK-19454: -- Summary: Improve DataFrame.replace API Key: SPARK-19454 URL: https://issues.apache.org/jira/browse/SPARK-19454 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-13802) Fields order in Row(**kwargs) is not consistent with Schema.toInternal method

[ https://issues.apache.org/jira/browse/SPARK-13802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853008#comment-15853008 ] Maciej Szymkiewicz commented on SPARK-13802: [~szymonm] Realistically it is r

[jira] [Comment Edited] (SPARK-13802) Fields order in Row(**kwargs) is not consistent with Schema.toInternal method

[ https://issues.apache.org/jira/browse/SPARK-13802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853008#comment-15853008 ] Maciej Szymkiewicz edited comment on SPARK-13802 at 2/5/17 12:45 AM: --

[jira] [Created] (SPARK-19467) PySpark ML shouldn't use circular imports

Maciej Szymkiewicz created SPARK-19467: -- Summary: PySpark ML shouldn't use circular imports Key: SPARK-19467 URL: https://issues.apache.org/jira/browse/SPARK-19467 Project: Spark Issue T

[jira] [Created] (SPARK-19475) (ML|MLlib).linalg.DenseVector method delegation fails for __neg__

Maciej Szymkiewicz created SPARK-19475: -- Summary: (ML|MLlib).linalg.DenseVector method delegation fails for __neg__ Key: SPARK-19475 URL: https://issues.apache.org/jira/browse/SPARK-19475 Project

[jira] [Created] (SPARK-19506) Missing warnings import in pyspark.ml.util

Maciej Szymkiewicz created SPARK-19506: -- Summary: Missing warnings import in pyspark.ml.util Key: SPARK-19506 URL: https://issues.apache.org/jira/browse/SPARK-19506 Project: Spark Issue

[jira] [Updated] (SPARK-19161) Improving UDF Docstrings

[ https://issues.apache.org/jira/browse/SPARK-19161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-19161: --- Priority: Major (was: Minor) > Improving UDF Docstrings > >

[jira] [Updated] (SPARK-19165) UserDefinedFunction should verify call arguments and provide readable exception in case of mismatch

[ https://issues.apache.org/jira/browse/SPARK-19165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-19165: --- Priority: Minor (was: Major) > UserDefinedFunction should verify call arguments and

[jira] [Updated] (SPARK-19162) UserDefinedFunction constructor should verify that func is callable

[ https://issues.apache.org/jira/browse/SPARK-19162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-19162: --- Priority: Minor (was: Major) > UserDefinedFunction constructor should verify that fu

[jira] [Updated] (SPARK-19161) Improving UDF Docstrings

[ https://issues.apache.org/jira/browse/SPARK-19161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-19161: --- Priority: Minor (was: Major) > Improving UDF Docstrings > >

[jira] [Commented] (SPARK-19163) Lazy creation of the _judf

[ https://issues.apache.org/jira/browse/SPARK-19163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15864110#comment-15864110 ] Maciej Szymkiewicz commented on SPARK-19163: [~holdenk] I see you've sorted o

[jira] [Resolved] (SPARK-19163) Lazy creation of the _judf

[ https://issues.apache.org/jira/browse/SPARK-19163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-19163. Resolution: Fixed Fix Version/s: 2.2.0 > Lazy creation of the _judf > --

[jira] [Commented] (SPARK-16931) PySpark access to data-frame bucketing api

[ https://issues.apache.org/jira/browse/SPARK-16931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15873329#comment-15873329 ] Maciej Szymkiewicz commented on SPARK-16931: [~sowen] Is there any particular

[jira] [Commented] (SPARK-16931) PySpark access to data-frame bucketing api

[ https://issues.apache.org/jira/browse/SPARK-16931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15873709#comment-15873709 ] Maciej Szymkiewicz commented on SPARK-16931: Thanks [~sowen]. I'll reopen thi

[jira] [Reopened] (SPARK-16931) PySpark access to data-frame bucketing api

[ https://issues.apache.org/jira/browse/SPARK-16931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reopened SPARK-16931: Should be implemented to achieve feature parity. > PySpark access to data-frame bucket

[jira] [Comment Edited] (SPARK-16931) PySpark access to data-frame bucketing api

[ https://issues.apache.org/jira/browse/SPARK-16931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15873710#comment-15873710 ] Maciej Szymkiewicz edited comment on SPARK-16931 at 2/19/17 2:09 PM: --

[jira] [Created] (SPARK-19728) PythonUDF with multiple parents shouldn't be pushed down when used as a predicat

Maciej Szymkiewicz created SPARK-19728: -- Summary: PythonUDF with multiple parents shouldn't be pushed down when used as a predicat Key: SPARK-19728 URL: https://issues.apache.org/jira/browse/SPARK-19728

[jira] [Updated] (SPARK-19728) PythonUDF with multiple parents shouldn't be pushed down when used as a predicate

[ https://issues.apache.org/jira/browse/SPARK-19728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-19728: --- Summary: PythonUDF with multiple parents shouldn't be pushed down when used as a pre

[jira] [Commented] (SPARK-13802) Fields order in Row(**kwargs) is not consistent with Schema.toInternal method

[ https://issues.apache.org/jira/browse/SPARK-13802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884939#comment-15884939 ] Maciej Szymkiewicz commented on SPARK-13802: [~szymonm] Do you have anything

[jira] [Created] (SPARK-17587) SparseVector __getitem__ should follow __getitem__ contract

Maciej Szymkiewicz created SPARK-17587: -- Summary: SparseVector __getitem__ should follow __getitem__ contract Key: SPARK-17587 URL: https://issues.apache.org/jira/browse/SPARK-17587 Project: Spar

[jira] [Updated] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-2620: -- Affects Version/s: 1.6.0 2.0.0 > case class cannot be used as key

[jira] [Updated] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-2620: -- Affects Version/s: 2.1.0 > case class cannot be used as key for reduce > ---

[jira] [Updated] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-2620: -- Affects Version/s: 1.3.0 1.4.0 1.5.0 > cas

[jira] [Commented] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15538581#comment-15538581 ] Maciej Szymkiewicz commented on SPARK-2620: --- With Scala 2.11 we get around by cr

[jira] [Issue Comment Deleted] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-2620: -- Comment: was deleted (was: With Scala 2.11 we get around by creating a package: {code}

[jira] [Created] (SPARK-17756) java.lang.ClassCastException when using cartesian with DStream.transform

Maciej Szymkiewicz created SPARK-17756: -- Summary: java.lang.ClassCastException when using cartesian with DStream.transform Key: SPARK-17756 URL: https://issues.apache.org/jira/browse/SPARK-17756

[jira] [Updated] (SPARK-17756) java.lang.ClassCastException when using cartesian with DStream.transform

[ https://issues.apache.org/jira/browse/SPARK-17756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-17756: --- External issue URL: http://stackoverflow.com/q/39804337/1560062 > java.lang.ClassCast

[jira] [Commented] (SPARK-16589) Chained cartesian produces incorrect number of records

[ https://issues.apache.org/jira/browse/SPARK-16589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15545239#comment-15545239 ] Maciej Szymkiewicz commented on SPARK-16589: Not actively so if you want to g

[jira] [Commented] (SPARK-17587) SparseVector __getitem__ should follow __getitem__ contract

[ https://issues.apache.org/jira/browse/SPARK-17587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15545262#comment-15545262 ] Maciej Szymkiewicz commented on SPARK-17587: I would probably go with 2.1.0 a

[jira] [Commented] (SPARK-16626) Code duplication after SPARK-14906

[ https://issues.apache.org/jira/browse/SPARK-16626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15554978#comment-15554978 ] Maciej Szymkiewicz commented on SPARK-16626: Oh well. Let's mark it a won't f

[jira] [Created] (SPARK-14058) Incorrect docstring in Window.orderBy

Maciej Szymkiewicz created SPARK-14058: -- Summary: Incorrect docstring in Window.orderBy Key: SPARK-14058 URL: https://issues.apache.org/jira/browse/SPARK-14058 Project: Spark Issue Type

[jira] [Commented] (SPARK-12916) Support Row.fromSeq and Row.toSeq methods in pyspark

[ https://issues.apache.org/jira/browse/SPARK-12916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15206030#comment-15206030 ] Maciej Szymkiewicz commented on SPARK-12916: Since PySpark `Row` is just a su

[jira] [Created] (SPARK-11569) StringIndexer transform fails when column contains nulls

Maciej Szymkiewicz created SPARK-11569: -- Summary: StringIndexer transform fails when column contains nulls Key: SPARK-11569 URL: https://issues.apache.org/jira/browse/SPARK-11569 Project: Spark

[jira] [Commented] (SPARK-11569) StringIndexer transform fails when column contains nulls

[ https://issues.apache.org/jira/browse/SPARK-11569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995580#comment-14995580 ] Maciej Szymkiewicz commented on SPARK-11569: It looks this problem affects Sc

[jira] [Commented] (SPARK-11530) Return eigenvalues with PCA model

[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995874#comment-14995874 ] Maciej Szymkiewicz commented on SPARK-11530: It should actually target MLlib,

[jira] [Commented] (SPARK-11086) createDataFrame should dropFactor column-wise not cell-wise

[ https://issues.apache.org/jira/browse/SPARK-11086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15006292#comment-15006292 ] Maciej Szymkiewicz commented on SPARK-11086: [~shivaram] Does it resolve [SPA

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15006960#comment-15006960 ] Maciej Szymkiewicz commented on SPARK-11281: [~shivaram] No, there isn't. I r

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15006970#comment-15006970 ] Maciej Szymkiewicz commented on SPARK-11281: [~sunrui], [~shivaram] I don't t

[jira] [Issue Comment Deleted] (SPARK-11281) Issue with creating and collecting DataFrame using environments

[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz updated SPARK-11281: --- Comment: was deleted (was: [~sunrui], [~shivaram] I don't think it is resolved by [SP

[jira] [Commented] (SPARK-11281) Issue with creating and collecting DataFrame using environments

[ https://issues.apache.org/jira/browse/SPARK-11281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007038#comment-15007038 ] Maciej Szymkiewicz commented on SPARK-11281: [~shivaram] I've tested both cur

[jira] [Created] (SPARK-12006) GaussianMixture.train crashes if an itnital model is not None

Maciej Szymkiewicz created SPARK-12006: -- Summary: GaussianMixture.train crashes if an itnital model is not None Key: SPARK-12006 URL: https://issues.apache.org/jira/browse/SPARK-12006 Project: Sp

<    1   2   3   4   5   6   7   >