[jira] [Assigned] (SPARK-38257) Upgrade rocksdbjni to 6.29.3
[ https://issues.apache.org/jira/browse/SPARK-38257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38257: Assignee: (was: Apache Spark) > Upgrade rocksdbjni to 6.29.3 > > > Key: SPARK-38257 > URL: https://issues.apache.org/jira/browse/SPARK-38257 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 3.3.0 >Reporter: Yang Jie >Priority: Major > > This is the first version that supports Apple silicon -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-38257) Upgrade rocksdbjni to 6.29.3
[ https://issues.apache.org/jira/browse/SPARK-38257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495081#comment-17495081 ] Apache Spark commented on SPARK-38257: -- User 'LuciferYang' has created a pull request for this issue: https://github.com/apache/spark/pull/35580 > Upgrade rocksdbjni to 6.29.3 > > > Key: SPARK-38257 > URL: https://issues.apache.org/jira/browse/SPARK-38257 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 3.3.0 >Reporter: Yang Jie >Priority: Major > > This is the first version that supports Apple silicon -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-38257) Upgrade rocksdbjni to 6.29.3
[ https://issues.apache.org/jira/browse/SPARK-38257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38257: Assignee: Apache Spark > Upgrade rocksdbjni to 6.29.3 > > > Key: SPARK-38257 > URL: https://issues.apache.org/jira/browse/SPARK-38257 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 3.3.0 >Reporter: Yang Jie >Assignee: Apache Spark >Priority: Major > > This is the first version that supports Apple silicon -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Comment Edited] (SPARK-38257) Upgrade rocksdbjni to 6.29.3
[ https://issues.apache.org/jira/browse/SPARK-38257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495079#comment-17495079 ] Yang Jie edited comment on SPARK-38257 at 2/20/22, 3:38 AM: Already release wait maven can download it [https://github.com/facebook/rocksdb/releases/tag/v6.29.3] cc [~dongjoon] was (Author: luciferyang): Already release wait maven can download it https://github.com/facebook/rocksdb/releases/tag/v6.29.3 > Upgrade rocksdbjni to 6.29.3 > > > Key: SPARK-38257 > URL: https://issues.apache.org/jira/browse/SPARK-38257 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 3.3.0 >Reporter: Yang Jie >Priority: Major > > This is the first version that supports Apple silicon -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-38257) Upgrade rocksdbjni to 6.29.3
[ https://issues.apache.org/jira/browse/SPARK-38257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495079#comment-17495079 ] Yang Jie commented on SPARK-38257: -- Already release wait maven can download it https://github.com/facebook/rocksdb/releases/tag/v6.29.3 > Upgrade rocksdbjni to 6.29.3 > > > Key: SPARK-38257 > URL: https://issues.apache.org/jira/browse/SPARK-38257 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 3.3.0 >Reporter: Yang Jie >Priority: Major > > This is the first version that supports Apple silicon -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-38257) Upgrade rocksdbjni to 6.29.3
Yang Jie created SPARK-38257: Summary: Upgrade rocksdbjni to 6.29.3 Key: SPARK-38257 URL: https://issues.apache.org/jira/browse/SPARK-38257 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 3.3.0 Reporter: Yang Jie This is the first version that supports Apple silicon -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-38256) Upgarde `org.scalatestplus:mockito` to 3.2.11.0
[ https://issues.apache.org/jira/browse/SPARK-38256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495078#comment-17495078 ] Apache Spark commented on SPARK-38256: -- User 'LuciferYang' has created a pull request for this issue: https://github.com/apache/spark/pull/35579 > Upgarde `org.scalatestplus:mockito` to 3.2.11.0 > --- > > Key: SPARK-38256 > URL: https://issues.apache.org/jira/browse/SPARK-38256 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 3.3.0 >Reporter: Yang Jie >Priority: Minor > > Upgarde `org.scalatestplus:mockito` from 3.2.110.0 to 3.2.11.0 and the actual > mockito is upgraded from 3.12 to 4.2.0 -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-38256) Upgarde `org.scalatestplus:mockito` to 3.2.11.0
[ https://issues.apache.org/jira/browse/SPARK-38256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38256: Assignee: Apache Spark > Upgarde `org.scalatestplus:mockito` to 3.2.11.0 > --- > > Key: SPARK-38256 > URL: https://issues.apache.org/jira/browse/SPARK-38256 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 3.3.0 >Reporter: Yang Jie >Assignee: Apache Spark >Priority: Minor > > Upgarde `org.scalatestplus:mockito` from 3.2.110.0 to 3.2.11.0 and the actual > mockito is upgraded from 3.12 to 4.2.0 -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-38256) Upgarde `org.scalatestplus:mockito` to 3.2.11.0
[ https://issues.apache.org/jira/browse/SPARK-38256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38256: Assignee: (was: Apache Spark) > Upgarde `org.scalatestplus:mockito` to 3.2.11.0 > --- > > Key: SPARK-38256 > URL: https://issues.apache.org/jira/browse/SPARK-38256 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 3.3.0 >Reporter: Yang Jie >Priority: Minor > > Upgarde `org.scalatestplus:mockito` from 3.2.110.0 to 3.2.11.0 and the actual > mockito is upgraded from 3.12 to 4.2.0 -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-38256) Upgarde `org.scalatestplus:mockito` to 3.2.11.0
Yang Jie created SPARK-38256: Summary: Upgarde `org.scalatestplus:mockito` to 3.2.11.0 Key: SPARK-38256 URL: https://issues.apache.org/jira/browse/SPARK-38256 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 3.3.0 Reporter: Yang Jie Upgarde `org.scalatestplus:mockito` from 3.2.110.0 to 3.2.11.0 and the actual mockito is upgraded from 3.12 to 4.2.0 -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-38245) Avro Complex Union Type return `member$I`
[
https://issues.apache.org/jira/browse/SPARK-38245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495031#comment-17495031
]
Teddy Crepineau commented on SPARK-38245:
-
Sounds good. Right now the workaround I have found is to read the schema from
the avro file and do some logic to replace the column names ({{member$i}}) of
the Spark df with the info from the schema.
I really appreciate your help with this [~xkrogen] and thanks again for taking
the time to comment on this issue.
{code:python}
import fastavro
with open("my_file.avro", "rb") as af:
reader = fastavro.reader(af)
schema = reader.writer_schema
{code}
> Avro Complex Union Type return `member$I`
> -
>
> Key: SPARK-38245
> URL: https://issues.apache.org/jira/browse/SPARK-38245
> Project: Spark
> Issue Type: Bug
> Components: SQL
>Affects Versions: 3.2.1
> Environment: +OS+
> * Debian GNU/Linux 10 (Docker Container)
> +packages & others+
> * spark-avro_2.12-3.2.1
> * python 3.7.3
> * pyspark 3.2.1
> * spark-3.2.1-bin-hadoop3.2
> * Docker version 20.10.12
>Reporter: Teddy Crepineau
>Priority: Major
> Labels: avro, newbie
>
> *Short Description*
> When reading complex union types from Avro files, there seems to be some
> information lost as the name of the record is omitted and {{member$i}} is
> instead returned.
> *Long Description*
> +Error+
> Given the Avro schema {{{}schema.avsc{}}}, I would expected the schema when
> reading the avro file using {{read_avro.py}} to be as {{{}expected.txt{}}}.
> Instead, I get the schema output in {{reality.txt}} where {{RecordOne}}
> became {{{}member0{}}}, etc.
> This causes information lost and makes the DataFrame unusable.
> From my understanding this behavior was implemented
> [here.|https://github.com/databricks/spark-avro/pull/117]
>
> {code:java|title=read_avro.py}
> df = spark.read.format("avro").load("path/to/my/file.avro")
> df.printSchema()
> {code}
> {code:java|title=schema.avsc}
> {
> "type": "record",
> "name": "SomeData",
> "namespace": "my.name.space",
> "fields": [
> {
> "name": "ts",
> "type": {
> "type": "long",
> "logicalType": "timestamp-millis"
> }
> },
> {
> "name": "field_id",
> "type": [
> "null",
> "string"
> ],
> "default": null
> },
> {
> "name": "values",
> "type": [
> {
> "type": "record",
> "name": "RecordOne",
> "fields": [
> {
> "name": "field_a",
> "type": "long"
> },
> {
> "name": "field_b",
> "type": {
> "type": "enum",
> "name": "FieldB",
> "symbols": [
> "..."
> ],
> }
> },
> {
> "name": "field_C",
> "type": {
> "type": "array",
> "items": "long"
> }
> }
> ]
> },
> {
> "type": "record",
> "name": "RecordTwo",
> "fields": [
> {
> "name": "field_a",
> "type": "long"
> }
> ]
> }
> ]
> }
> ]
> }{code}
> {code:java|title=expected.txt}
> root
> |-- ts: timestamp (nullable = true)
> |-- field_id: string (nullable = true)
> |-- values: struct (nullable = true)
> ||-- RecordOne: struct (nullable = true)
> |||-- field_a: long (nullable = true)
> |||-- field_b: string (nullable = true)
> |||-- field_c: array (nullable = true)
> ||||-- element: long (containsNull = true)
> ||-- RecordTwo: struct (nullable = true)
> |||-- field_a: long (nullable = true)
> {code}
> {code:java|title=reality.txt}
> root
> |-- ts: timestamp (nullable = true)
> |-- field_id: string (nullable = true)
> |-- values: struct (nullable = true)
> ||-- member0: struct (nullable = true)
> |||-- field_a: long (nullable = true)
> |||-- field_b: string (nullable = true)
> |||-- field_c: array (nullable = true)
> ||||-- element: long (containsNull = true)
> ||-- member1: struct (nullable = true)
> |||-- field_a: long (nullable = true)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-37402) Inline type hints for python/pyspark/mllib/clustering.py
[ https://issues.apache.org/jira/browse/SPARK-37402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37402: Assignee: Apache Spark > Inline type hints for python/pyspark/mllib/clustering.py > > > Key: SPARK-37402 > URL: https://issues.apache.org/jira/browse/SPARK-37402 > Project: Spark > Issue Type: Sub-task > Components: MLlib, PySpark >Affects Versions: 3.3.0 >Reporter: Maciej Szymkiewicz >Assignee: Apache Spark >Priority: Major > > Inline type hints from python/pyspark/mlib/clustering.pyi to > python/pyspark/mllib/clustering.py. -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-37402) Inline type hints for python/pyspark/mllib/clustering.py
[ https://issues.apache.org/jira/browse/SPARK-37402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37402: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/mllib/clustering.py > > > Key: SPARK-37402 > URL: https://issues.apache.org/jira/browse/SPARK-37402 > Project: Spark > Issue Type: Sub-task > Components: MLlib, PySpark >Affects Versions: 3.3.0 >Reporter: Maciej Szymkiewicz >Priority: Major > > Inline type hints from python/pyspark/mlib/clustering.pyi to > python/pyspark/mllib/clustering.py. -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-37402) Inline type hints for python/pyspark/mllib/clustering.py
[ https://issues.apache.org/jira/browse/SPARK-37402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17495027#comment-17495027 ] Apache Spark commented on SPARK-37402: -- User 'zero323' has created a pull request for this issue: https://github.com/apache/spark/pull/35578 > Inline type hints for python/pyspark/mllib/clustering.py > > > Key: SPARK-37402 > URL: https://issues.apache.org/jira/browse/SPARK-37402 > Project: Spark > Issue Type: Sub-task > Components: MLlib, PySpark >Affects Versions: 3.3.0 >Reporter: Maciej Szymkiewicz >Priority: Major > > Inline type hints from python/pyspark/mlib/clustering.pyi to > python/pyspark/mllib/clustering.py. -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-37424) Inline type hints for python/pyspark/mllib/random.py
[ https://issues.apache.org/jira/browse/SPARK-37424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37424: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/mllib/random.py > > > Key: SPARK-37424 > URL: https://issues.apache.org/jira/browse/SPARK-37424 > Project: Spark > Issue Type: Sub-task > Components: MLlib, PySpark >Affects Versions: 3.3.0 >Reporter: Maciej Szymkiewicz >Priority: Major > > Inline type hints from python/pyspark/mlib/random.pyi to > python/pyspark/mllib/random.py -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-37424) Inline type hints for python/pyspark/mllib/random.py
[ https://issues.apache.org/jira/browse/SPARK-37424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494992#comment-17494992 ] Apache Spark commented on SPARK-37424: -- User 'zero323' has created a pull request for this issue: https://github.com/apache/spark/pull/35576 > Inline type hints for python/pyspark/mllib/random.py > > > Key: SPARK-37424 > URL: https://issues.apache.org/jira/browse/SPARK-37424 > Project: Spark > Issue Type: Sub-task > Components: MLlib, PySpark >Affects Versions: 3.3.0 >Reporter: Maciej Szymkiewicz >Priority: Major > > Inline type hints from python/pyspark/mlib/random.pyi to > python/pyspark/mllib/random.py -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-37424) Inline type hints for python/pyspark/mllib/random.py
[ https://issues.apache.org/jira/browse/SPARK-37424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37424: Assignee: Apache Spark > Inline type hints for python/pyspark/mllib/random.py > > > Key: SPARK-37424 > URL: https://issues.apache.org/jira/browse/SPARK-37424 > Project: Spark > Issue Type: Sub-task > Components: MLlib, PySpark >Affects Versions: 3.3.0 >Reporter: Maciej Szymkiewicz >Assignee: Apache Spark >Priority: Major > > Inline type hints from python/pyspark/mlib/random.pyi to > python/pyspark/mllib/random.py -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-38249) Cleanup unused private methods and fields
[ https://issues.apache.org/jira/browse/SPARK-38249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38249: Assignee: Yang Jie > Cleanup unused private methods and fields > - > > Key: SPARK-38249 > URL: https://issues.apache.org/jira/browse/SPARK-38249 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.3.0 >Reporter: Yang Jie >Assignee: Yang Jie >Priority: Minor > -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-38249) Cleanup unused private methods and fields
[ https://issues.apache.org/jira/browse/SPARK-38249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38249. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35566 [https://github.com/apache/spark/pull/35566] > Cleanup unused private methods and fields > - > > Key: SPARK-38249 > URL: https://issues.apache.org/jira/browse/SPARK-38249 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.3.0 >Reporter: Yang Jie >Assignee: Yang Jie >Priority: Minor > Fix For: 3.3.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-38249) Cleanup unused private methods and fields
[ https://issues.apache.org/jira/browse/SPARK-38249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-38249: - Priority: Trivial (was: Minor) > Cleanup unused private methods and fields > - > > Key: SPARK-38249 > URL: https://issues.apache.org/jira/browse/SPARK-38249 > Project: Spark > Issue Type: Improvement > Components: Spark Core >Affects Versions: 3.3.0 >Reporter: Yang Jie >Assignee: Yang Jie >Priority: Trivial > Fix For: 3.3.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-37428) Inline type hints for python/pyspark/mllib/util.py
[ https://issues.apache.org/jira/browse/SPARK-37428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37428. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35532 [https://github.com/apache/spark/pull/35532] > Inline type hints for python/pyspark/mllib/util.py > -- > > Key: SPARK-37428 > URL: https://issues.apache.org/jira/browse/SPARK-37428 > Project: Spark > Issue Type: Sub-task > Components: PySpark >Affects Versions: 3.3.0 >Reporter: Maciej Szymkiewicz >Assignee: Maciej Szymkiewicz >Priority: Major > Fix For: 3.3.0 > > > Inline type hints from python/pyspark/mlib/util.pyi to > python/pyspark/mllib/util.py -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-37428) Inline type hints for python/pyspark/mllib/util.py
[ https://issues.apache.org/jira/browse/SPARK-37428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37428: -- Assignee: Maciej Szymkiewicz > Inline type hints for python/pyspark/mllib/util.py > -- > > Key: SPARK-37428 > URL: https://issues.apache.org/jira/browse/SPARK-37428 > Project: Spark > Issue Type: Sub-task > Components: PySpark >Affects Versions: 3.3.0 >Reporter: Maciej Szymkiewicz >Assignee: Maciej Szymkiewicz >Priority: Major > > Inline type hints from python/pyspark/mlib/util.pyi to > python/pyspark/mllib/util.py -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-37430) Inline type hints for python/pyspark/mllib/linalg/distributed.py
[ https://issues.apache.org/jira/browse/SPARK-37430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17494939#comment-17494939 ] Maciej Szymkiewicz commented on SPARK-37430: [~jyoti_08] Hard prerequisites so if you still want to work on that, go ahead. If not, please drop a line, so someone else can resolve this. TIA :) > Inline type hints for python/pyspark/mllib/linalg/distributed.py > > > Key: SPARK-37430 > URL: https://issues.apache.org/jira/browse/SPARK-37430 > Project: Spark > Issue Type: Sub-task > Components: MLlib, PySpark >Affects Versions: 3.3.0 >Reporter: Maciej Szymkiewicz >Priority: Major > > Inline type hints from python/pyspark/mlib/linalg/distributed.pyi to > python/pyspark/mllib/linalg/distributed.py -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-37094) Inline type hints for files in python/pyspark
[ https://issues.apache.org/jira/browse/SPARK-37094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37094. Fix Version/s: 3.3.0 Resolution: Fixed > Inline type hints for files in python/pyspark > - > > Key: SPARK-37094 > URL: https://issues.apache.org/jira/browse/SPARK-37094 > Project: Spark > Issue Type: Umbrella > Components: PySpark >Affects Versions: 3.3.0 >Reporter: dch nguyen >Assignee: dch nguyen >Priority: Major > Fix For: 3.3.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-37154) Inline type hints for python/pyspark/rdd.py
[ https://issues.apache.org/jira/browse/SPARK-37154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37154. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35252 [https://github.com/apache/spark/pull/35252] > Inline type hints for python/pyspark/rdd.py > --- > > Key: SPARK-37154 > URL: https://issues.apache.org/jira/browse/SPARK-37154 > Project: Spark > Issue Type: Sub-task > Components: PySpark >Affects Versions: 3.2.0 >Reporter: Byron Hsu >Assignee: Maciej Szymkiewicz >Priority: Major > Fix For: 3.3.0 > > -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-37154) Inline type hints for python/pyspark/rdd.py
[ https://issues.apache.org/jira/browse/SPARK-37154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37154: -- Assignee: Maciej Szymkiewicz > Inline type hints for python/pyspark/rdd.py > --- > > Key: SPARK-37154 > URL: https://issues.apache.org/jira/browse/SPARK-37154 > Project: Spark > Issue Type: Sub-task > Components: PySpark >Affects Versions: 3.2.0 >Reporter: Byron Hsu >Assignee: Maciej Szymkiewicz >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-38244) Upgrade kubernetes-client to 5.12.1
[ https://issues.apache.org/jira/browse/SPARK-38244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38244: Assignee: (was: Apache Spark) > Upgrade kubernetes-client to 5.12.1 > --- > > Key: SPARK-38244 > URL: https://issues.apache.org/jira/browse/SPARK-38244 > Project: Spark > Issue Type: Bug > Components: Kubernetes >Affects Versions: 3.3.0 >Reporter: Yikun Jiang >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-38244) Upgrade kubernetes-client to 5.12.1
[ https://issues.apache.org/jira/browse/SPARK-38244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38244: Assignee: Apache Spark > Upgrade kubernetes-client to 5.12.1 > --- > > Key: SPARK-38244 > URL: https://issues.apache.org/jira/browse/SPARK-38244 > Project: Spark > Issue Type: Bug > Components: Kubernetes >Affects Versions: 3.3.0 >Reporter: Yikun Jiang >Assignee: Apache Spark >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
