Messages by Thread
-
(spark) branch master updated: [SPARK-47982][BUILD] Update some code style's plugins to latest version
yao
-
(spark) branch master updated: [SPARK-47984][ML][SQL] Change `MetricsAggregate/V2Aggregator#serialize/deserialize` to call `SparkSerDeUtils#serialize/deserialize`
yao
-
(spark) branch master updated: [SPARK-47981][BUILD] Upgrade `Arrow` to 16.0.0
yao
-
(spark) branch master updated: [SPARK-47983][SQL] Demote spark.sql.pyspark.legacy.inferArrayTypeFromFirstElement.enabled to internal
yao
-
(spark) branch master updated (08caa567fb29 -> 775bc54fcd0d)
gengliang
-
(spark) branch master updated: [SPARK-47980][SQL][TESTS] Reactivate test 'Empty float/double array columns raise EOFException'
yao
-
(spark) branch master updated (b4624bf4be28 -> dab4a044b647)
gurwls223
-
(spark) branch master updated (c6aaa18e6cfd -> b4624bf4be28)
wenchen
-
(spark) branch master updated: Revert "[SPARK-45302][PYTHON] Remove PID communication between Pythonworkers when no demon is used"
gurwls223
-
(spark) branch master updated (d23389252a7d -> ea37c860a1a8)
gurwls223
-
(spark) branch master updated (0fcced63be99 -> d23389252a7d)
yao
-
(spark) branch master updated: [SPARK-47979][SQL][TESTS] Use Hive tables explicitly for Hive table capability tests
dongjoon
-
(spark) branch branch-3.5 updated: [SPARK-47921][CONNECT] Fix ExecuteJobTag creation in ExecuteHolder
ueshin
-
(spark) branch master updated (62dd64a5d13d -> 5a1559a7ef03)
ueshin
-
(spark) branch master updated: [SPARK-47583][CORE] SQL core: Migrate logError with variables to structured logging framework
gengliang
-
(spark) branch branch-3.5 updated: [SPARK-47633][SQL][3.5] Include right-side plan output in `LateralJoin#allAttributes` for more consistent canonicalization
dongjoon
-
(spark) branch master updated (09ed09cb18e7 -> 03d4ea6a707c)
dongjoon
-
(spark) branch branch-3.5 updated: [SPARK-47819][CONNECT][3.5] Use asynchronous callback for execution cleanup
hvanhovell
-
(spark) branch master updated: [SPARK-47958][TESTS] Change LocalSchedulerBackend to notify scheduler of executor on start
wenchen
-
(spark) branch master updated: [SPARK-47965][CORE] Avoid orNull in TypedConfigBuilder and OptionalConfigEntry
gurwls223
-
(spark) branch master updated: [SPARK-47971][PYTHON][CONNECT][TESTS] Reenable `PandasUDFGroupedAggParityTests.test_grouped_with_empty_partition`
ruifengz
-
(spark) branch master updated: [SPARK-47764][CORE][SQL] Cleanup shuffle dependencies based on ShuffleCleanupMode
wenchen
-
(spark) branch master updated: [SPARK-47692][SQL] Fix default StringType meaning in implicit casting
wenchen
-
(spark) branch master updated: [SPARK-47418][SQL] Add hand-crafted implementations for lowercase unicode-aware contains, startsWith and endsWith and optimize UTF8_BINARY_LCASE
wenchen
-
(spark) branch master updated (fd695be19d3f -> 6f01982094f6)
gurwls223
-
(spark) branch master updated: [SPARK-47903][PYTHON][FOLLOW-UP] Removed changes relating to try_parse_json
gurwls223
-
(spark) branch master updated: [SPARK-47969][PYTHON][TESTS] Make `test_creation_index` deterministic
dongjoon
-
(spark) branch master updated: [SPARK-47771][PYTHON][DOCS][TESTS][FOLLOWUP] Make `max_by, min_by` doctests deterministic
ruifengz
-
(spark) branch master updated: [SPARK-47933][PYTHON][CONNECT][FOLLOW-UP] Add a check of `__name__` at `_with_origin`
gurwls223
-
(spark) branch master updated: Revert "Revert "[SPARK-45302][PYTHON] Remove PID communication between Python workers when no demon is used""
gurwls223
-
(spark) branch master updated (390fb7429029 -> e8f529bb89a6)
gurwls223
-
(spark) branch master updated (c88fabfee41d -> 390fb7429029)
gurwls223
-
(spark) branch master updated: [SPARK-47604][CORE] Resource managers: Migrate logInfo with variables to structured logging framework
gengliang
-
(spark) branch master updated: [SPARK-47864][FOLLOWUP][PYTHON][DOCS] Fix minor typo: "MLLib" -> "MLlib"
xinrong
-
(spark) branch master updated: [SPARK-47956][SQL] Sanity check for unresolved LCA reference
dongjoon
-
(spark) branch master updated: [SPARK-47948][PYTHON] Upgrade the minimum `Pandas` version to 2.0.0
dongjoon
-
(spark) branch master updated (cf5fc0c720ee -> 9c4f12ca04ac)
dongjoon
-
(spark) branch master updated: [MINOR][DOCS] Fix type hint of 3 functions
dongjoon
-
(spark) branch master updated (ca916258b991 -> 33fa77cb4868)
dongjoon
-
(spark) branch master updated: [SPARK-47953][DOCS] MsSQLServer: Document Mapping Spark SQL Data Types to Microsoft SQL Server
dongjoon
-
(spark) branch master updated: [SPARK-47873][SQL] Write collated strings to Hive metastore using the regular string type
wenchen
-
(spark) branch master updated: [SPARK-47352][SQL] Fix Upper, Lower, InitCap collation awareness
wenchen
-
(spark) branch master updated: [SPARK-47805][SS] Implementing TTL for MapState
kabhwan
-
(spark) branch master updated (d1298e73a8d5 -> e74221e6525e)
yao
-
(spark) branch master updated (885e98ecbe64 -> d1298e73a8d5)
yao
-
(spark) branch master updated: [SPARK-47412][SQL] Add Collation Support for LPad/RPad
wenchen
-
(spark) branch master updated: [SPARK-47633][SQL] Include right-side plan output in `LateralJoin#allAttributes` for more consistent canonicalization
wenchen
-
(spark-kubernetes-operator) branch main updated: [SPARK-47943] Add `GitHub Action` CI for Java Build and Test
dongjoon
-
(spark-kubernetes-operator) branch main updated: [SPARK-47929] Setup Static Analysis for Operator
dongjoon
-
(spark) branch master updated (9d715ba49171 -> 876c2cf34a35)
dongjoon
-
(spark) branch master updated: [SPARK-47938][SQL] MsSQLServer: Cannot find data type BYTE error
dongjoon
-
(spark) branch master updated (e01ac581f46a -> 3c7905e00d2e)
gengliang
-
(spark) branch master updated (e4fb7dd98219 -> a97e72cfa7d4)
dongjoon
-
(spark) branch master updated (b335dd366fb1 -> e4fb7dd98219)
dongjoon
-
(spark) branch master updated (9e7ee7601d38 -> b335dd366fb1)
gurwls223
-
(spark) branch master updated: [SPARK-47903][PYTHON] Add support for remaining scalar types in the PySpark Variant library
gurwls223
-
(spark) branch branch-3.5 updated: [SPARK-47904][SQL][3.5] Preserve case in Avro schema when using enableStableIdentifiersForUnionType
dongjoon
-
(spark) branch master updated: [SPARK-47942][K8S][DOCS] Drop K8s v1.26 Support
dongjoon
-
(spark) branch master updated (f2d0cf23018f -> fc0c8553ea05)
dongjoon
-
(spark) branch master updated (86563169eef8 -> f2d0cf23018f)
gengliang
-
(spark) branch master updated: [SPARK-47940][BUILD][TESTS] Upgrade `guava` dependency to `33.1.0-jre` in Docker IT
dongjoon
-
(spark) branch master updated (256fc51508e4 -> 676d47ffe091)
dongjoon
-
(spark) branch master updated: [SPARK-47411][SQL] Support StringInstr & FindInSet functions to work with collated strings
wenchen
-
(spark) branch master updated: [SPARK-47928][SQL][TEST] Speed up test "Add jar support Ivy URI in SQL"
yangjie01
-
(spark) branch master updated (2fb31dea1c53 -> b20356ef55a2)
wenchen
-
(spark) branch master updated: [SPARK-47930][BUILD] Upgrade RoaringBitmap to 1.0.6
dongjoon
-
(spark) branch master updated (e1432ef6405a -> 79a1fa4b84dd)
gurwls223
-
(spark) branch master updated (2d0b56c3eac6 -> e1432ef6405a)
wenchen
-
(spark) branch master updated (458f70bd5213 -> 2d0b56c3eac6)
yangjie01
-
(spark) branch master updated (9f34b8eca2f3 -> 458f70bd5213)
wenchen
-
(spark) branch master updated (2d9d444b122d -> 9f34b8eca2f3)
ruifengz
-
(spark) branch master updated (393a84fb074a -> 2d9d444b122d)
gurwls223
-
(spark) branch master updated (adf02d38061b -> 393a84fb074a)
gurwls223
-
(spark) branch master updated: [SPARK-47925][SQL][TESTS] Mark `BloomFilterAggregateQuerySuite` as `ExtendedSQLTest`
dongjoon
-
(spark) branch master updated: [SPARK-47923][R] Upgrade the minimum version of `arrow` R package to 10.0.0
dongjoon
-
(spark) branch master updated (3fcc0f7ac142 -> 2613516110a4)
dongjoon
-
(spark) branch branch-3.5 updated (afd99d19a2b8 -> 6a358ff7d633)
dongjoon
-
(spark) branch branch-3.4 updated (bcaf61b975d6 -> e7a2e5a196a8)
dongjoon
-
(spark) branch master updated: [SPARK-47915][BUILD][K8S] Upgrade `kubernetes-client` to 6.12.1
dongjoon
-
(spark) branch master updated (2bf43460b923 -> 0d553d06fe2f)
ruifengz
-
(spark) branch master updated: [SPARK-47833][SQL][CORE] Supply caller stackstrace for checkAndGlobPathIfNecessary AnalysisException
yao
-
(spark) branch master updated: [SPARK-47901][BUILD] Upgrade common-text 1.12.0
yangjie01
-
(spark) branch master updated (fe47edece059 -> 8aa2dad46b79)
gengliang
-
(spark) branch master updated: [SPARK-47883][SQL] Make `CollectTailExec.doExecute` lazy with RowQueue
ruifengz
-
(spark) branch branch-3.4 updated: [SPARK-47897][SQL][3.5] Fix ExpressionSet performance regression in scala 2.12
yao
-
(spark) branch branch-3.5 updated: [SPARK-47897][SQL][3.5] Fix ExpressionSet performance regression in scala 2.12
yao
-
(spark) branch master updated (bb5ded8f1bb0 -> 76fb196a8ab7)
wenchen
-
(spark) branch master updated (e2e17fe6e038 -> bb5ded8f1bb0)
gurwls223
-
(spark) branch master updated: [SPARK-47816][CONNECT][DOCS][FOLLOWUP] refine the description
gurwls223
-
(spark) branch master updated: [SPARK-44461][FOLLOWUP][SS][CONNECT] Remove unneeded TODOs
gurwls223
-
(spark) branch master updated: [SPARK-47898][SQL] Port HIVE-12270: Add DBTokenStore support to HS2 delegation token
dongjoon
-
(spark) branch master updated: [MINOR][TESTS] Replace CONFIG_DIM1 with CONFIG_DIM2 in timestamp tests
dongjoon
-
(spark-kubernetes-operator) branch main updated: [SPARK-47889][FOLLOWUP] Add `gradlew` to `.licenserc.yaml`
dongjoon
-
(spark-kubernetes-operator) branch main updated: [SPARK-47889] Setup gradle as build tool for operator repository
dongjoon
-
[PR] Add Apache Spark 3.4.3 news [spark-website]
via GitHub
-
svn commit: r68631 - /release/spark/spark-3.4.2/
dongjoon
-
[PR] Add Apache Spark 3.4.3 docs [spark-website]
via GitHub
-
(spark) branch master updated: [SPARK-47887][CONNECT] Remove unused import `spark/connect/common.proto` from `spark/connect/relations.proto`
dongjoon
-
(spark) branch master updated: [SPARK-47893][BUILD] Upgrade ASM to 9.7
dongjoon
-
(spark) branch branch-3.5 updated: [SPARK-47463][SQL][3.5] Use V2Predicate to wrap expression with return type of boolean
wenchen
-
(spark) branch master updated: [SPARK-47858][SPARK-47852][PYTHON][SQL][FOLLOWUP] Fix Python Liner
ruifengz
-
(spark) branch branch-3.4 updated: [SPARK-47895][SQL] group by all should be idempotent
wenchen
-
(spark) branch branch-3.5 updated: [SPARK-47895][SQL] group by all should be idempotent
wenchen
-
(spark) branch master updated: [SPARK-47895][SQL] group by all should be idempotent
wenchen
-
(spark) tag v3.4.3 created (now 1eb558c3a6fb)
dongjoon
-
svn commit: r68618 - /dev/spark/v3.4.3-rc2-bin/ /release/spark/spark-3.4.3/
dongjoon
-
(spark) branch master updated: [SPARK-47850][SQL] Support `spark.sql.hive.convertInsertingUnpartitionedTable`
yangjie01
-
(spark) branch master updated (216379df3543 -> bcafb43825ac)
gurwls223
-
(spark) branch master updated: [SPARK-47858][SPARK-47852][PYTHON][SQL] Refactoring the structure for DataFrame error context
gurwls223
-
(spark) branch master updated (eb8688c2b6ce -> 564b2384c40d)
gurwls223
-
(spark) branch master updated: [SPARK-47896][BUILD] Upgrade netty to `4.1.109.Final`
dongjoon
-
(spark) branch master updated (47d783bc6489 -> 9718573ce748)
gengliang
-
(spark) branch master updated: [SPARK-47882][SQL] createTableColumnTypes need to be mapped to database types instead of using directly
dongjoon
-
(spark) branch master updated: [SPARK-47894][CORE][WEBUI] Add `Environment` page to Master UI
dongjoon
-
(spark) branch master updated (c4b0c260bb13 -> 60e75e6e0275)
wenchen
-
(spark) branch master updated: [SPARK-47839][SQL] Fix aggregate bug in RewriteWithExpression
wenchen
-
(spark) branch master updated (37afc3fff8c6 -> 61a7901a2c83)
wenchen
-
(spark) branch master updated: [SPARK-47803][FOLLOWUP] Fix cast binary/decimal to variant
wenchen
-
(spark) branch master updated: [SPARK-47867][FOLLOWUP] Fix variant parsing in JacksonParser
wenchen
-
(spark) branch master updated: [SPARK-46810][DOCS][FOLLOWUP] Make some reference file links clickable
gurwls223
-
(spark) branch master updated: [SPARK-47891][PYTHON][DOCS] Improve docstring of mapInPandas
gurwls223
-
(spark) branch master updated: [SPARK-47584][SQL] SQL core: Migrate logWarn with variables to structured logging framework
gengliang
-
(spark) branch master updated: [SPARK-47627][SQL] Add SQL MERGE syntax to enable schema evolution
gengliang
-
(spark) branch master updated: [SPARK-47360][SQL] Collation support: Overlay, FormatString, Length, BitLength, OctetLength, SoundEx, Luhncheck
wenchen
-
(spark) branch master updated: [SPARK-47726][DOC] Document push-based shuffle metrics
dongjoon
-
(spark) branch master updated: [SPARK-47416][SQL] Add new functions to CollationBenchmark
wenchen
-
(spark) branch master updated: [SPARK-47886][SQL][DOCS][TESTS] Postgres: Add tests and doc for Postgres special numeric values
dongjoon
-
(spark) branch master updated: [SPARK-47765][SQL][FOLLOWUP] Disable SET COLLATION when collations are disabled
wenchen
-
(spark) branch master updated (5da7b6878c20 -> 7dc88db0c8b6)
gurwls223
-
(spark) branch master updated: [SPARK-47763][CONNECT][TESTS] Enable local-cluster tests with pyspark-connect package
gurwls223
-
(spark) branch master updated (e327c1220abf -> 1b53f122d56c)
wenchen
-
(spark) branch master updated: [SPARK-47884][INFRA] Switch ANSI SQL CI job to NON-ANSI SQL CI job
gurwls223
-
(spark) branch master updated (4e754f778fdc -> 6fb2f7c3772a)
dongjoon
-
(spark) branch master updated: [SPARK-47822][SQL] Prohibit Hash Expressions from hashing the Variant Data Type
wenchen
-
(spark) branch master updated (4913c344756d -> 76882d0c13db)
wenchen
-
(spark) branch master updated: [SPARK-47867][SQL] Support variant in JSON scan
wenchen
-
(spark) branch master updated: [SPARK-46812][CONNECT][PYTHON][FOLLOW-UP] Add pyspark.pyspark.sql.connect.resource into PyPi packaging
gurwls223
-
(spark) branch master updated: [SPARK-47588][CORE] Hive module: Migrate logInfo with variables to structured logging framework
gengliang
-
(spark) branch master updated (268856da31c1 -> 2054ab0fb03f)
yao
-
(spark) branch master updated (ab6338e09aa0 -> 268856da31c1)
yao
-
(spark) branch master updated: [SPARK-47838][BUILD] Upgrade `rocksdbjni` to 8.11.4
dongjoon
-
(spark) branch master updated (f9ebe1b3d24b -> 6c827c10dc15)
xinrong
-
(spark) branch master updated: [SPARK-46375][DOCS] Add user guide for Python data source API
gurwls223
-
(spark) branch master updated (5321353b24db -> 86837d3155b1)
gurwls223
-
(spark) branch master updated: [SPARK-47875][CORE] Remove `spark.deploy.recoverySerializer`
dongjoon
-
(spark) branch master updated: [SPARK-47760][SPARK-47763][CONNECT][TESTS] Reeanble Avro and Protobuf function doctests
gurwls223
-
(spark) branch master updated: [SPARK-47868][CONNECT] Fix recursion limit error in SparkConnectPlanner and SparkSession
ruifengz
-
[PR] Fix title for spark 3.5.1 PySpark doc [spark-website]
via GitHub
-
(spark) branch master updated: [SPARK-47590][SQL] Hive-thriftserver: Migrate logWarn with variables to structured logging framework
gengliang
-
(spark) branch master updated (9a1fc112677f -> 6919febfcc87)
gengliang
-
(spark) branch master updated: [SPARK-47871][SQL] Oracle: Map TimestampType to TIMESTAMP WITH LOCAL TIME ZONE
dongjoon
-
(spark) branch master updated: [SPARK-47417][SQL] Collation support: Ascii, Chr, Base64, UnBase64, Decode, StringDecode, Encode, ToBinary, FormatNumber, Sentences
wenchen
-
(spark-kubernetes-operator) branch main updated: [SPARK-47745] Add License to Spark Operator repository
dongjoon
-
(spark-kubernetes-operator) branch main updated: Update GITHUB_API_BASE
dongjoon
-
(spark) branch master updated (4dad2170b05c -> 9b1b2b30d591)
hvanhovell
-
(spark) branch master updated: [SPARK-47356][SQL] Add support for ConcatWs & Elt (all collations)
wenchen
-
(spark) branch master updated: [SPARK-47739][SQL] Register logical avro type
dongjoon
-
(spark) branch master updated: [SPARK-46574][BUILD] Upgrade maven plugin to latest version
dongjoon
-
(spark) branch master updated: [SPARK-47818][CONNECT] Introduce plan cache in SparkConnectPlanner to improve performance of Analyze requests
gurwls223
-
(spark) branch master updated: [SPARK-47420][SQL] Fix test output
wenchen
-
(spark) branch master updated: [SPARK-47769][SQL] Add schema_of_variant_agg expression
wenchen
-
(spark) branch master updated: [SPARK-47463][SQL] Use V2Predicate to wrap expression with return type of boolean
wenchen
-
(spark) branch master updated (3ff339362b75 -> 21cc89b68ba5)
gurwls223
-
(spark) branch branch-3.5 updated: [SPARK-46335][BUILD][3.5] Upgrade Maven to 3.9.6
dongjoon
-
(spark) branch master updated: [SPARK-47861][BUILD] Upgrade `slf4j` to 2.0.13
dongjoon
-
(spark) branch branch-3.5 updated: [SPARK-47840][SS] Disable foldable propagation across Streaming Aggregate/Join nodes
kabhwan
-
(spark) branch master updated (51d3efcead5b -> f21719346eb0)
kabhwan
-
(spark) branch master updated: [SPARK-47233][CONNECT][SS][2/2] Client & Server logic for Client side streaming query listener
gurwls223
-
(spark) branch master updated (61f8ec6c5175 -> e815012f26ab)
gurwls223
-
(spark) branch master updated (c5b8e60e0d59 -> 61f8ec6c5175)
gurwls223
-
(spark) branch master updated (be080703688f -> c5b8e60e0d59)
wenchen
-
(spark) branch master updated: [SPARK-47673][SS] Implementing TTL for ListState
kabhwan
-
(spark) branch master updated: [SPARK-47804] Add Dataframe cache debug log
gengliang
-
(spark) branch branch-3.4 updated: [SPARK-43394][BUILD] Upgrade maven to 3.8.8
dongjoon
-
(spark) branch branch-3.5 updated (b8e2498007a0 -> 3b3903dda363)
dongjoon
-
(spark) branch master updated (becbca6752a5 -> 6d1b3668db42)
dongjoon
-
(spark) branch master updated (61264f77fd68 -> becbca6752a5)
dongjoon
-
(spark) branch master updated (83fe9b16ab5a -> 61264f77fd68)
gengliang
-
(spark) branch master updated: [SPARK-47694][CONNECT] Make max message size configurable on the client side
hvanhovell
-
(spark) branch master updated (f3a6ca9e2c47 -> ba673d74973a)
dongjoon
-
(spark) branch master updated (b8354bbe53c0 -> f3a6ca9e2c47)
wenchen
-
[PR] add pandas on spark page [spark-website]
via GitHub
-
(spark) branch master updated (e6b7950f553c -> b8354bbe53c0)
gurwls223
-
(spark) branch master updated (f86dc2b7e5c3 -> e6b7950f553c)
kabhwan