commits
Thread
Date
Earlier messages
Messages by Thread
(spark) branch master updated (9f8147c2a8d2 -> e01ed0da22f2)
dongjoon
(spark) branch master updated (acf17fd67217 -> 9f8147c2a8d2)
kabhwan
(spark) branch master updated (cb20fcae951d -> acf17fd67217)
dongjoon
(spark) branch master updated (51e8634a5883 -> cb20fcae951d)
dongjoon
(spark) branch master updated: [SPARK-47380][CONNECT] Ensure on the server side that the SparkSession is the same
hvanhovell
(spark) branch master updated: [SPARK-47446][CORE] Make `BlockManager` warn before `removeBlockInternal`
dongjoon
(spark) branch master updated: [SPARK-47383][CORE] Support `spark.shutdown.timeout` config
dongjoon
(spark) branch master updated: [SPARK-47435][SQL] Fix overflow issue of MySQL UNSIGNED TINYINT caused by SPARK-45561
dongjoon
(spark) branch master updated (4dc362dbc6c0 -> 1aafe60b3e76)
dongjoon
(spark) branch master updated: [SPARK-47438][BUILD] Upgrade jackson to 2.17.0
dongjoon
(spark) branch master updated: [MINOR][DOCS] Add `Web UI` link to `Other Documents` section of index.md
dongjoon
(spark) branch branch-3.4 updated: [SPARK-47434][WEBUI] Fix `statistics` link in `StreamingQueryPage`
dongjoon
(spark) branch branch-3.5 updated: [SPARK-47434][WEBUI] Fix `statistics` link in `StreamingQueryPage`
dongjoon
(spark) branch master updated (d3f12df6e09e -> 9b466d329c3c)
dongjoon
(spark) branch master updated: [SPARK-47437][PYTHON][CONNECT] Correct the error class for `DataFrame.sort*`
gurwls223
(spark) branch master updated (08866c280f87 -> 42c4dad62dcd)
gurwls223
(spark) branch master updated: [SPARK-47439][PYTHON] Document Python Data Source API in API reference page
gurwls223
(spark) branch master updated: [MINOR][TESTS] Collation - extending golden file coverage
maxgekk
(spark) branch master updated (310dd5294267 -> 3f171ce3f43b)
ruifengz
(spark) branch master updated: [SPARK-45891][DOCS] Update README with more details
wenchen
(spark) branch branch-3.4 updated (be0e44e59b3e -> b4e2c6750cb3)
dongjoon
(spark) branch branch-3.5 updated: [SPARK-47432][PYTHON][CONNECT][DOCS][3.5] Add `pyarrow` upper bound requirement, `<13.0.0`
dongjoon
(spark) branch branch-3.4 updated: [SPARK-45141][PYTHON][INFRA][TESTS] Pin `pyarrow==12.0.1` in CI
dongjoon
(spark) branch branch-3.5 updated: [SPARK-45141][PYTHON][INFRA][TESTS] Pin `pyarrow==12.0.1` in CI
dongjoon
(spark) branch master updated: [SPARK-47426][BUILD] Upgrade Guava used by the connect module to `33.1.0-jre`
dongjoon
(spark-website) branch asf-site updated: Update the organization in committers.md (#509)
dongjoon
[PR] Update the organization in committers.md [spark-website]
via GitHub
Re: [PR] Update the organization in committers.md [spark-website]
via GitHub
Re: [PR] Update the organization in committers.md [spark-website]
via GitHub
(spark) branch master updated: [SPARK-47377][PYTHON][CONNECT][TESTS][FOLLOWUP] Factor out more tests from `SparkConnectSQLTestCase`
gurwls223
(spark) branch branch-3.4 updated: [SPARK-47428][BUILD][3.4] Upgrade Jetty to 9.4.54.v20240208
dongjoon
(spark) branch branch-3.4 updated: [SPARK-45587][INFRA] Skip UNIDOC and MIMA in `build` GitHub Action job
dongjoon
(spark) branch branch-3.5 updated: [SPARK-45587][INFRA] Skip UNIDOC and MIMA in `build` GitHub Action job
dongjoon
(spark) branch branch-3.5 updated: [SPARK-47428][BUILD][3.5] Upgrade Jetty to 9.4.54.v20240208
dongjoon
(spark) branch master updated: [SPARK-47327][SQL] Move sort keys concurrency test to CollationFactorySuite
maxgekk
(spark) branch master updated: [SPARK-47423][SQL] Collations - Set operation support for strings with collations
maxgekk
(spark) branch master updated (7c81bdf1ed17 -> add49b3c115f)
ueshin
(spark) branch master updated: [SPARK-47345][SQL][TESTS] Xml functions suite
maxgekk
(spark) branch master updated (6bf031796c8c -> e2c0471476ea)
maxgekk
(spark) branch master updated (4437e6e21237 -> 6bf031796c8c)
dongjoon
(spark) branch master updated (b7aa9740249b -> 4437e6e21237)
dongjoon
(spark) branch master updated (4b1f8c3d779b -> b7aa9740249b)
maxgekk
(spark) branch master updated: [SPARK-47399][SQL] Disable generated columns on expressions with collations
maxgekk
(spark) branch master updated: [SPARK-47406][SQL] Handle TIMESTAMP and DATETIME in MYSQLDialect
yao
(spark) branch master updated: [SPARK-47234][BUILD] Upgrade Scala to 2.13.13
dongjoon
(spark) branch master updated (fe0aa1edff04 -> 7eea705d3015)
wenchen
(spark) branch master updated (213399b61de5 -> fe0aa1edff04)
dongjoon
(spark) branch master updated (7b4ab4fa452d -> 213399b61de5)
dongjoon
(spark) branch master updated (d41d5ecda8c1 -> 7b4ab4fa452d)
maxgekk
(spark) branch master updated: [SPARK-47390][SQL][FOLLOWUP] Fix TIME_WITH_TIMEZONE mapping in PostgresDialect
dongjoon
(spark) branch master updated (481597cd2d79 -> b98accd9d931)
dongjoon
(spark) branch master updated: [SPARK-47400][BUILD] Upgrade `gcs-connector` to 2.2.20
dongjoon
(spark) branch master updated: [SPARK-47384][BUILD] Upgrade RoaringBitmap to 1.0.5
dongjoon
(spark) branch master updated (5ce150735bc5 -> 168346f93303)
dongjoon
(spark) branch master updated: [SPARK-47394][SQL] Support TIMESTAMP WITH TIME ZONE for H2Dialect
dongjoon
(spark) branch master updated: [SPARK-47388][SQL] Pass `messageParameters` by name to `require()`
maxgekk
(spark) branch master updated: [SPARK-47208][CORE] Allow overriding base overhead memory
tgraves
(spark) branch branch-3.4 updated: [SPARK-47375][DOC][FOLLOWUP] Fix a mistake in JDBC's preferTimestampNTZ option doc
yao
(spark) branch branch-3.5 updated: [SPARK-47375][DOC][FOLLOWUP] Fix a mistake in JDBC's preferTimestampNTZ option doc
yao
(spark) branch master updated: [SPARK-47375][DOC][FOLLOWUP] Fix a mistake in JDBC's preferTimestampNTZ option doc
yao
(spark) branch master updated (49af659c9aec -> 336801dead40)
yao
(spark) branch master updated (9986462811f1 -> 49af659c9aec)
ruifengz
(spark) branch branch-3.3 updated: [SPARK-47385] Fix tuple encoders with Option inputs
wenchen
(spark) branch branch-3.4 updated: [SPARK-47385] Fix tuple encoders with Option inputs
wenchen
(spark) branch branch-3.5 updated: [SPARK-47385] Fix tuple encoders with Option inputs
wenchen
(spark) branch master updated (e9802116b047 -> 9986462811f1)
wenchen
(spark) branch master updated (56416378f86d -> 9efae37dc535)
gurwls223
(spark) branch master updated: [SPARK-47374][CONNECT][DOCS] Fix connect-repl `usage prompt` & `docs link`
gurwls223
(spark) branch master updated (abfbd2718159 -> 56416378f86d)
gurwls223
(spark) branch branch-3.4 updated: [SPARK-47375][DOC][FOLLOWUP] Correct the preferTimestampNTZ option description in JDBC doc
gengliang
(spark) branch branch-3.5 updated: [SPARK-47375][DOC][FOLLOWUP] Correct the preferTimestampNTZ option description in JDBC doc
gengliang
(spark) branch master updated (bc0ba7dccdd5 -> abfbd2718159)
gengliang
(spark) branch master updated: [SPARK-41762][PYTHON][CONNECT][TESTS] Enable column name comparsion in `test_column_arithmetic_ops`
ruifengz
(spark) branch master updated: [SPARK-46913][SS] Add support for processing/event time based timers with transformWithState operator
kabhwan
(spark) branch master updated: [SPARK-47344] Extend INVALID_IDENTIFIER error beyond catching '-' in an unquoted identifier and fix "IS ! NULL" et al.
gengliang
(spark) branch master updated: [SPARK-47378][PROTOBUF][TESTS] Make the related Protobuf UT run well in IDE
dongjoon
(spark) branch master updated: [SPARK-47375][SQL] Add guidelines for timestamp mapping in `JdbcDialect#getCatalystType`
yao
(spark) branch master updated: [SPARK-46654][SQL][PYTHON] Make `to_csv` explicitly indicate that it does not support some types of data
maxgekk
(spark) branch master updated: Revert "[SPARK-47342][SQL] Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE"
yao
(spark) branch master updated: [SPARK-47373][SQL] Match FileSourceScanLike to get metadata instead of FileSourceScanExec
dongjoon
(spark) branch master updated: [SPARK-46761][SQL] Quoted strings in a JSON path should support ? characters
gurwls223
(spark) branch branch-3.4 updated: [SPARK-47368][SQL]][3.5] Remove inferTimestampNTZ config check in ParquetRo…
gengliang
(spark) branch branch-3.5 updated (6629b9a6a5ae -> 3018a5d8cd96)
gengliang
(spark) branch master updated (78531ebb8064 -> c7795bb8cc82)
maxgekk
(spark) branch master updated: [SPARK-47340][SQL] Change "collate" in StringType typename to lowercase
maxgekk
(spark) branch master updated (5d32e62436dc -> 625589f736fe)
gengliang
(spark) branch master updated (37d0c556fdd9 -> 5d32e62436dc)
ruifengz
(spark) branch master updated (806f8e0466b9 -> 37d0c556fdd9)
gurwls223
(spark) branch master updated: [SPARK-47349][SQL][TESTS] Refactor string function `startsWith` and `endsWith` tests
dongjoon
(spark) branch master updated: [SPARK-47272][SS] Add MapState implementation for State API v2.
kabhwan
(spark) branch branch-3.4 updated: [SPARK-47370][DOC] Add migration doc: TimestampNTZ type inference on Parquet files
gengliang
(spark) branch branch-3.5 updated: [SPARK-47370][DOC] Add migration doc: TimestampNTZ type inference on Parquet files
gengliang
(spark) branch master updated: [SPARK-47370][DOC] Add migration doc: TimestampNTZ type inference on Parquet files
gengliang
(spark) branch master updated: [SPARK-47364][CORE] Make `PluginEndpoint` warn when plugins reply for one-way message
dongjoon
(spark) branch master updated: [SPARK-46331][SQL][FOLLOWUP] Time travel should support current datetime functions
maxgekk
(spark) branch master updated: [SPARK-46919][BUILD][CONNECT] Upgrade `grpcio*` and `grpc-java` to 1.62.x
dongjoon
(spark) branch master updated: [SPARK-47342][SQL] Support TimestampNTZ for DB2 TIMESTAMP WITH TIME ZONE
dongjoon
(spark) branch master updated: [SPARK-47335][BUILD] Upgrade `mvn-scalafmt` to `1.1.1684076452.9f83818` & `scalafmt` to `3.8.0`
dongjoon
(spark) branch master updated (f8a49030fd68 -> 6c30525e0d71)
maxgekk
(spark) branch master updated (fc61abd89cbf -> f8a49030fd68)
maxgekk
(spark) branch master updated (1f58f4c68e8d -> fc61abd89cbf)
maxgekk
(spark) branch master updated (95aec974d8e7 -> 1f58f4c68e8d)
maxgekk
(spark) branch master updated (e1865811cac9 -> 95aec974d8e7)
gurwls223
(spark) branch master updated: [MINOR] Minor English fixes
ruifengz
(spark) branch master updated: [SPARK-47250][SS] Add additional validations and NERF changes for RocksDB state provider and use of column families
kabhwan
(spark) branch master updated: [SPARK-46962][SS][PYTHON] Add interface for python streaming data source API and implement python worker to run python streaming data source
kabhwan
(spark-website) branch asf-site updated: Remove the extra text on page sql-error-conditions-sqlstates (#508)
yao
(spark) branch master updated (fe5998538596 -> 09bdf2a9334f)
yao
(spark) branch master updated (63c01c8036e8 -> fe5998538596)
yao
[PR] Remove the extra text on page sql-error-conditions-sqlstates [spark-website]
via GitHub
Re: [PR] Remove the extra text on page sql-error-conditions-sqlstates [spark-website]
via GitHub
Re: [PR] Remove the extra text on page sql-error-conditions-sqlstates [spark-website]
via GitHub
(spark) branch master updated: [SPARK-47309][SQL][XML] Add schema inference unit tests
gurwls223
(spark) branch master updated (c1b9f28682d8 -> f20b28e1005c)
gurwls223
(spark) branch master updated: [SPARK-47327][SQL] Fix thread safety issue in ICU Collator
gurwls223
(spark) branch master updated (f97da1638062 -> f40c693ad7fd)
dongjoon
(spark) branch master updated (610840e27e2e -> f97da1638062)
dongjoon
(spark) branch master updated (10be03215775 -> 610840e27e2e)
dongjoon
(spark) branch master updated: [SPARK-47255][SQL] Assign names to the error classes _LEGACY_ERROR_TEMP_323[6-7] and _LEGACY_ERROR_TEMP_324[7-9]
maxgekk
(spark) branch master updated (427f74066d57 -> 4b0d1085a782)
maxgekk
(spark) branch master updated (d5f42fc6f186 -> 427f74066d57)
maxgekk
(spark) branch master updated (f350b760ea11 -> d5f42fc6f186)
yao
(spark) branch master updated: [SPARK-47270][SQL] Dataset.isEmpty projects CommandResults locally
wenchen
(spark) branch master updated: [MINOR][DOCS][SQL] Fix doc comment for coalescePartitions.parallelismFirst on sql-performance-tuning page
yao
(spark) branch master updated (72a95bcad7f1 -> 66d6a23dc3b7)
maxgekk
(spark) branch master updated: [SPARK-47324][SQL] Add missing timestamp conversion for JDBC nested types
gurwls223
(spark) branch master updated: [SPARK-47331][SS] Serialization using case classes/primitives/POJO based on SQL encoder for Arbitrary State API v2
kabhwan
(spark) branch master updated (f6df78154bac -> 5ac560c76e60)
gurwls223
(spark) branch master updated: [SPARK-47035][SS][CONNECT][FOLLOWUP] Additional protobuf change to client side listener
gurwls223
(spark) branch master updated: [SPARK-47334][SQL] Make `withColumnRenamed` reuse the implementation of `withColumnsRenamed`
gurwls223
(spark) branch master updated: [SPARK-47325][INFRA] Use the latest `buf-setup-action` in github workflow
gurwls223
(spark) branch master updated: [SPARK-47200][SS] Make Foreach batch sink user function error handling backward compatible
kabhwan
(spark) branch master updated: [SPARK-47218][SQL] XML: Changed SchemaOfXml to fail on DROPMALFORMED mode
gurwls223
(spark) branch master updated: [MINOR][SQL][TEST] Moving tests to related suites
maxgekk
(spark) branch master updated: [SPARK-44115][BUILD] Upgrade Apache ORC to 2.0.0
dongjoon
(spark) branch master updated: [SPARK-47322][PYTHON][CONNECT] Make `withColumnsRenamed` column names duplication handling consistent with `withColumnRenamed`
gurwls223
(spark) branch master updated: [SPARK-47302][SQL] Collate keyword as identifier
maxgekk
(spark) branch master updated (00de3ed5e0aa -> 7a3b3c612d16)
yao
(spark) branch master updated (50131054b818 -> 00de3ed5e0aa)
ruifengz
(spark) branch master updated (c0a8cf9cca08 -> 50131054b818)
wenchen
(spark) branch branch-3.4 updated: [SPARK-47305][SQL][TESTS][FOLLOWUP][3.4] Fix the compilation error related to `PropagateEmptyRelationSuite`
yangjie01
(spark) branch master updated (f659f8d1b019 -> c0a8cf9cca08)
gurwls223
(spark) branch master updated: [SPARK-47319][SQL] Improve missingInput calculation
yao
(spark) branch master updated: [SPARK-47314][DOC] Remove the wrong comment line of `ExternalSorter#writePartitionedMapOutput` method
yao
(spark) branch master updated (9cac2bb608c6 -> 703d1d8e4be2)
gurwls223
(spark) branch master updated (7a5bb5d83551 -> 9cac2bb608c6)
gurwls223
(spark) branch master updated: [SPARK-47078][DOCS][PYTHON] Documentation for SparkSession-based Profilers
gurwls223
(spark) branch master updated: [SPARK-47276][PYTHON][CONNECT] Introduce `spark.profile.clear` for SparkSession-based profiling
xinrong
(spark) branch master updated (456d246badb8 -> 0f9164201ff0)
wenchen
(spark) branch master updated (7a429aa84a5e -> 456d246badb8)
wenchen
(spark) branch branch-3.4 updated: [MINOR][DOCS][PYTHON] Fix documentation typo in takeSample method
yao
(spark) branch branch-3.5 updated: [MINOR][DOCS][PYTHON] Fix documentation typo in takeSample method
yao
(spark) branch master updated (3112762e88b9 -> 7a429aa84a5e)
yao
(spark) branch master updated (620297ab6d8f -> 3112762e88b9)
yao
(spark) branch master updated (9b743ffb577a -> 620297ab6d8f)
yao
(spark) branch master updated (0ff22b0019f1 -> 9b743ffb577a)
yao
(spark) branch master updated (51f4cfa7560b -> 0ff22b0019f1)
yao
(spark) branch branch-3.5 updated: [SPARK-47241][SQL] Fix rule order issues for ExtractGenerator
wenchen
(spark) branch master updated (9f28c43a127d -> 51f4cfa7560b)
wenchen
(spark) branch master updated: [SPARK-47315][SQL][TEST] Clean up tempView for `createTempView` UT
yao
(spark) branch master updated (8d6bd9bbd29d -> 15d7755fd1cb)
gurwls223
(spark) branch branch-3.4 updated: [SPARK-47305][SQL] Fix PruneFilters to tag the isStreaming flag of LocalRelation correctly when the plan has both batch and streaming
kabhwan
(spark) branch branch-3.5 updated: [SPARK-47305][SQL] Fix PruneFilters to tag the isStreaming flag of LocalRelation correctly when the plan has both batch and streaming
kabhwan
(spark) branch master updated (3ec79a9df06f -> 8d6bd9bbd29d)
kabhwan
(spark) branch master updated (e341e26330ba -> 3ec79a9df06f)
wenchen
(spark) branch master updated (0c28df40e049 -> e341e26330ba)
gurwls223
(spark) branch master updated (c6538301c0a8 -> 0c28df40e049)
ruifengz
(spark) branch master updated: [SPARK-47070][SQL][FOLLOW-UP] Add a flag guarding a subquery in aggregate rewrite
gurwls223
(spark) branch master updated (88599ea6568f -> d9881bd59d05)
gurwls223
(spark) branch master updated: [SPARK-47303][CORE][TESTS] Restructure MasterSuite
gurwls223
(spark) branch master updated (fe2174d8caaf -> d705d868aaaa)
liyuanjian
(spark) branch master updated: [SPARK-47304][SQL][TESTS] Distribute tests from `DataFrameSuite` to more specific suites
maxgekk
(spark) branch branch-3.4 updated: [SPARK-47146][CORE][FOLLOWUP] Rename incorrect logger name
gurwls223
(spark) branch master updated: [SPARK-47146][CORE][FOLLOWUP] Rename incorrect logger name
gurwls223
(spark) branch branch-3.5 updated: [SPARK-47146][CORE][FOLLOWUP] Rename incorrect logger name
gurwls223
(spark) branch master updated (d5f35ec97fc4 -> 58761623dcdd)
yao
(spark) branch master updated (d7cc708e1e0d -> d5f35ec97fc4)
wenchen
(spark) branch branch-3.5 updated (e9f7d36797c4 -> ba229613c08e)
gurwls223
(spark) branch master updated: [SPARK-47280][SQL] Remove timezone limitation for ORACLE TIMESTAMP WITH TIMEZONE
yao
(spark) branch master updated (36299f1b2bff -> e310e76e63fe)
wenchen
(spark) branch branch-3.4 updated: [SPARK-47146][CORE][3.5] Possible thread leak when doing sort merge join
mridulm80
(spark) branch branch-3.5 updated (14762b372dd6 -> e9f7d36797c4)
mridulm80
(spark) branch master updated: [SPARK-47285][SQL] AdaptiveSparkPlanExec should always use the context.session
yao
(spark) branch master updated (474310347802 -> e0d79108cacc)
gurwls223
(spark) branch master updated (c88f0310621b -> 474310347802)
gurwls223
(spark) branch master updated (c417c757907e -> c88f0310621b)
gurwls223
(spark) branch master updated (502fa8070c65 -> c417c757907e)
wenchen
(spark) branch master updated (6534a3398ae9 -> 502fa8070c65)
wenchen
(spark) branch master updated: [SPARK-47102][SQL] Add the `COLLATION_ENABLED` config flag
maxgekk
[PR] Update the `versions.json` file for the already released spark version [spark-website]
via GitHub
Re: [PR] Update the `versions.json` file for the already released spark version [spark-website]
via GitHub
Re: [PR] Update the `versions.json` file for the already released spark version [spark-website]
via GitHub
Re: [PR] Update the `versions.json` file for the already released spark version [spark-website]
via GitHub
Re: [PR] Update the `versions.json` file for the already released spark version [spark-website]
via GitHub
Re: [PR] Fix version dropdown issue in version 3.5.1 of pyspark document [spark-website]
via GitHub
Re: [PR] Fix version dropdown issue in version 3.5.1 of pyspark document [spark-website]
via GitHub
Re: [PR] Fix version dropdown issue in version 3.5.1 of pyspark document [spark-website]
via GitHub
Re: [PR] Fix version dropdown issue in version 3.5.1 of pyspark document [spark-website]
via GitHub
Re: [PR] Fix version dropdown issue in version 3.5.1 of pyspark document [spark-website]
via GitHub
Re: [PR] Fix version dropdown issue in version 3.5.1 of pyspark document [spark-website]
via GitHub
Earlier messages