commits
Thread
Date
Earlier messages
Later messages
Messages by Thread
(spark) branch master updated: [SPARK-46454][SQL][DSTREAM] Remove redundant `.headOption`
maxgekk
(spark) branch master updated: [SPARK-46451][PS][TESTS] Reorganize `GroupbyStatTests`
ruifengz
(spark) branch branch-3.5 updated: [SPARK-46453][CONNECT] Throw exception from `internalError()` in `SessionHolder`
maxgekk
(spark) branch master updated: [SPARK-46453][CONNECT] Throw exception from `internalError()` in `SessionHolder`
maxgekk
(spark) branch master updated: [SPARK-46433][PS][TESTS][FOLLOWUPS] Reorganize `OpsOnDiffFramesGroupByTests`: Factor out 4 more slow tests
ruifengz
(spark) branch master updated: [SPARK-46446][SQL] Disable subqueries with correlated OFFSET to fix correctness bug
wenchen
(spark) branch master updated: [SPARK-46424][PYTHON][SQL][FOLLOW-UP] Refactor and clean up Python metric implementation
gurwls223
(spark) branch master updated: [SPARK-46308] Forbid recursive error handling by adding recursion guards
gurwls223
(spark) branch master updated: [SPARK-46411][BUILD] Change to use `bcprov/bcpkix-jdk18on` for UT
dongjoon
(spark) branch master updated: [SPARK-46439][PS][TESTS] Move IO-related tests to `pyspark.pandas.tests.io.*`
dongjoon
(spark) branch master updated (9756bbe8026c -> 61f51113d884)
dongjoon
(spark) branch master updated: [SPARK-46289][SQL] Support ordering UDTs in interpreted mode
dongjoon
(spark) branch master updated (036af4bf2336 -> feeb9a0b6208)
dongjoon
(spark) branch master updated: [SPARK-45725][SQL][FOLLOWUP] Fix arguments of a removed SQL config
maxgekk
(spark) branch master updated (bfafad4d47b4 -> 5c80e6aec29e)
wenchen
(spark) branch master updated: [SPARK-46440][SQL] Set the rebase configs to the `CORRECTED` mode by default
maxgekk
(spark) branch master updated: [SPARK-46436][INFRA] Clean up compatibility configurations related to branch-3.3 daily testing in `build_and_test.yml`
ruifengz
(spark) branch master updated: [SPARK-46435][INFRA] Exclude `branch-3.3` from `publish_snapshot.yml`
yangjie01
(spark) branch master updated (5edd0ec696d6 -> 1b413a4bd61e)
ruifengz
(spark) branch master updated: [SPARK-46317][INFRA][FOLLOWUP] Install `lxml` in PyPy3.8
ruifengz
(spark) branch master updated: [SPARK-46434][INFRA] Remove `build_branch33.yml`
yao
(spark) branch master updated (96bf373e9002 -> d163b319e21a)
kabhwan
(spark) branch master updated: [SPARK-46430][CONNECT][TESTS] Add test for `ProtoUtils.abbreviate`
dongjoon
(spark) branch master updated (5e1b904ca54f -> 29db77653fe0)
dongjoon
(spark) branch master updated: [SPARK-46389][CORE] Manually close the `RocksDB/LevelDB` instance when `checkVersion` throw Exception
dongjoon
(spark) branch master updated: [SPARK-46376][SQL][TESTS] Simplify the code to generate the Spark tarball `filename` in the `HiveExternalCatalogVersionsSuite`
dongjoon
(spark) branch master updated: [SPARK-46410][SQL] Assign error classes/subclasses to JdbcUtils.classifyException
maxgekk
Error while running notifications feature from .asf.yaml in spark!
Apache Infrastructure
(spark) branch master updated: [SPARK-46406][SQL] Assign a name to the error class _LEGACY_ERROR_TEMP_1023
beliefer
(spark) branch master updated: [SPARK-45502][BUILD] Upgrade Kafka to 3.6.1
dongjoon
(spark) branch master updated: [MINOR][DOCS] Use user-facing feature names in Python metrics documentation
dongjoon
[PR] Add news, release note, download link for Apache Spark 3.3.4 [spark-website]
via GitHub
Re: [PR] Add news, release note, download link for Apache Spark 3.3.4 [spark-website]
via GitHub
Re: [PR] Add news, release note, download link for Apache Spark 3.3.4 [spark-website]
via GitHub
Re: [PR] Add news, release note, download link for Apache Spark 3.3.4 [spark-website]
via GitHub
(spark) branch master updated: [SPARK-46386][PYTHON] Improve assertions of observation (pyspark.sql.observation)
gurwls223
(spark) branch master updated: [SPARK-46424][PYTHON][SQL] Support Python metrics in Python Data Source
gurwls223
(spark) branch master updated (ac935f5074d -> f69f791ef87)
beliefer
[PR] Add Apache Spark 3.3.4 docs [spark-website]
via GitHub
Re: [PR] Add Apache Spark 3.3.4 docs [spark-website]
via GitHub
Re: [PR] Add Apache Spark 3.3.4 docs [spark-website]
via GitHub
(spark) tag v3.3.4 created (now 18db204995b)
dongjoon
(spark) branch master updated: [SPARK-46427][PYTHON][SQL] Change Python Data Source's description to be pretty in explain
gurwls223
(spark) branch master updated: [MINOR][SQL][PYTHON] Rename Python plan node names
gurwls223
(spark) branch master updated: [SPARK-46403][SQL] Decode parquet binary with getBytesUnsafe method
beliefer
(spark) branch master updated: [SPARK-46425][INFRA] Pin the bundler version in CI
gurwls223
(spark) branch master updated (d34d9b39aec -> f9a8e135761)
gurwls223
(spark) branch master updated: [SPARK-46422][PS][TESTS] Move `test_window` to `pyspark.pandas.tests.window.*`
ruifengz
svn commit: r66087 - /release/spark/spark-3.3.3/
dongjoon
svn commit: r66086 - /dev/spark/v3.3.4-rc1-bin/ /release/spark/spark-3.3.4/
dongjoon
(spark) branch master updated: [SPARK-46423][PYTHON][SQL] Make the Python Data Source instance at DataSource.lookupDataSourceV2
gurwls223
(spark) branch master updated (3d447c21b426 -> 69de04f6aaac)
wenchen
(spark) branch master updated: [SPARK-46419][PS][TESTS] Reorganize `DatetimeIndexTests`: Factor out 3 slow tests
gurwls223
(spark) branch master updated: [SPARK-45597][PYTHON][SQL] Support creating table using a Python data source in SQL (DSv2 exec)
gurwls223
(spark) branch master updated (15e99cf676d9 -> 69237c9b09f3)
gurwls223
(spark) branch master updated: [MINOR][CONNECT][PYTHON] Fix minor test issue and properly yield extension from result
gurwls223
[PR] docs: update examples page [spark-website]
via GitHub
Re: [PR] docs: update examples page [spark-website]
via GitHub
Re: [PR] docs: update examples page [spark-website]
via GitHub
(spark) branch branch-3.4 updated: [SPARK-46417][SQL] Do not fail when calling hive.getTable and throwException is false
yao
(spark) branch branch-3.5 updated: [SPARK-46417][SQL] Do not fail when calling hive.getTable and throwException is false
yao
(spark) branch master updated: [SPARK-46417][SQL] Do not fail when calling hive.getTable and throwException is false
yao
(spark) branch master updated: [SPARK-46418][PS][TESTS] Reorganize `ReshapeTests`
ruifengz
(spark) branch master updated: [SPARK-46402][PYTHON] Add getMessageParameters and getQueryContext support
gurwls223
(spark) branch master updated: [SPARK-46416][CORE] Add `@tailrec` to `HadoopFSUtils#shouldFilterOutPath`
yangjie01
(spark) branch master updated (b1e8b50e018c -> 7d30bd7e25ed)
yao
(spark) branch master updated: [SPARK-46407][PS][TESTS] Reorganize `OpsOnDiffFramesDisabledTests`
ruifengz
(spark) branch master updated: [SPARK-45005][PS][TESTS][FOLLOWUPS] Deduplicate `test_properties`
ruifengz
(spark) branch master updated: [SPARK-46294][SQL] Clean up semantics of init vs zero value
wenchen
(spark) branch master updated: [SPARK-46043][SQL][FOLLOWUP] Remove the catalog and identifier check in DataSourceV2Relation
wenchen
(spark) branch master updated: [SPARK-45796][SQL] Support MODE() WITHIN GROUP (ORDER BY col)
beliefer
(spark) branch master updated: [SPARK-46391][PS][TESTS] Reorganize `ExpandingParityTests`
ruifengz
(spark) branch master updated: [SPARK-46401][CORE] Use `!isEmpty()` on `RoaringBitmap` instead of `getCardinality() > 0` in `RemoteBlockPushResolver`
yangjie01
(spark) branch branch-3.5 updated: [SPARK-46396][SQL] Timestamp inference should not throw exception
gengliang
(spark) branch master updated (f1e5a136fa79 -> 4a79ae9d821e)
gengliang
(spark) branch master updated: [SPARK-46393][SQL] Classify exceptions in the JDBC table catalog
maxgekk
(spark) branch master updated: [SPARK-46379][PS][TESTS][FOLLOWUPS] Deduplicate `test_interpolate_error`
ruifengz
(spark) branch master updated: [SPARK-46394][SQL] Fix spark.catalog.listDatabases() issues on schemas with special characters when `spark.sql.legacy.keepCommandOutputSchema` set to true
wenchen
(spark) branch master updated: Revert "[SPARK-46377][INFRA] Upgrade labeler action to v5"
yangjie01
(spark) branch master updated: [SPARK-46377][INFRA] Upgrade labeler action to v5
yao
(spark) branch master updated: [SPARK-46377][INFRA] Upgrade labeler action to v5
dongjoon
(spark) branch master updated: [SPARK-46357] Replace incorrect documentation use of setConf with conf.set
yao
(spark) branch master updated (79f61985c8de -> 6afc0f856298)
gurwls223
(spark) branch master updated: [SPARK-46385][PYTHON][TESTS] Test aggregate functions for groups (pyspark.sql.group)
gurwls223
(spark) branch master updated (ff26b602c92b -> 96107ca42ddb)
gurwls223
(spark) branch master updated: [SPARK-45798][CONNECT] Followup: add serverSessionId to SessionHolderInfo
gurwls223
(spark) branch master updated (ccc436d829cd -> 4c8d01aa3a51)
gurwls223
(spark) branch branch-3.5 updated: [SPARK-46388][SQL] HiveAnalysis misses the pattern guard of `query.resolved`
yao
(spark) branch master updated: [SPARK-46388][SQL] HiveAnalysis misses the pattern guard of `query.resolved`
yao
(spark) branch master updated: [SPARK-46381][SQL] Migrate sub-classes of `AnalysisException` to error classes
maxgekk
[PR] [SPARK-46390] Update the `Example` page [spark-website]
via GitHub
Re: [PR] [SPARK-46390] Update the `Example` page [spark-website]
via GitHub
Re: [PR] [SPARK-46390] Update the `Example` page [spark-website]
via GitHub
Re: [PR] [SPARK-46390] Update the `Example` page [spark-website]
via GitHub
Re: [PR] [SPARK-46390] Update the `Example` page [spark-website]
via GitHub
Re: [PR] [SPARK-46390] Update the `Example` page [spark-website]
via GitHub
Re: [PR] [SPARK-46390] Update the `Example` page [spark-website]
via GitHub
Re: [PR] [SPARK-46390] Update the `Example` page [spark-website]
via GitHub
(spark) branch master updated (83434af22284 -> 4f65413031d8)
gurwls223
(spark) branch master updated: [SPARK-46132][CORE] Support key password for JKS keys for RPC SSL
mridulm80
(spark) branch master updated: [SPARK-46370][SQL] Fix bug when querying from table after changing column defaults
wenchen
(spark) branch master updated: [SPARK-46202][CONNECT] Expose new ArtifactManager APIs to support custom target directories
hvanhovell
(spark) branch master updated: [SPARK-46253][PYTHON] Plan Python data source read using MapInArrow
gurwls223
(spark) branch master updated: [SPARK-46378][SQL] Still remove Sort after converting Aggregate to Project
wenchen
(spark) branch master updated: [SPARK-46353][CORE] Refactor to improve `RegisterWorker` unit test coverage
dongjoon
(spark) branch master updated: [SPARK-46075][CONNECT] Improvements to SparkConnectSessionManager
gurwls223
(spark) branch master updated: [MINOR][SQL] Convert `UnresolvedException` to an internal error
maxgekk
(spark) branch master updated: [SPARK-46360][PYTHON] Enhance error message debugging with new `getMessage` API
gurwls223
(spark) branch master updated: [SPARK-43427][PROTOBUF] spark protobuf: allow upcasting unsigned integer types
gurwls223
(spark) branch branch-3.4 updated: [SPARK-46369][CORE] Remove `kill` link from `RELAUNCHING` drivers in `MasterPage`
dongjoon
(spark) branch branch-3.5 updated: [SPARK-46369][CORE] Remove `kill` link from `RELAUNCHING` drivers in `MasterPage`
dongjoon
(spark) branch master updated (3e0808c33f1 -> e434c9f0d57)
dongjoon
(spark) branch master updated: [SPARK-46351][SQL] Require an error class in `AnalysisException`
maxgekk
(spark) branch master updated: [SPARK-46273][SQL] Support INSERT INTO/OVERWRITE using DSv2 sources
gurwls223
(spark) branch master updated: [SPARK-46341][PS][TESTS][FOLLOWUP] Sort indices before dataframe comparison
gurwls223
(spark) branch master updated: [SPARK-46347][PS][TESTS] Reorganize `RollingTests `
gurwls223
(spark) branch master updated: [SPARK-46355][SQL] XML: Close InputStreamReader on read completion
gurwls223
(spark) branch master updated: [SPARK-46358][CONNECT] Simplify the condition check in the `ResponseValidator#verifyResponse`
dongjoon
(spark) branch master updated (bab884082c0 -> bb886abcc4a)
dongjoon
(spark) branch branch-3.5 updated: [MINOR][DOCS] Fix documentation for `spark.sql.legacy.doLooseUpcast` in SQL migration guide
maxgekk
(spark) branch master updated: [MINOR][DOCS] Fix documentation for `spark.sql.legacy.doLooseUpcast` in SQL migration guide
maxgekk
(spark) branch master updated: [SPARK-45649][SQL] Unify the prepare framework for OffsetWindowFunctionFrame
beliefer
(spark) branch master updated: [SPARK-46215][CORE][FOLLOWUP] Handle symbolic links
dongjoon
(spark) branch master updated: [SPARK-45642][CORE][SQL] Fix `FileSystem.isFile & FileSystem.isDirectory is deprecated`
dongjoon
(spark) branch branch-3.5 updated: [SPARK-45969][DOCS] Document configuration change of executor failure tracker
dongjoon
(spark) branch master updated: [SPARK-45969][DOCS] Document configuration change of executor failure tracker
dongjoon
(spark) branch master updated: [SPARK-46285][SQL] Add `foreachWithSubqueries`
dongjoon
(spark) branch master updated: [SPARK-46342][SQL] Replace `IllegalStateException` by `SparkException.internalError` in sql
dongjoon
(spark) branch master updated: [SPARK-46346][CORE] Fix Master to update a worker from `UNKNOWN` to `ALIVE` on `RegisterWorker` msg
dongjoon
(spark) branch master updated: [SPARK-46348][CORE] Support `spark.deploy.recoveryTimeout`
dongjoon
(spark) branch master updated (bac3492980a3 -> e4570f871ad4)
ruifengz
(spark) branch master updated: [SPARK-46341][PS][TESTS] Reorganize `SeriesInterpolateTests`
ruifengz
(spark) branch master updated: [SPARK-46340][PS][CONNECT][TESTS] Reorganize `EWMTests`
ruifengz
(spark) branch master updated: [SPARK-46344][CORE] Warn properly when a driver exists successfully but master is disconnected
dongjoon
(spark) branch branch-3.4 updated: [SPARK-46339][SS] Directory with batch number name should not be treated as metadata log
dongjoon
(spark) branch branch-3.5 updated: [SPARK-46339][SS] Directory with batch number name should not be treated as metadata log
dongjoon
(spark) branch master updated: [SPARK-46339][SS] Directory with batch number name should not be treated as metadata log
dongjoon
(spark) branch master updated (1af4b658064d -> cae4bdc88161)
dongjoon
(spark) branch master updated: [SPARK-46338][PS][TESTS] Re-enable the `get_item` test for `BasicIndexingTests`
dongjoon
(spark) branch master updated: [SPARK-46333][SQL] Replace `IllegalStateException` by `SparkException.internalError` in catalyst
maxgekk
(spark) branch master updated: [SPARK-46337][SQL][CONNECT][PYTHON] Make `CTESubstitution` retain the `PLAN_ID_TAG`
gurwls223
(spark) branch master updated: [SPARK-46334][INFRA][PS] Upgrade `Pandas` to 2.1.4
dongjoon
(spark) branch master updated: [SPARK-46335][BUILD] Upgrade Maven to 3.9.6 for MNG-7913
yangjie01
(spark) branch branch-3.4 updated: [SPARK-46275][3.4] Protobuf: Return null in permissive mode when deserialization fails
dongjoon
(spark) branch master updated: [SPARK-46325][CONNECT] Remove unnecessary override functions when constructing `WrappedCloseableIterator` in `ResponseValidator#wrapIterator`
dongjoon
(spark) branch master updated: [SPARK-46332][SQL] Migrate `CatalogNotFoundException` to the error class `CATALOG_NOT_FOUND`
dongjoon
(spark) branch master updated: [SPARK-46324][SQL][PYTHON] Fix the output name of pyspark.sql.functions.user and session_user
dongjoon
svn commit: r65952 - in /dev/spark/v3.3.4-rc1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/R/articles/ _site/api/R/deps/ _site/api/R/deps/bootstrap-5.3.1/ _site/api/R/deps/bootstrap-5.3.1/fonts/ _site/api/R/deps/jquery-3.6.0/ _site/api/R/reference...
dongjoon
svn commit: r65951 - /dev/spark/v3.4.2-rc1-docs/
dongjoon
svn commit: r65950 - /dev/spark/v3.3.4-rc1-bin/
dongjoon
(spark) branch master updated: [SPARK-46328][SQL] Allocate capacity of array list of TColumns by columns size in TRowSet generation
dongjoon
(spark) branch branch-3.3 updated (6a4488f2f486 -> 0837e78d9cee)
dongjoon
(spark) 01/01: Preparing development version 3.3.5-SNAPSHOT
dongjoon
(spark) tag v3.3.4-rc1 created (now 18db204995b3)
dongjoon
(spark) 01/01: Preparing Spark release v3.3.4-rc1
dongjoon
(spark) branch master updated: [SPARK-46327][PS][CONNECT][TESTS] Reorganize `SeriesStringTests`
gurwls223
(spark) branch master updated: [SPARK-46326][PYTHON][TESTS] Test missing cases for functions (pyspark.sql.functions)
gurwls223
(spark) branch master updated: [SPARK-46323][PYTHON] Fix the output name of pyspark.sql.functions.now
gurwls223
(spark) branch branch-3.5 updated: [SPARK-46275] Protobuf: Return null in permissive mode when deserialization fails
gurwls223
(spark) branch master updated: [SPARK-46275] Protobuf: Return null in permissive mode when deserialization fails
gurwls223
(spark) branch master updated (c06d41859f08 -> 9ffdcc398ed5)
dongjoon
(spark) branch master updated (b6b450927ec8 -> c06d41859f08)
dongjoon
(spark) branch master updated: [SPARK-46317][PYTHON][CONNECT] Match minor behaviour matching in SparkSession with full test coverage
gurwls223
(spark) branch master updated: [SPARK-46315][PYTHON][TESTS] Test invalid key for spark.conf.get (pyspark.sql.conf)
gurwls223
(spark) branch master updated: [SPARK-46318][PYTHON][INFRA] Exclude ported pyspark.loose_version from the code coverage report
gurwls223
(spark) branch master updated: [SPARK-46316][CORE] Enable `buf-lint-action` on `core` module
dongjoon
(spark) branch master updated: Revert "[SPARK-46316][CORE] Enable `buf-lint-action` on `core` module"
dongjoon
(spark) branch master updated (105eee73cfa0 -> dcbae0643ce1)
dongjoon
(spark) branch master updated (61a3e0587df6 -> 105eee73cfa0)
dongjoon
(spark) branch master updated: [SPARK-46312][CORE] Use `lower_camel_case` in `store_types.proto`
dongjoon
(spark) branch master updated: [SPARK-46309][PS][TESTS] Remove unused code in `pyspark.pandas.tests.indexes.* `
dongjoon
(spark) branch master updated (027aeb1764a8 -> 82e67461511e)
dongjoon
(spark) branch master updated: [SPARK-46277][PYTHON] Validate startup urls with the config being set
xinrong
(spark) branch master updated: [SPARK-46293][CONNECT][PYTHON] Use `protobuf` transitive dependency
dongjoon
(spark) branch master updated (0692856bb124 -> 8132e1700c81)
dongjoon
(spark) branch master updated: [SPARK-46304][INFRA] Upgrade setup-java action to v4 and setup-python to v5
ruifengz
(spark) branch master updated: [SPARK-46301][CORE] Support `spark.worker.(initial|max)RegistrationRetries`
dongjoon
(spark) branch master updated: [SPARK-46303][PS][TESTS] Remove unused code in `pyspark.pandas.tests.series.* `
ruifengz
(spark) branch master updated: [SPARK-46300][PYTHON][CONNECT] Match minor behaviour matching in Column with full test coverage
gurwls223
(spark) branch master updated: [SPARK-45515][CORE][SQL][FOLLOWUP] Use enhanced switch expressions to replace the regular switch statement
beliefer
(spark) branch master updated: [SPARK-46298][PYTHON][CONNECT] Match deprecation warning, test case, and error of Catalog.createExternalTable
gurwls223
(spark) branch master updated: [SPARK-46296][PYTHON][TESTS] Test missing test coverage for captured errors (pyspark.errors.exceptions)
gurwls223
(spark) branch branch-3.3 updated: [SPARK-45580][SQL][3.3] Handle case where a nested subquery becomes an existence join
dongjoon
(spark) branch branch-3.4 updated: [SPARK-45580][SQL][3.4] Handle case where a nested subquery becomes an existence join
dongjoon
(spark) branch master updated: [SPARK-46299][DOCS] Make `spark.deploy.recovery*` docs up-to-date
dongjoon
(spark) branch master updated: [SPARK-46297][PYTHON][INFRA] Exclude generated files from the code coverage report
gurwls223
(spark) branch master updated: [SPARK-46058][CORE] Add separate flag for privateKeyPassword
mridulm80
(spark) branch master updated: [SPARK-46292][CORE][UI] Show a summary of workers in MasterPage
dongjoon
(spark) branch master updated: [SPARK-46290][PYTHON] Change saveMode to a boolean flag for DataSourceWriter
gurwls223
(spark) branch master updated: [SPARK-46231][PYTHON][FOLLOWUP] Cleanup duplicated test
gurwls223
(spark) branch master updated: [MINOR][PYTHON][DOCS] Rename "Koalas" > "Pandas-on-Spark" for testing util doc
gurwls223
(spark) branch branch-3.5 updated: [SPARK-45580][SQL][3.5] Handle case where a nested subquery becomes an existence join
dongjoon
(spark) branch branch-3.5 updated: [SPARK-46274][SQL] Fix Range operator computeStats() to check long validity before converting
wenchen
(spark) branch master updated: [SPARK-46274][SQL] Fix Range operator computeStats() to check long validity before converting
wenchen
(spark) branch master updated: [SPARK-46230][PYTHON] Migrate `RetriesExceeded` into PySpark error
dongjoon
(spark) branch master updated: [SPARK-46270][SQL][CORE][SS] Use java16 instanceof expressions to replace the java8 instanceof statement
dongjoon
(spark) branch master updated: [SPARK-46186][CONNECT][TESTS][FOLLOWUP] Remove flakiness of `ReattachableExecuteSuite`
dongjoon
(spark) branch master updated: [SPARK-45580][SQL] Handle case where a nested subquery becomes an existence join
dongjoon
(spark) branch master updated: [SPARK-46232][PYTHON][FOLLOWUP] Migrate `ValueError` into `PySparkValueError`
dongjoon
(spark) branch master updated: [SPARK-46283][INFRA] Remove `streaming-kinesis-asl` module from `MODULES_TO_TEST` for branch-3.x daily tests
dongjoon
Earlier messages
Later messages