Messages by Thread
-
(spark) branch master updated: [SPARK-45481][SQL][FOLLOWUP] Add `lowerCaseName` for `ParquetCompressionCodec`
dongjoon
-
(spark) branch master updated: [SPARK-45689][SPARK-45690][SPARK-45691][CORE][SQL] Clean up the deprecated API usage related to `StringContext/StringOps/RightProjection/LeftProjection/Either` and type use of `BufferedIterator/CanBuildFrom/Traversable`
yangjie01
-
(spark) branch master updated: [SPARK-43380][SQL][FOLLOWUP] Deprecate toSqlType(avroSchema: Schema, …useStableIdForUnionType: Boolean): SchemaType
beliefer
-
(spark) branch master updated: [SPARK-45681][UI] Clone a js version of UIUtils.errorMessageCell for consistent error rendering on UI
yao
-
(spark) branch master updated (b92265a98f2 -> e499ba80be6)
gurwls223
-
(spark) branch master updated: [SPARK-45685][CORE][SQL] Use `LazyList` instead of `Stream`
dongjoon
-
(spark) branch master updated: [SPARK-45707][SQL] Simplify `DataFrameStatFunctions.countMinSketch` with `CountMinSketchAgg`
dongjoon
-
(spark) branch master updated: [SPARK-45682][CORE][SQL][ML][MLLIB][GRAPHX][YARN][DSTREAM][UI][EXAMPLES] Fix "method + in class Byte/Short/Char/Long/Double/Int is deprecated"
dongjoon
-
(spark) branch master updated: [SPARK-45664][SQL] Introduce a mapper for orc compression codecs
dongjoon
-
(spark) branch master updated: [SPARK-44790][SQL] XML: to_xml implementation and bindings for python, connect and SQL
gurwls223
-
[PR] Add Matomo analytics to the published documents [spark-website]
via GitHub
-
(spark) branch master updated (4af4ddea116 -> 0245b842ccc)
gurwls223
-
(spark) branch master updated: [SPARK-45552][PS] Introduce flexible parameters to `assertDataFrameEqual`
gurwls223
-
(spark) branch master updated: [SPARK-45544][CORE] Integrate SSL support into TransportContext
mridulm80
-
(spark) branch master updated: [SPARK-45605][CORE][SQL][SS][CONNECT][MLLIB][GRAPHX][DSTREAM][PROTOBUF][EXAMPLES] Replace `s.c.MapOps.mapValues` with `s.c.MapOps.view.mapValues`
srowen
-
(spark) branch master updated: [SPARK-45636][BUILD] Upgrade jersey to 2.41
srowen
-
(spark) branch master updated: [SPARK-45674][CONNECT][PYTHON] Improve error message for JVM-dependent attributes on Spark Connect
gurwls223
-
(spark) branch master updated (57e73dafeb9 -> e46c8ae84e8)
beliefer
-
(spark) branch branch-3.4 updated: [SPARK-45678][CORE] Cover BufferReleasingInputStream.available/reset under tryOrFetchFailedException
sunchao
-
(spark) branch branch-3.5 updated: [SPARK-45678][CORE] Cover BufferReleasingInputStream.available/reset under tryOrFetchFailedException
sunchao
-
(spark) branch master updated: [SPARK-45678][CORE] Cover BufferReleasingInputStream.available/reset under tryOrFetchFailedException
sunchao
-
(spark) branch master updated (3d6e31a13a4 -> aa232f21487)
ulyssesyou
-
(spark) branch master updated (f1d1dc1f87a -> 3d6e31a13a4)
wenchen
-
(spark) tag v3.5.0 created (now ce5ddad9903)
gurwls223
-
(spark) tag v3.5.0 deleted (was 270861a3cd6)
gurwls223
-
(spark-website) branch asf-site updated: [SPARK-45706][PYTHON][DOCS] Fix the links for Binder builds for Spark 3.5.0
srowen
-
(spark) tag v3.5.0 created (now 270861a3cd6)
gurwls223
-
(spark) tag v3.5.0 deleted (was de66d8f2ec7)
gurwls223
-
[PR] Fix the links for Binder builds for Spark 3.5.0 [spark-website]
via GitHub
-
(spark) tag v3.5.0 created (now de66d8f2ec7)
gurwls223
-
(spark) tag v3.5.0 deleted (was ce5ddad9903)
gurwls223
-
(spark) branch branch-3.5 updated: [SPARK-45706][PYTHON][DOCS] Makes entire Binder build fails fast during setting up
gurwls223
-
(spark) branch master updated: [SPARK-45706][PYTHON][DOCS] Makes entire Binder build fails fast during setting up
gurwls223
-
(spark) branch master updated: [SPARK-45328][DOCS][FOLLOWUP] Update docs for Hive metastore supported versions
maxgekk
-
(spark) branch master updated: [SPARK-45698][CORE][SQL][SS] Clean up the deprecated API usage related to `Buffer`
maxgekk
-
(spark) branch master updated: [SPARK-45651][BUILD][FOLLOWUP] Reduce mvn -Xmx option to 2g in publish_snapshot workflow
yangjie01
-
[spark] branch master updated: [SPARK-45614][SQL] Assign names to error _LEGACY_ERROR_TEMP_215[6,7,8]
maxgekk
-
[spark] branch master updated (7d94c5769a8 -> e1dc571051d)
gurwls223
-
[spark] branch branch-3.5 updated: [SPARK-43380][SQL] Fix slowdown in Avro read
wenchen
-
[spark] branch master updated: [SPARK-43380][SQL] Fix slowdown in Avro read
wenchen
-
[spark] branch branch-3.5 updated: [SPARK-45670][CORE][3.5] SparkSubmit does not support `--total-executor-cores` when deploying on K8s
gurwls223
-
[spark] branch branch-3.4 updated: [SPARK-45670][CORE][3.4] SparkSubmit does not support `--total-executor-cores` when deploying on K8s
gurwls223
-
[spark] branch branch-3.3 updated: [SPARK-45670][CORE][3.3] SparkSubmit does not support `--total-executor-cores` when deploying on K8s
gurwls223
-
[spark] branch master updated: [SPARK-45667][CORE][SQL][CONNECT] Clean up the deprecated API usage related to `IterableOnceExtensionMethods`
yangjie01
-
[spark] branch master updated: [SPARK-45481][SQL] Introduce a mapper for parquet compression codecs
beliefer
-
[spark] branch master updated: [SPARK-45575][SQL] Support time travel options for df read API
yao
-
[spark] branch master updated: [SPARK-45679][CONNECT] Add proto for clusterBy
gurwls223
-
[spark] branch master updated (d948be6c963 -> df0262f2996)
gurwls223
-
[spark] branch master updated: [SPARK-45677] Better error logging for Observation API
kabhwan
-
[spark] branch master updated: [SPARK-45651][BUILD][FOLLOWUP] Reduce mvn -Xmx option to 2g in publish_snapshot workflow
gurwls223
-
[spark] branch branch-3.4 updated: [SPARK-45652][SQL][3.4] SPJ: Handle empty input partitions after dynamic filtering
dongjoon
-
[spark] branch branch-3.5 updated: [SPARK-45652][SQL][3.5] SPJ: Handle empty input partitions after dynamic filtering
dongjoon
-
[spark] branch master updated: [SPARK-45670][CORE] SparkSubmit does not support `--total-executor-cores` when deploying on K8s
dongjoon
-
[spark] branch master updated: [SPARK-45652][SQL] SPJ: Handle empty input partitions after dynamic filtering
sunchao
-
[spark] branch master updated: [SPARK-43923][CONNECT][FOLLOWUP] Correct the message abbreviation
yangjie01
-
[spark] branch master updated: [SPARK-45596][CONNECT] Use java.lang.ref.Cleaner instead of org.apache.spark.sql.connect.client.util.Cleaner
yangjie01
-
[spark] branch master updated: [SPARK-45659][SQL][SS] Add `since` field to Java API marked as `@Deprecated`
yangjie01
-
[spark] branch master updated: [SPARK-38723][SS][TESTS] Add test for streaming query resume race condition
kabhwan
-
[spark] branch master updated: [SPARK-45663][CORE][MLLIB] Replace `IterableOnceOps#aggregate` with `IterableOnceOps#foldLeft`
yangjie01
-
[spark] branch master updated: [SPARK-44407][BUILD][TESTS] Clean up the compilation warnings related to `it will become a keyword in Scala 3` and prohibit use these keywords as variable name
yangjie01
-
[spark] branch master updated: [SPARK-45665][INFRA] Uses different `ORACLE_DOCKER_IMAGE_NAME` in the scheduled builds in other branches
yangjie01
-
[spark] branch master updated (dcbe275543e -> 25c74d0d4e2)
gurwls223
-
[spark] branch master updated: [SPARK-45634][PS] Remove `DataFrame.get_dtype_counts` from Pandas API on Spark
gurwls223
-
[spark] branch master updated: [SPARK-45651][BUILD] Log memory usage of publish snapshot workflow
gurwls223
-
[spark] branch master updated: [SPARK-45136][CONNECT] Enhance ClosureCleaner with Ammonite support
hvanhovell
-
[spark] branch master updated: [SPARK-45661][SQL][PYTHON] Add toNullable in StructType, MapType and ArrayType
gurwls223
-
[spark-connect-go] branch dependabot/go_modules/google.golang.org/grpc-1.56.3 created (now bcf0c58)
github-bot
-
[spark] branch master updated: [SPARK-45660] Re-use Literal objects in ComputeCurrentTime rule
maxgekk
-
[spark] branch branch-3.4 updated: [SPARK-40154][PYTHON][DOCS] Correct storage level in Dataframe.cache docstring
srowen
-
[spark] branch branch-3.5 updated: [SPARK-40154][PYTHON][DOCS] Correct storage level in Dataframe.cache docstring
srowen
-
[spark] branch master updated (a073bf38c7d -> 94607dd001b)
srowen
-
[spark] branch master updated: [SPARK-45209][CORE][UI] Flame Graph Support For Executor Thread Dump Page
yangjie01
-
[spark] branch master updated: [SPARK-45656][SQL] Fix observation when named observations with the same name on different datasets
gurwls223
-
[spark] branch branch-3.5 updated: [SPARK-45588][SPARK-45640][SQL][TESTS][3.5] Fix flaky ProtobufCatalystDataConversionSuite
gurwls223
-
[spark] branch master updated: [SPARK-45545][CORE] Pass SSLOptions wherever we create a SparkTransportConf
mridulm80
-
[spark] branch branch-3.4 updated: [SPARK-45588][SPARK-45640][SQL][TESTS][3.4] Fix flaky ProtobufCatalystDataConversionSuite
kabhwan
-
[spark] branch master updated: [SPARK-45648][INFRA] Add `sql/api` and `common/utils` to `modules.py`
gurwls223
-
[spark] branch master updated: [SPARK-45651][BUILD] Publish snapshot manually
gurwls223
-
[spark] branch master updated (4eac0244c765 -> a6503b22169d)
gurwls223
-
[spark] branch master updated: [SPARK-45503][SS] Add Conf to Set RocksDB Compression
kabhwan
-
[spark] branch master updated: [SPARK-45523][PYTHON] Refactor the null-checking to have shortcuts
ueshin
-
[spark] branch master updated (840306d867e2 -> 7ef96ee5b888)
ueshin
-
[spark] branch master updated: [SPARK-45643][CORE][SQL] Replace `s.c.mutable.MapOps#transform` with `s.c.mutable.MapOps#mapValuesInPlace`
dongjoon
-
[spark] branch master updated: [SPARK-45452][SQL][FOLLOWUP] Do not fail too early if FileSystem does not implement getSchema
dongjoon
-
[spark] branch master updated: [SPARK-45646][SQL] Remove hardcoding time variables prior to Hive 2.0
yangjie01
-
[spark] branch master updated: [SPARK-45561][SQL] Add proper conversions for TINYINT in MySQLDialect
maxgekk
-
[spark] branch branch-3.5 updated: [SPARK-45561][SQL] Add proper conversions for TINYINT in MySQLDialect
maxgekk
-
[spark] branch master updated: [SPARK-44752][SQL] XML: Update Spark Docs
gurwls223
-
[spark] branch master updated: [SPARK-45641][UI] Display the application start time on AllJobsPage
dongjoon
-
[spark] branch master updated: [SPARK-45626][SQL] Convert _LEGACY_ERROR_TEMP_1055 to REQUIRES_SINGLE_PART_NAMESPACE
maxgekk
-
[spark] branch master updated (32e1e5841191 -> 1f396f5aaf92)
yangjie01
-
[spark] branch branch-3.3 updated: [SPARK-45430] Fix for FramelessOffsetWindowFunction when IGNORE NULLS and offset > rowCount
wenchen
-
[spark] branch branch-3.4 updated: [SPARK-45430] Fix for FramelessOffsetWindowFunction when IGNORE NULLS and offset > rowCount
wenchen
-
[spark] branch branch-3.5 updated: [SPARK-45430] Fix for FramelessOffsetWindowFunction when IGNORE NULLS and offset > rowCount
wenchen
-
[spark] branch master updated: [SPARK-45430] Fix for FramelessOffsetWindowFunction when IGNORE NULLS and offset > rowCount
wenchen
-
[spark] branch master updated: [SPARK-44032][BUILD] Remove `threeten-extra` exclusion in `enforceBytecodeVersion` rule
dongjoon
-
[spark] branch master updated: [SPARK-45632][SQL] Table cache should avoid unnecessary ColumnarToRow when enable AQE
ulyssesyou
-
[spark] branch master updated: [SPARK-45618][CORE] Remove BaseErrorHandler
dongjoon
-
[spark] branch master updated: [SPARK-45638][SQL][AVRO] Improve test coverage of decimal conversion
wenchen
-
[spark] branch master updated: [SPARK-45547][ML] Validate Vectors with built-in function
ruifengz
-
[spark] branch master updated: [SPARK-45619][CONNECT][PYTHON] Apply the observed metrics to Observation object
gurwls223
-
[spark] branch master updated: [SPARK-44735][SQL] Add warning msg when inserting columns with the same name by row that don't match up
holden
-
[spark] branch master updated (e2af8aba8b44 -> e40e74497eb1)
yangjie01
-
[spark] branch master updated: [SPARK-45627][BUILD] Fix `symbol literal is deprecated`
yangjie01
-
[spark] branch branch-3.5 updated: [SPARK-45631][SS][PYSPARK] Remove @abstractmethod from onQueryIdle in PySpark StreamingQueryListener
kabhwan
-
[spark] branch master updated: [SPARK-45631][SS][PYSPARK] Remove @abstractmethod from onQueryIdle in PySpark StreamingQueryListener
kabhwan
-
[spark] branch master updated: [SPARK-45633][PYTHON][SQL][TESTS] Make SQL test group depend on `analyze_udtf.py`
gurwls223
-
[spark] branch master updated: Revert "[SPARK-45620][PYTHON] Fix user-facing APIs related to Python UDTF to use camelCase"
yangjie01
-
[spark] branch upmaster deleted (was 6a8124b9c2d)
yangjie01
-
[spark] branch upmaster created (now 6a8124b9c2d)
yangjie01
-
[spark] branch master updated (dbf2f4943c1 -> 959382f7fbc)
gurwls223
-
[spark] branch master updated: [SPARK-45625][BUILD] Upgrade log4j to 2.21.0
yangjie01
-
[spark] branch branch-3.5 updated: [SPARK-45616][CORE] Avoid ParVector, which does not propagate ThreadLocals or SparkSession
wenchen
-
[spark] branch master updated: [SPARK-45616][CORE] Avoid ParVector, which does not propagate ThreadLocals or SparkSession
wenchen
-
[spark] branch master updated: [SPARK-45620][PYTHON] Fix user-facing APIs related to Python UDTF to use camelCase
gurwls223
-
[spark] branch master updated (7763c91950e -> 9f675c54a56)
gurwls223
-
[spark] branch master updated (48e207f4a21 -> 7763c91950e)
gurwls223
-
[spark] branch master updated (2709426f0f6 -> 48e207f4a21)
srowen
-
[spark] branch master updated: [SPARK-45541][CORE] Add SSLFactory
mridulm80
-
[spark] branch master updated: [SPARK-45574][SQL] Add :: syntax as a shorthand for casting
maxgekk
-
[spark] branch master updated: [SPARK-45604][SQL] Add LogicalType checking on INT64 -> DateTime conversion on Parquet Vectorized Reader
maxgekk
-
[spark] branch branch-3.4 updated: [SPARK-45604][SQL] Add LogicalType checking on INT64 -> DateTime conversion on Parquet Vectorized Reader
maxgekk
-
[spark] branch branch-3.5 updated: [SPARK-45604][SQL] Add LogicalType checking on INT64 -> DateTime conversion on Parquet Vectorized Reader
maxgekk
-
[spark] branch master updated: [SPARK-45484][SQL][FOLLOWUP][DOCS] Update the document of parquet compression codec
srowen
-
[spark] branch master updated: [MINOR] Fix typos
srowen
-
[spark] branch master updated: [SPARK-45523][PYTHON] Return useful error message if UDTF returns None for any non-nullable column
ueshin
-
Re: [PR] update the canonical link, due to a change in some addresses in the latest version of the document [spark-website]
via GitHub
-
[spark] branch master updated: [SPARK-30848][SQL] Remove productHash from TreeNode
yangjie01
-
[spark] branch master updated: [SPARK-45602][CORE][SQL][SS][YARN][K8S] Replace `s.c.MapOps.filterKeys` with `s.c.MapOps.view.filterKeys`
yangjie01
-
[spark] branch master updated: [SPARK-45595] Expose SQLSTATE in error message
wenchen
-
[spark] branch master updated: [SPARK-45609][CONNECT] Include SqlState in SparkThrowable proto message
gurwls223
-
[spark] branch master updated: [SPARK-45613][CORE] Expose DeterministicLevel as a DeveloperApi
gurwls223
-
[spark] branch branch-3.5 updated: [SPARK-45553][3.5][PS] Correct warning messages
gurwls223
-
[spark] branch master updated: [SPARK-44837][SQL] Change ALTER TABLE ALTER PARTITION column error message
maxgekk
-
[spark] branch master updated: [SPARK-45591][BUILD] Upgrade ASM to 9.6
yangjie01
-
[spark] branch master updated: [SPARK-45484][SQL] Fix the bug that uses incorrect parquet compression codec lz4raw
beliefer
-
[spark] branch master updated: [SPARK-45562][SQL][FOLLOWUP] Restore test case not require `rowTag` option
gurwls223
-
[spark] branch master updated: [SPARK-45603][INFRA] merge_spark_pr shall notify us about GITHUB_OAUTH_KEY expiry
ruifengz
-
[spark] branch branch-3.5 updated: [SPARK-45584][SQL] Fix subquery execution failure with TakeOrderedAndProjectExec
wenchen
-
[spark] branch master updated: [SPARK-45584][SQL] Fix subquery execution failure with TakeOrderedAndProjectExec
wenchen
-
[spark] branch master updated: [SPARK-45428][PYTHON][DOCS] Add Matomo analytics to pyspark docs pages
gurwls223
-
[spark] branch master updated: [SPARK-45611][PYTHON][DOCS] Typo fixed yyy to yyyy at date_format function
gurwls223
-
[spark] branch master updated: [SPARK-45569][SQL] Assign name to the error _LEGACY_ERROR_TEMP_2152
maxgekk
-
[spark] branch branch-3.5 updated: [SPARK-45543][SQL] `InferWindowGroupLimit` causes bug if the other window functions haven't the same window frame as the rank-like functions
beliefer
-
[spark] branch master updated: [SPARK-45543][SQL] `InferWindowGroupLimit` causes bug if the other window functions haven't the same window frame as the rank-like functions
beliefer
-
[spark] branch master updated: [SPARK-45392][SQL][FOLLOWUP] Restore the original exception from data source
yangjie01
-
[spark] branch master updated: [SPARK-45569][SQL] Assign name to the error _LEGACY_ERROR_TEMP_2153
maxgekk
-
[spark] branch master updated: [SPARK-45220][PYTHON][DOCS] Refine docstring of DataFrame.join
gurwls223
-
[spark] branch master updated: [SPARK-45589][PYTHON][DOCS] Supplementary exception class
gurwls223
-
[spark] branch master updated: [SPARK-45588][PROTOBUF][CONNECT][MINOR] Scaladoc improvement for StreamingForeachBatchHelper
kabhwan
-
[spark] branch master updated: [MINOR][CONNECT] Fix a typo in org.apache.spark.sql.connect.client.ArtifactManager
gurwls223
-
[spark] branch branch-3.5 updated: [SPARK-45553][PS] Deprecate `assertPandasOnSparkEqual`
gurwls223
-
[spark] branch master updated: [SPARK-45553][PS] Deprecate `assertPandasOnSparkEqual`
gurwls223
-
[spark] branch master updated (a3c17b2e229 -> e37dd3ab8e0)
gurwls223
-
[spark] branch master updated: [SPARK-45562][SQL][FOLLOW-UP] XML: Make 'rowTag' option check case insensitive
gurwls223
-
[spark] branch master updated: [SPARK-45507][SQL] Correctness fix for nested correlated scalar subqueries with COUNT aggregates
wenchen
-
[spark] branch master updated: [SPARK-45586][SQL] Reduce compiler latency for plans with large expression trees
wenchen
-
[spark] branch master updated: [SPARK-45585][TEST] Fix time format and redirection issues in SparkSubmit tests
yao
-
[spark] branch branch-3.5 updated: [SPARK-45585][TEST] Fix time format and redirection issues in SparkSubmit tests
yao
-
[spark] branch master updated: [SPARK-45582][SS] Ensure that store instance is not used after calling commit within output mode streaming aggregation
kabhwan
-
[spark] branch master updated: [SPARK-45581] Make SQLSTATE mandatory
gengliang
-
[spark] branch master updated: [SPARK-45549][CORE] Remove unused `numExistingExecutors` in `CoarseGrainedSchedulerBackend`
dongjoon
-
[spark] branch master updated: [SPARK-45370][PYTHON][TESTS] Fix python test when ansi mode enabled
gurwls223
-
[spark] branch master updated: [SPARK-45410][INFRA][FOLLOW-UP] Rename "Python - PyPy3.8 (master)" to "Build / Python-only (master, PyPy 3.8)"
dongjoon
-
[spark] branch master updated: [SPARK-45542][CORE] Replace `setSafeMode(HdfsConstants.SafeModeAction, boolean)` with `setSafeMode(SafeModeAction, boolean)`
dongjoon
-
[spark] branch master updated: [SPARK-44649][SQL] Runtime Filter supports passing equivalent creation side expressions
wenchen
-
[spark] branch master updated: [SPARK-45558][SS] Introduce a metadata file for streaming stateful operator
kabhwan
-
[spark] branch master updated (b1e57a2b359 -> d7d38fbc184)
dongjoon
-
[spark] branch master updated: [SPARK-45534][CORE] Use java.lang.ref.Cleaner instead of finalize for RemoteBlockPushResolver
mridulm80
-
[spark] branch master updated: [SPARK-45035][SQL] Fix ignoreCorruptFiles/ignoreMissingFiles with multiline CSV/JSON will report error
maxgekk
-
[spark] branch master updated: [SPARK-45576][CORE][FOLLOWUP] Remove unused imports to fix Java linter errors
dongjoon
-
[spark] branch master updated: [SPARK-45500][CORE][WEBUI][FOLLOWUP] Show `RELAUNCHING` drivers too
dongjoon
-
[spark] branch master updated (4901548d4c3 -> f4bd99da12f)
wenchen
-
[spark] branch master updated: [SPARK-45576][CORE] Remove unnecessary debug logs in ReloadingX509TrustManagerSuite
mridulm80
-
[spark] branch master updated: [SPARK-45546][BUILD][FOLLOW-UP] Remove snapshot repo mistakenly added
dongjoon
-
[spark] branch master updated: [MINOR][INFRA] Skip if JIRA ID is an empty string
dongjoon
-
[spark] branch master updated (3ef18e2d00f -> 0cb4a84f6ab)
gurwls223
-
[spark] branch branch-3.5 updated: [MINOR][DOCS] Update the docs for spark.sql.optimizer.canChangeCachedPlanOutputPartitioning configuration
gurwls223
-
[spark] branch master updated: [SPARK-45546][BUILD][INFRA] Make `publish-snapshot` support `package` first then `deploy`
yangjie01
-
[spark] branch master updated: [SPARK-45578][CORE] Remove `InaccessibleObjectException` usage by using `trySetAccessible`
dongjoon
-
[spark] branch branch-3.3 updated: [MINOR][SQL] Remove signature from Hive thriftserver exception
dongjoon