Re: [PR] [SPARK-47596][DSTREAMS] Streaming: Migrate logWarn with variables to structured logging framework [spark]

2024-04-21 Thread via GitHub
smileyboy2019 commented on PR #46079: URL: https://github.com/apache/spark/pull/46079#issuecomment-2068510767 Structured Streaming supports writing Spark SQL and using SQL to write stream processing logic. Is this possible, similar to the syntax of Flink. SQL can satisfy the flow

Re: [PR] [SPARK-47596][DSTREAMS] Streaming: Migrate logWarn with variables to structured logging framework [spark]

2024-04-18 Thread via GitHub
gengliangwang closed pull request #46079: [SPARK-47596][DSTREAMS] Streaming: Migrate logWarn with variables to structured logging framework URL: https://github.com/apache/spark/pull/46079 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [SPARK-47596][DSTREAMS] Streaming: Migrate logWarn with variables to structured logging framework [spark]

2024-04-18 Thread via GitHub
gengliangwang commented on PR #46079: URL: https://github.com/apache/spark/pull/46079#issuecomment-2065758227 @panbingkun Thanks again for the works! Merging to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] [SPARK-47596][DSTREAMS] Streaming: Migrate logWarn with variables to structured logging framework [spark]

2024-04-18 Thread via GitHub
gengliangwang commented on code in PR #46079: URL: https://github.com/apache/spark/pull/46079#discussion_r1571792309 ## streaming/src/main/scala/org/apache/spark/streaming/scheduler/ReceivedBlockTracker.scala: ## @@ -247,7 +247,8 @@ private[streaming] class

Re: [PR] [SPARK-47596][DSTREAMS] Streaming: Migrate logWarn with variables to structured logging framework [spark]

2024-04-18 Thread via GitHub
panbingkun commented on PR #46079: URL: https://github.com/apache/spark/pull/46079#issuecomment-2063629099 cc @gengliangwang -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[PR] [SPARK-47596][DSTREAMS] Streaming: Migrate logWarn with variables to structured logging framework [spark]

2024-04-16 Thread via GitHub
panbingkun opened a new pull request, #46079: URL: https://github.com/apache/spark/pull/46079 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? No. ### How was this