[jira] [Commented] (SPARK-42760) The partition of result data frame of join is always 1

[ https://issues.apache.org/jira/browse/SPARK-42760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707125#comment-17707125 ] Ranga Reddy commented on SPARK-42760: - >From Spark version 3.2.0 onwards AQE is enabled by default.

[jira] [Commented] (SPARK-32893) Structured Streaming and Dynamic Allocation on StandaloneCluster

[ https://issues.apache.org/jira/browse/SPARK-32893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703182#comment-17703182 ] Ranga Reddy commented on SPARK-32893: - Similar kind of issue is created for

[jira] [Commented] (SPARK-32893) Structured Streaming and Dynamic Allocation on StandaloneCluster

[ https://issues.apache.org/jira/browse/SPARK-32893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703177#comment-17703177 ] Ranga Reddy commented on SPARK-32893: - I can see similar behaviour Spark Structured Streaming with

[jira] [Commented] (SPARK-28869) Roll over event log files

[ https://issues.apache.org/jira/browse/SPARK-28869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17643804#comment-17643804 ] Ranga Reddy commented on SPARK-28869: - Hi [~kabhwan]  I have enabled the eventlog rolling for the

[jira] [Updated] (SPARK-28869) Roll over event log files

[ https://issues.apache.org/jira/browse/SPARK-28869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ranga Reddy updated SPARK-28869: Attachment: application_1670216197043_0012.log > Roll over event log files >

[jira] [Commented] (SPARK-40958) Support data masking built-in function 'null'

[ https://issues.apache.org/jira/browse/SPARK-40958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634142#comment-17634142 ] Ranga Reddy commented on SPARK-40958: - I will work on this Jira. > Support data masking built-in

[jira] [Commented] (SPARK-40686) Support data masking and redacting built-in functions

[ https://issues.apache.org/jira/browse/SPARK-40686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17633668#comment-17633668 ] Ranga Reddy commented on SPARK-40686: - Hi [~dtenedor]  I am not able to find more

[jira] [Updated] (SPARK-40988) Test case for insert partition should verify value

[ https://issues.apache.org/jira/browse/SPARK-40988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ranga Reddy updated SPARK-40988: Priority: Minor (was: Major) > Test case for insert partition should verify value >

[jira] [Updated] (SPARK-40988) Test case for insert partition should verify value

[ https://issues.apache.org/jira/browse/SPARK-40988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ranga Reddy updated SPARK-40988: Summary: Test case for insert partition should verify value (was: Spark3 partition column value

[jira] [Commented] (SPARK-40798) Alter partition should verify value

[ https://issues.apache.org/jira/browse/SPARK-40798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17633488#comment-17633488 ] Ranga Reddy commented on SPARK-40798: - Hi [~ulysses]  I will go ahead and add a test case for the

[jira] [Comment Edited] (SPARK-40798) Alter partition should verify value

[ https://issues.apache.org/jira/browse/SPARK-40798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17633209#comment-17633209 ] Ranga Reddy edited comment on SPARK-40798 at 11/14/22 3:11 AM: --- Hi

[jira] [Commented] (SPARK-40798) Alter partition should verify value

[ https://issues.apache.org/jira/browse/SPARK-40798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17633471#comment-17633471 ] Ranga Reddy commented on SPARK-40798: - Hi [~ulysses]  *SPARK-40988* is created for validating the

[jira] [Comment Edited] (SPARK-40798) Alter partition should verify value

[ https://issues.apache.org/jira/browse/SPARK-40798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17633209#comment-17633209 ] Ranga Reddy edited comment on SPARK-40798 at 11/13/22 3:59 AM: --- Hi

[jira] [Commented] (SPARK-40798) Alter partition should verify value

[ https://issues.apache.org/jira/browse/SPARK-40798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17633209#comment-17633209 ] Ranga Reddy commented on SPARK-40798: - Hi [~ulysses]  The current Jira will solve both the *Insert*

[jira] [Commented] (SPARK-40798) Alter partition should verify value

[ https://issues.apache.org/jira/browse/SPARK-40798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632106#comment-17632106 ] Ranga Reddy commented on SPARK-40798: - The below issue is addressed in the current Jira. Can I add a

[jira] [Commented] (SPARK-40988) Spark3 partition column value is not validated with user provided schema.

[ https://issues.apache.org/jira/browse/SPARK-40988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632102#comment-17632102 ] Ranga Reddy commented on SPARK-40988: - The following Jira will resolve the issue by throwing the

[jira] [Commented] (SPARK-40988) Spark3 partition column value is not validated with user provided schema.

[ https://issues.apache.org/jira/browse/SPARK-40988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17632073#comment-17632073 ] Ranga Reddy commented on SPARK-40988: - In Spark 3.4, if we run the following code we can see the

[jira] [Commented] (SPARK-32380) sparksql cannot access hive table while data in hbase

[ https://issues.apache.org/jira/browse/SPARK-32380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17627704#comment-17627704 ] Ranga Reddy commented on SPARK-32380: - The below pull request will solve the issue but needs to

[jira] [Commented] (SPARK-40988) Spark3 partition column value is not validated with user provided schema.

[ https://issues.apache.org/jira/browse/SPARK-40988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17627197#comment-17627197 ] Ranga Reddy commented on SPARK-40988: - I will work on this issue. > Spark3 partition column value

[jira] [Created] (SPARK-40988) Spark3 partition column value is not validated with user provided schema.

Ranga Reddy created SPARK-40988: --- Summary: Spark3 partition column value is not validated with user provided schema. Key: SPARK-40988 URL: https://issues.apache.org/jira/browse/SPARK-40988 Project:

[jira] [Updated] (SPARK-36901) ERROR exchange.BroadcastExchangeExec: Could not execute broadcast in 300 secs

[ https://issues.apache.org/jira/browse/SPARK-36901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ranga Reddy updated SPARK-36901: Description: While running Spark application, if there are no further resources to launch

[jira] [Updated] (SPARK-36901) ERROR exchange.BroadcastExchangeExec: Could not execute broadcast in 300 secs

[ https://issues.apache.org/jira/browse/SPARK-36901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ranga Reddy updated SPARK-36901: Description: While running Spark application, if there are no further resources to launch

[jira] [Created] (SPARK-36901) ERROR exchange.BroadcastExchangeExec: Could not execute broadcast in 300 secs

Ranga Reddy created SPARK-36901: --- Summary: ERROR exchange.BroadcastExchangeExec: Could not execute broadcast in 300 secs Key: SPARK-36901 URL: https://issues.apache.org/jira/browse/SPARK-36901 Project:

[jira] [Commented] (SPARK-26208) Empty dataframe does not roundtrip for csv with header

[ https://issues.apache.org/jira/browse/SPARK-26208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17409427#comment-17409427 ] Ranga Reddy commented on SPARK-26208: - cc [~hyukjin.kwon] > Empty dataframe does not roundtrip for

[jira] [Comment Edited] (SPARK-26208) Empty dataframe does not roundtrip for csv with header

[ https://issues.apache.org/jira/browse/SPARK-26208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396076#comment-17396076 ] Ranga Reddy edited comment on SPARK-26208 at 8/10/21, 9:03 AM: --- Hi

[jira] [Commented] (SPARK-26208) Empty dataframe does not roundtrip for csv with header

[ https://issues.apache.org/jira/browse/SPARK-26208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396076#comment-17396076 ] Ranga Reddy commented on SPARK-26208: - The above code will work only when dataframe created

[jira] [Comment Edited] (SPARK-12139) REGEX Column Specification for Hive Queries

[ https://issues.apache.org/jira/browse/SPARK-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346581#comment-17346581 ] Ranga Reddy edited comment on SPARK-12139 at 5/18/21, 6:07 AM: --- Hi

[jira] [Commented] (SPARK-12139) REGEX Column Specification for Hive Queries

[ https://issues.apache.org/jira/browse/SPARK-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346581#comment-17346581 ] Ranga Reddy commented on SPARK-12139: - Hi [~janewangfb] While creating alias for column it is not