[jira] [Updated] (SPARK-46359) add optional batch id _spark_metadata sink file status

[ https://issues.apache.org/jira/browse/SPARK-46359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gagan taneja updated SPARK-46359: - Summary: add optional batch id _spark_metadata sink file status (was: add optional batch id

[jira] [Created] (SPARK-46359) add optional batch id to sink file status

gagan taneja created SPARK-46359: Summary: add optional batch id to sink file status Key: SPARK-46359 URL: https://issues.apache.org/jira/browse/SPARK-46359 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24437) Memory leak in UnsafeHashedRelation

[ https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499733#comment-16499733 ] gagan taneja commented on SPARK-24437: -- I have already set the values  of

[jira] [Commented] (SPARK-24437) Memory leak in UnsafeHashedRelation

[ https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496866#comment-16496866 ] gagan taneja commented on SPARK-24437: -- No Dynamic allocation. Also this is an issue with Driver

[jira] [Updated] (SPARK-24437) Memory leak in UnsafeHashedRelation

[ https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gagan taneja updated SPARK-24437: - Attachment: Screen Shot 2018-05-30 at 2.07.22 PM.png > Memory leak in UnsafeHashedRelation >

[jira] [Updated] (SPARK-24437) Memory leak in UnsafeHashedRelation

[ https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gagan taneja updated SPARK-24437: - Attachment: Screen Shot 2018-05-30 at 2.05.40 PM.png > Memory leak in UnsafeHashedRelation >

[jira] [Created] (SPARK-24437) Memory leak in UnsafeHashedRelation

gagan taneja created SPARK-24437: Summary: Memory leak in UnsafeHashedRelation Key: SPARK-24437 URL: https://issues.apache.org/jira/browse/SPARK-24437 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-21760) Structured streaming terminates with Exception

gagan taneja created SPARK-21760: Summary: Structured streaming terminates with Exception Key: SPARK-21760 URL: https://issues.apache.org/jira/browse/SPARK-21760 Project: Spark Issue Type:

[jira] [Commented] (SPARK-19705) Preferred location supporting HDFS Cache for FileScanRDD

[ https://issues.apache.org/jira/browse/SPARK-19705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15940897#comment-15940897 ] gagan taneja commented on SPARK-19705: -- Sandy Would you be able to help with this bug. I saw you

[jira] [Commented] (SPARK-19145) Timestamp to String casting is slowing the query significantly

[ https://issues.apache.org/jira/browse/SPARK-19145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896061#comment-15896061 ] gagan taneja commented on SPARK-19145: -- I am suggesting following changes introduce the function to

[jira] [Commented] (SPARK-19145) Timestamp to String casting is slowing the query significantly

[ https://issues.apache.org/jira/browse/SPARK-19145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896046#comment-15896046 ] gagan taneja commented on SPARK-19145: -- 17/03/04 19:05:32 TRACE HiveSessionState$$anon$1: ===

[jira] [Commented] (SPARK-19145) Timestamp to String casting is slowing the query significantly

[ https://issues.apache.org/jira/browse/SPARK-19145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896040#comment-15896040 ] gagan taneja commented on SPARK-19145: -- Code responsible for this belongs to class amd the code

[jira] [Commented] (SPARK-19541) High Availability support for ThriftServer

[ https://issues.apache.org/jira/browse/SPARK-19541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896032#comment-15896032 ] gagan taneja commented on SPARK-19541: -- This would a great improvement as we are also leveraging

[jira] [Updated] (SPARK-19705) Preferred location supporting HDFS Cache for FileScanRDD

[ https://issues.apache.org/jira/browse/SPARK-19705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gagan taneja updated SPARK-19705: - Shepherd: Herman van Hovell > Preferred location supporting HDFS Cache for FileScanRDD >

[jira] [Commented] (SPARK-19705) Preferred location supporting HDFS Cache for FileScanRDD

[ https://issues.apache.org/jira/browse/SPARK-19705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896026#comment-15896026 ] gagan taneja commented on SPARK-19705: -- Herman, Can you help me with this enhancement thanks >

[jira] [Created] (SPARK-19705) Preferred location supporting HDFS Cache for FileScanRDD

gagan taneja created SPARK-19705: Summary: Preferred location supporting HDFS Cache for FileScanRDD Key: SPARK-19705 URL: https://issues.apache.org/jira/browse/SPARK-19705 Project: Spark

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15872811#comment-15872811 ] gagan taneja commented on SPARK-13219: -- This is what we are looking for For example Table Address

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15872809#comment-15872809 ] gagan taneja commented on SPARK-13219: -- Venu This is very interesting i would like to look at the

[jira] [Commented] (SPARK-19609) Broadcast joins should pushdown join constraints as Filter to the larger relation

[ https://issues.apache.org/jira/browse/SPARK-19609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15872797#comment-15872797 ] gagan taneja commented on SPARK-19609: -- This can be further extended to join on the column that are

[jira] [Commented] (SPARK-19145) Timestamp to String casting is slowing the query significantly

[ https://issues.apache.org/jira/browse/SPARK-19145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15814165#comment-15814165 ] gagan taneja commented on SPARK-19145: -- i should be able to work on a proposal for the fix >

[jira] [Created] (SPARK-19145) Timestamp to String casting is slowing the query significantly

gagan taneja created SPARK-19145: Summary: Timestamp to String casting is slowing the query significantly Key: SPARK-19145 URL: https://issues.apache.org/jira/browse/SPARK-19145 Project: Spark

[jira] [Commented] (SPARK-19118) Percentile support for frequency distribution table

[ https://issues.apache.org/jira/browse/SPARK-19118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15808173#comment-15808173 ] gagan taneja commented on SPARK-19118: -- I had filed original JIRA to provide the functionality for

[jira] [Created] (SPARK-19119) Approximate percentile support for frequency distribution table

gagan taneja created SPARK-19119: Summary: Approximate percentile support for frequency distribution table Key: SPARK-19119 URL: https://issues.apache.org/jira/browse/SPARK-19119 Project: Spark

[jira] [Created] (SPARK-19118) Percentile support for frequency distribution table

gagan taneja created SPARK-19118: Summary: Percentile support for frequency distribution table Key: SPARK-19118 URL: https://issues.apache.org/jira/browse/SPARK-19118 Project: Spark Issue

[jira] [Commented] (SPARK-18940) Percentile and approximate percentile support for frequency distribution table

[ https://issues.apache.org/jira/browse/SPARK-18940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15764702#comment-15764702 ] gagan taneja commented on SPARK-18940: -- i am working on the fix. Should be able to make the changes

[jira] [Updated] (SPARK-18940) Percentile and approximate percentile support for frequency distribution table

[ https://issues.apache.org/jira/browse/SPARK-18940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gagan taneja updated SPARK-18940: - Shepherd: Herman van Hovell > Percentile and approximate percentile support for frequency

[jira] [Created] (SPARK-18940) Percentile and approximate percentile support for frequency distribution table

gagan taneja created SPARK-18940: Summary: Percentile and approximate percentile support for frequency distribution table Key: SPARK-18940 URL: https://issues.apache.org/jira/browse/SPARK-18940

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15414544#comment-15414544 ] gagan taneja commented on SPARK-15345: -- i was annoyed by this bug but fortunately found the

[jira] [Created] (SPARK-5292) optimize join for table that are already sharded/support for hive bucket

gagan taneja created SPARK-5292: --- Summary: optimize join for table that are already sharded/support for hive bucket Key: SPARK-5292 URL: https://issues.apache.org/jira/browse/SPARK-5292 Project: Spark