[jira] [Commented] (SPARK-47290) Extend CustomTaskMetric to allow metric values from multiple sources

2024-03-19 Thread Parth Chandra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828481#comment-17828481 ] Parth Chandra commented on SPARK-47290: --- [~dongjoon] can we close this issue? As discussed in the

[jira] [Created] (SPARK-47291) Add Parquet file reader metrics to scan

2024-03-05 Thread Parth Chandra (Jira)
Parth Chandra created SPARK-47291: - Summary: Add Parquet file reader metrics to scan Key: SPARK-47291 URL: https://issues.apache.org/jira/browse/SPARK-47291 Project: Spark Issue Type:

[jira] [Created] (SPARK-47290) Extend CustomTaskMetric to allow metric values from multiple sources

2024-03-05 Thread Parth Chandra (Jira)
Parth Chandra created SPARK-47290: - Summary: Extend CustomTaskMetric to allow metric values from multiple sources Key: SPARK-47290 URL: https://issues.apache.org/jira/browse/SPARK-47290 Project:

[jira] [Created] (SPARK-47289) Allow extensions to log extended information in explain plan

2024-03-05 Thread Parth Chandra (Jira)
Parth Chandra created SPARK-47289: - Summary: Allow extensions to log extended information in explain plan Key: SPARK-47289 URL: https://issues.apache.org/jira/browse/SPARK-47289 Project: Spark

[jira] [Created] (SPARK-47106) Plan canonicalization test serializes/deserializes class that is not serializable

2024-02-20 Thread Parth Chandra (Jira)
Parth Chandra created SPARK-47106: - Summary: Plan canonicalization test serializes/deserializes class that is not serializable Key: SPARK-47106 URL: https://issues.apache.org/jira/browse/SPARK-47106

[jira] [Updated] (SPARK-46094) Add support for code profiling executors

2023-11-24 Thread Parth Chandra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Chandra updated SPARK-46094: -- Component/s: Connect Contrib (was: Spark Core) > Add support for code

[jira] [Updated] (SPARK-46094) Add support for code profiling executors

2023-11-24 Thread Parth Chandra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Chandra updated SPARK-46094: -- Component/s: Connect (was: Connect Contrib) > Add support for code

[jira] [Created] (SPARK-46094) Add support for code profiling executors

2023-11-24 Thread Parth Chandra (Jira)
Parth Chandra created SPARK-46094: - Summary: Add support for code profiling executors Key: SPARK-46094 URL: https://issues.apache.org/jira/browse/SPARK-46094 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

2022-08-17 Thread Parth Chandra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580929#comment-17580929 ] Parth Chandra commented on SPARK-38954: --- Sorry about the delay, should have updated the JIRA. I

[jira] [Commented] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

2022-05-23 Thread Parth Chandra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17541070#comment-17541070 ] Parth Chandra commented on SPARK-38954: --- The flow would be like this (using AWS as an example) - 

[jira] [Created] (SPARK-38954) Implement sharing of cloud credentials among driver and executors

2022-04-19 Thread Parth Chandra (Jira)
Parth Chandra created SPARK-38954: - Summary: Implement sharing of cloud credentials among driver and executors Key: SPARK-38954 URL: https://issues.apache.org/jira/browse/SPARK-38954 Project: Spark

[jira] [Created] (SPARK-38254) Improve vectorized loop for Packed encodings

2022-02-18 Thread Parth Chandra (Jira)
Parth Chandra created SPARK-38254: - Summary: Improve vectorized loop for Packed encodings Key: SPARK-38254 URL: https://issues.apache.org/jira/browse/SPARK-38254 Project: Spark Issue Type:

[jira] [Closed] (SPARK-37912) Add benchmark for delta binary encoding

2022-02-10 Thread Parth Chandra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Chandra closed SPARK-37912. - > Add benchmark for delta binary encoding > --- > >

[jira] [Resolved] (SPARK-37912) Add benchmark for delta binary encoding

2022-02-10 Thread Parth Chandra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Chandra resolved SPARK-37912. --- Resolution: Fixed resolved by  SPARK-37928 > Add benchmark for delta binary encoding >

[jira] [Created] (SPARK-38169) Use OffHeap memory if configured in vectorized DeltaByteArray reader

2022-02-09 Thread Parth Chandra (Jira)
Parth Chandra created SPARK-38169: - Summary: Use OffHeap memory if configured in vectorized DeltaByteArray reader Key: SPARK-38169 URL: https://issues.apache.org/jira/browse/SPARK-38169 Project:

[jira] [Created] (SPARK-37975) Implement vectorized BYTE_STREAM_SPLIT encoding for Parquet V2 support

2022-01-20 Thread Parth Chandra (Jira)
Parth Chandra created SPARK-37975: - Summary: Implement vectorized BYTE_STREAM_SPLIT encoding for Parquet V2 support Key: SPARK-37975 URL: https://issues.apache.org/jira/browse/SPARK-37975 Project:

[jira] [Updated] (SPARK-37974) Implement vectorized DELTA_BYTE_ARRAY and DELTA_LENGTH_BYTE_ARRAY encodings for Parquet V2 support

2022-01-20 Thread Parth Chandra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Chandra updated SPARK-37974: -- External issue ID: (was: SPARK-36879) > Implement vectorized DELTA_BYTE_ARRAY and

[jira] [Created] (SPARK-37974) Implement vectorized DELTA_BYTE_ARRAY and DELTA_LENGTH_BYTE_ARRAY encodings for Parquet V2 support

2022-01-20 Thread Parth Chandra (Jira)
Parth Chandra created SPARK-37974: - Summary: Implement vectorized DELTA_BYTE_ARRAY and DELTA_LENGTH_BYTE_ARRAY encodings for Parquet V2 support Key: SPARK-37974 URL:

[jira] [Commented] (SPARK-37912) Add benchmark for delta binary encoding

2022-01-18 Thread Parth Chandra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17478152#comment-17478152 ] Parth Chandra commented on SPARK-37912: --- Superseded by SPARK-37928 > Add benchmark for delta

[jira] [Created] (SPARK-37912) Add benchmark for delta binary encoding

2022-01-14 Thread Parth Chandra (Jira)
Parth Chandra created SPARK-37912: - Summary: Add benchmark for delta binary encoding Key: SPARK-37912 URL: https://issues.apache.org/jira/browse/SPARK-37912 Project: Spark Issue Type:

[jira] [Commented] (SPARK-27100) dag-scheduler-event-loop" java.lang.StackOverflowError

2019-06-13 Thread Parth Chandra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863381#comment-16863381 ] Parth Chandra commented on SPARK-27100: --- Opened a PR with a fix and a test to reproduce the issue. 

[jira] [Updated] (SPARK-27100) dag-scheduler-event-loop" java.lang.StackOverflowError

2019-06-13 Thread Parth Chandra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Chandra updated SPARK-27100: -- Attachment: SPARK-27100-Overflow.txt > dag-scheduler-event-loop" java.lang.StackOverflowError

[jira] [Commented] (SPARK-27100) dag-scheduler-event-loop" java.lang.StackOverflowError

2019-06-13 Thread Parth Chandra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863375#comment-16863375 ] Parth Chandra commented on SPARK-27100: --- The stack overflow is due to serialization of a