[
https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380846#comment-15380846
]
Shea Parkes commented on SPARK-12261:
-
I believe I'm hitting the same bug. I'm also
[
https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15391728#comment-15391728
]
Shea Parkes commented on SPARK-12261:
-
Alright, I've been spending time off and on fo
[
https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15391731#comment-15391731
]
Shea Parkes commented on SPARK-12261:
-
Also, I added extensive logging to {{worker.py
[
https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394508#comment-15394508
]
Shea Parkes commented on SPARK-12261:
-
I still can't get this bug to reproduce reliab
[
https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15629182#comment-15629182
]
Shea Parkes commented on SPARK-12261:
-
I'm still maintaining the two-line bandaid to
[
https://issues.apache.org/jira/browse/SPARK-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15665137#comment-15665137
]
Shea Parkes commented on SPARK-2141:
This would have been nice to have today. We want
Shea Parkes created SPARK-18541:
---
Summary: Add pyspark.sql.Column.aliasWithMetadata to allow dynamic
metadata management in pyspark SQL API
Key: SPARK-18541
URL: https://issues.apache.org/jira/browse/SPARK-18541
[
https://issues.apache.org/jira/browse/SPARK-18541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15866393#comment-15866393
]
Shea Parkes commented on SPARK-18541:
-
Thank you very much!
> Add pyspark.sql.Column
Shea Parkes created SPARK-17998:
---
Summary: Reading Parquet files coalesces parts into too few
in-memory partitions
Key: SPARK-17998
URL: https://issues.apache.org/jira/browse/SPARK-17998
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shea Parkes closed SPARK-17998.
---
Resolution: Information Provided
> Reading Parquet files coalesces parts into too few in-memory parti
[
https://issues.apache.org/jira/browse/SPARK-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15590680#comment-15590680
]
Shea Parkes commented on SPARK-17998:
-
That definitely answers it. I would say the d
Shea Parkes created SPARK-13842:
---
Summary: Consider __iter__ and __getitem__ methods for
pyspark.sql.types.StructType
Key: SPARK-13842
URL: https://issues.apache.org/jira/browse/SPARK-13842
Project: Spa
[
https://issues.apache.org/jira/browse/SPARK-13842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15231201#comment-15231201
]
Shea Parkes commented on SPARK-13842:
-
I'm willing to give it a first pass. Need to
[
https://issues.apache.org/jira/browse/SPARK-13842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15231491#comment-15231491
]
Shea Parkes commented on SPARK-13842:
-
Pull request is available (https://github.com/
[
https://issues.apache.org/jira/browse/SPARK-17218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shea Parkes updated SPARK-17218:
Environment:
Microsoft Windows 10
Python v3.5.x
Standalone Spark Cluster
was:
Microsoft Windows
Shea Parkes created SPARK-17218:
---
Summary: Caching a DataFrame with >200 columns ~nulls the contents
Key: SPARK-17218
URL: https://issues.apache.org/jira/browse/SPARK-17218
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-17218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shea Parkes updated SPARK-17218:
Description:
Caching a DataFrame with >200 columns causes the contents to be ~nulled. This
is qui
Shea Parkes created SPARK-10847:
---
Summary: Pyspark - DataFrame - Optional Metadata with `None`
triggers cryptic failure
Key: SPARK-10847
URL: https://issues.apache.org/jira/browse/SPARK-10847
Project: S
[
https://issues.apache.org/jira/browse/SPARK-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933924#comment-14933924
]
Shea Parkes commented on SPARK-10847:
-
This issue caused me to learn enough about Sca
[
https://issues.apache.org/jira/browse/SPARK-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941952#comment-14941952
]
Shea Parkes commented on SPARK-10847:
-
I appreciate your assistance! I think your pr
[
https://issues.apache.org/jira/browse/SPARK-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941953#comment-14941953
]
Shea Parkes commented on SPARK-10847:
-
My apologies, I just read your patch and see y
[
https://issues.apache.org/jira/browse/SPARK-18541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703755#comment-15703755
]
Shea Parkes commented on SPARK-18541:
-
Yea, I originally did {{aliasWithMetadata}} be
Shea Parkes created SPARK-19116:
---
Summary: LogicalPlan.statistics.sizeInBytes wrong for trivial
parquet file
Key: SPARK-19116
URL: https://issues.apache.org/jira/browse/SPARK-19116
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15928179#comment-15928179
]
Shea Parkes commented on SPARK-12261:
-
I simply added the following to the end:
for
[
https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15928179#comment-15928179
]
Shea Parkes edited comment on SPARK-12261 at 3/16/17 2:38 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-12261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15928179#comment-15928179
]
Shea Parkes edited comment on SPARK-12261 at 3/16/17 2:38 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-19116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16115176#comment-16115176
]
Shea Parkes commented on SPARK-19116:
-
Apologies for not responding earlier. I'm str
Shea Parkes created SPARK-20683:
---
Summary: Make table uncache chaining optional
Key: SPARK-20683
URL: https://issues.apache.org/jira/browse/SPARK-20683
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-20683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003864#comment-16003864
]
Shea Parkes commented on SPARK-20683:
-
For anyone that found this issue and just want
29 matches
Mail list logo