[
https://issues.apache.org/jira/browse/SPARK-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316940#comment-14316940
]
Don Drake commented on SPARK-5722:
--
Hi, I've submitted 2 pull requests for branch-1.2 and
[
https://issues.apache.org/jira/browse/SPARK-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Don Drake updated SPARK-5722:
-
Description:
The Integers datatype in Python does not match what a Scala/Java integer is
defined as.
[
https://issues.apache.org/jira/browse/SPARK-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Don Drake updated SPARK-5722:
-
Summary: Infer_schema_type incorrect for Integers in pyspark (was:
Infer_schma_type incorrect for
Don Drake created SPARK-5722:
Summary: Infer_schma_type incorrect for Integers in pyspark
Key: SPARK-5722
URL: https://issues.apache.org/jira/browse/SPARK-5722
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-7182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Don Drake updated SPARK-7182:
-
Summary: [SQL] Can't remove columns from DataFrame or save DataFrame from a
join due to duplicate columns
[
https://issues.apache.org/jira/browse/SPARK-7182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Don Drake updated SPARK-7182:
-
Description:
I'm having trouble saving a dataframe as parquet after performing a simple
table join.
Don Drake created SPARK-7182:
Summary: [SQL] Can't remove or save DataFrame from a join due to
duplicate columns
Key: SPARK-7182
URL: https://issues.apache.org/jira/browse/SPARK-7182
Project: Spark
Don Drake created SPARK-7781:
Summary: GradientBoostedTrees.trainRegressor is missing maxBins
parameter in pyspark
Key: SPARK-7781
URL: https://issues.apache.org/jira/browse/SPARK-7781
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14596001#comment-14596001
]
Don Drake commented on SPARK-8368:
--
I've verified through a nightly build that this
Don Drake created SPARK-8365:
Summary: pyspark does not retain --packages or --jars passed on
the command line as of 1.4.0
Key: SPARK-8365
URL: https://issues.apache.org/jira/browse/SPARK-8365
Project:
[
https://issues.apache.org/jira/browse/SPARK-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590290#comment-14590290
]
Don Drake commented on SPARK-8365:
--
Is there a workaround that you are aware of?
[
https://issues.apache.org/jira/browse/SPARK-11085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14954989#comment-14954989
]
Don Drake commented on SPARK-11085:
---
Neither of the options work.
> Add support for HTTP proxy
>
[
https://issues.apache.org/jira/browse/SPARK-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735690#comment-14735690
]
Don Drake commented on SPARK-10441:
---
I see that PR 8597 was merged into master. Does master represent
[
https://issues.apache.org/jira/browse/SPARK-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736986#comment-14736986
]
Don Drake commented on SPARK-10441:
---
Got it, thanks for the clarification.
> Cannot write timestamp to
[
https://issues.apache.org/jira/browse/SPARK-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15295512#comment-15295512
]
Don Drake commented on SPARK-15467:
---
Vishnu, the 22 field limitation is with Scala 2.10.x, Spark 2.0
Don Drake created SPARK-15467:
-
Summary: Getting stack overflow when attempting to query a wide
Dataset (>200 fields)
Key: SPARK-15467
URL: https://issues.apache.org/jira/browse/SPARK-15467
Project:
[
https://issues.apache.org/jira/browse/SPARK-19477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Don Drake reopened SPARK-19477:
---
I'm struggling with this answer.
I thought the point of Datasets, was to have a strongly typed
Don Drake created SPARK-19477:
-
Summary: [SQL] Datasets created from a Dataframe with extra
columns retain the extra columns
Key: SPARK-19477
URL: https://issues.apache.org/jira/browse/SPARK-19477
[
https://issues.apache.org/jira/browse/SPARK-19477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862560#comment-15862560
]
Don Drake commented on SPARK-19477:
---
How does lazy apply here? If I read/create a dataframe with extra
[
https://issues.apache.org/jira/browse/SPARK-17341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453806#comment-15453806
]
Don Drake commented on SPARK-17341:
---
I just downloaded the nightly build from 8/31/2016 and gave it a
[
https://issues.apache.org/jira/browse/SPARK-13721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459490#comment-15459490
]
Don Drake commented on SPARK-13721:
---
My nested structures aren't simple types, they are structs (case
Don Drake created SPARK-17384:
-
Summary: SQL - Running query with outer join from 1.6 fails
Key: SPARK-17384
URL: https://issues.apache.org/jira/browse/SPARK-17384
Project: Spark
Issue Type: Bug
Don Drake created SPARK-17341:
-
Summary: Can't read Parquet data with fields containing periods "."
Key: SPARK-17341
URL: https://issues.apache.org/jira/browse/SPARK-17341
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-13721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15452846#comment-15452846
]
Don Drake commented on SPARK-13721:
---
Spark 2.0 has deprecated this function, what workarounds are
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543555#comment-15543555
]
Don Drake commented on SPARK-16845:
---
I just hit this bug as well. Are there any suggested workarounds?
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15590256#comment-15590256
]
Don Drake commented on SPARK-16845:
---
[~lwlin] I saw your PR, but noticed it's failing some tests. Just
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15598442#comment-15598442
]
Don Drake commented on SPARK-16845:
---
Update:
It turns out that I am still getting this exception.
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592862#comment-15592862
]
Don Drake commented on SPARK-16845:
---
I compiled your branch and ran my large job and it finished
[
https://issues.apache.org/jira/browse/SPARK-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15659978#comment-15659978
]
Don Drake commented on SPARK-18207:
---
Hi, I was able to download a nightly SNAPSHOT release and verify
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614100#comment-15614100
]
Don Drake commented on SPARK-16845:
---
I'm struggling to get a simple case created.
I'm curious though,
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Don Drake updated SPARK-16845:
--
Attachment: error.txt.zip
Does this generated code help in resolving this?
>
Don Drake created SPARK-18207:
-
Summary: class
"org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection"
grows beyond 64 KB
Key: SPARK-18207
URL:
[
https://issues.apache.org/jira/browse/SPARK-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Don Drake updated SPARK-18207:
--
Description:
I have 2 wide dataframes that contain nested data structures, when I explode
one of the
[
https://issues.apache.org/jira/browse/SPARK-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Don Drake updated SPARK-18207:
--
Attachment: spark-18207.txt
Please read the comments at the top of the attachment, you need to :paste
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626664#comment-15626664
]
Don Drake commented on SPARK-16845:
---
I've been struggling to duplicate this and finally came up with a
[
https://issues.apache.org/jira/browse/SPARK-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15629140#comment-15629140
]
Don Drake commented on SPARK-18207:
---
I opened it based on [~lwlin]'s suggestion in the comments of
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626664#comment-15626664
]
Don Drake edited comment on SPARK-16845 at 11/2/16 12:32 AM:
-
I've been
[
https://issues.apache.org/jira/browse/SPARK-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15629177#comment-15629177
]
Don Drake commented on SPARK-18207:
---
The difference with my case versus the other test cases is that my
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15565592#comment-15565592
]
Don Drake commented on SPARK-16845:
---
Unfortunately, it does not work around it.
16/10/10 18:19:47
[
https://issues.apache.org/jira/browse/SPARK-16845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15567358#comment-15567358
]
Don Drake commented on SPARK-16845:
---
I can't at the moment, mine is not simple.
But this JIRA has
[
https://issues.apache.org/jira/browse/SPARK-16745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15940654#comment-15940654
]
Don Drake commented on SPARK-16745:
---
I just came across the same exception running Spark 2.1.0 on my
41 matches
Mail list logo
