Amit created SPARK-30692:
-
Summary: Mechanism to check that all queries of spark
structured-streaming are started in case of multiple sink actions.
Key: SPARK-30692
URL: https://issues.apache.org/jira/browse/SPARK-30692
[
https://issues.apache.org/jira/browse/SPARK-25185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16897305#comment-16897305
]
Amit commented on SPARK-25185:
--
Yes it seems to work, but with lot of caveats.. like the on
[
https://issues.apache.org/jira/browse/SPARK-25185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amit updated SPARK-25185:
-
Description:
Created a dummy partitioned data with partition column on string type col1=a
and col1=b
added csv
[
https://issues.apache.org/jira/browse/SPARK-25185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amit updated SPARK-25185:
-
Environment:
Tried on Ubuntu, FreBSD and windows, running spark-shell in local mode reading
data from local
[
https://issues.apache.org/jira/browse/SPARK-25185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amit updated SPARK-25185:
-
Environment:
Tried on Ubuntu, FreBSD and windows
was:
Created a dummy partitioned data with partition col
Amit created SPARK-25185:
Summary: CBO rowcount statistics doesn't work for partitioned
parquet external table
Key: SPARK-25185
URL: https://issues.apache.org/jira/browse/SPARK-25185
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16263867#comment-16263867
]
Amit edited comment on SPARK-10848 at 11/23/17 6:22 AM:
This issu
[
https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16263867#comment-16263867
]
Amit edited comment on SPARK-10848 at 11/23/17 6:21 AM:
This issu
[
https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16263867#comment-16263867
]
Amit commented on SPARK-10848:
--
This issue is still persistent in Spark 2.1.0.
I tried below
[
https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15924573#comment-15924573
]
Nira Amit commented on SPARK-19424:
---
[~hvanhovell] The solution would be to not ignore
[
https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nira Amit reopened SPARK-19424:
---
I managed to get my code to work, yes. The problem of the wrong type at runtime
is not resolved, though.
[
https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nira Amit reopened SPARK-19424:
---
Sean, I am not trying to piss you off but to investigate a problem. If your
explanation is that it is fi
[
https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nira Amit reopened SPARK-19424:
---
Re-opening this issue because throwing unexpected ClassCastExceptions is not an
accepted behavior of a J
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896590#comment-15896590
]
Nira Amit commented on SPARK-19656:
---
I will not, but please consider documenting the co
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896581#comment-15896581
]
Nira Amit commented on SPARK-19656:
---
I found a problem in my schema and managed to load
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nira Amit updated SPARK-19656:
--
Attachment: (was: datum2.png)
> Can't load custom type from avro file to RDD with newAPIHadoopFile
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nira Amit updated SPARK-19656:
--
Comment: was deleted
(was: {code}
public static class ABgoEventAvroReader extends
AvroRecordReader
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nira Amit updated SPARK-19656:
--
Attachment: (was: datum.png)
> Can't load custom type from avro file to RDD with newAPIHadoopFile
>
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nira Amit updated SPARK-19656:
--
Comment: was deleted
(was: [~srowen] Will you at least consider the possibility that I'm on to a
real
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nira Amit updated SPARK-19656:
--
Attachment: datum2.png
> Can't load custom type from avro file to RDD with newAPIHadoopFile
> -
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nira Amit updated SPARK-19656:
--
Attachment: datum.png
{code}
public static class ABgoEventAvroReader extends
AvroRecordReaderBase
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nira Amit reopened SPARK-19656:
---
[~srowen] Will you at least consider the possibility that I'm on to a real
problem here? I may be wrong
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896314#comment-15896314
]
Nira Amit commented on SPARK-19656:
---
And by the way, "what is in the file" is bytes. Th
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896286#comment-15896286
]
Nira Amit edited comment on SPARK-19656 at 3/5/17 2:55 PM:
---
But
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896286#comment-15896286
]
Nira Amit edited comment on SPARK-19656 at 3/5/17 2:56 PM:
---
But
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896286#comment-15896286
]
Nira Amit commented on SPARK-19656:
---
But then why does the compiler accepts what newAPI
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896277#comment-15896277
]
Nira Amit commented on SPARK-19656:
---
The only reason my code sample doesn't compile is
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896266#comment-15896266
]
Nira Amit commented on SPARK-19656:
---
[~sowen] I have been trying this for weeks every w
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896262#comment-15896262
]
Nira Amit commented on SPARK-19656:
---
Thanks Eric, but my question is about RDDs. Is it
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896179#comment-15896179
]
Nira Amit commented on SPARK-19656:
---
Yes, I did, and answered him that it gives a compi
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896172#comment-15896172
]
Nira Amit commented on SPARK-19656:
---
But if this is not possible to do in Java then it
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896166#comment-15896166
]
Nira Amit commented on SPARK-19656:
---
[~emaynard] There is no "asInstanceOf" method in t
[
https://issues.apache.org/jira/browse/SPARK-19656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15873090#comment-15873090
]
Nira Amit commented on SPARK-19656:
---
I also tried to do this without writing my own `Av
Nira Amit created SPARK-19656:
-
Summary: Can't load custom type from avro file to RDD with
newAPIHadoopFile
Key: SPARK-19656
URL: https://issues.apache.org/jira/browse/SPARK-19656
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848981#comment-15848981
]
Nira Amit edited comment on SPARK-19424 at 2/1/17 11:04 PM:
[
[
https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848981#comment-15848981
]
Nira Amit edited comment on SPARK-19424 at 2/1/17 11:03 PM:
[
[
https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848981#comment-15848981
]
Nira Amit edited comment on SPARK-19424 at 2/1/17 11:00 PM:
[
[
https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848981#comment-15848981
]
Nira Amit commented on SPARK-19424:
---
[~srowen] thanks for elaborating, but in that case
[
https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848634#comment-15848634
]
Nira Amit commented on SPARK-19424:
---
[~srowen] So shouldn't this give me a compilation
[
https://issues.apache.org/jira/browse/SPARK-19424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848478#comment-15848478
]
Nira Amit commented on SPARK-19424:
---
I posted this question in StackOverflow with a wor
Nira Amit created SPARK-19424:
-
Summary: Wrong runtime type in RDD when reading from avro with
custom serializer
Key: SPARK-19424
URL: https://issues.apache.org/jira/browse/SPARK-19424
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-18945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15764163#comment-15764163
]
Nira Amit edited comment on SPARK-18945 at 12/20/16 1:03 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-18945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nira Amit closed SPARK-18945.
-
Resolution: Not A Problem
There's a bug in my code
> java.lang.ClassCastException when Tuple2 field is a
Nira Amit created SPARK-18945:
-
Summary: java.lang.ClassCastException when Tuple2 field is an array
Key: SPARK-18945
URL: https://issues.apache.org/jira/browse/SPARK-18945
Project: Spark
Issue Ty
Amit created SPARK-12435:
Summary: Installing Spark
Key: SPARK-12435
URL: https://issues.apache.org/jira/browse/SPARK-12435
Project: Spark
Issue Type: Bug
Components: Build
Affects Vers
[
https://issues.apache.org/jira/browse/SPARK-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amit updated SPARK-10756:
-
Description:
DataFrame write to teradata using jdbc not working, tries to create table each
time irrespective of
Amit created SPARK-10756:
Summary: DataFrame write to teradata using jdbc not working, tries
to create table each time irrespective of table existence
Key: SPARK-10756
URL: https://issues.apache.org/jira/browse/SPARK-1075
47 matches
Mail list logo
