[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629231#comment-16629231
]
David Spies commented on SPARK-18492:
-
Ran into this as well. It seems like this is happening
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552257#comment-16552257
]
Takeshi Yamamuro commented on SPARK-18492:
--
[~MDS Tang] You'd be better to describe more about
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552242#comment-16552242
]
Tang Yu Jie commented on SPARK-18492:
-
Here I also encountered this problem, have you resolved it?
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389761#comment-16389761
]
Kazuaki Ishizaki commented on SPARK-18492:
--
[~imranshaik]
I ran the following program with
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389723#comment-16389723
]
Nicholas Chammas commented on SPARK-18492:
--
[~imranshaik] - This is an open source project. You
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389648#comment-16389648
]
imran shaik commented on SPARK-18492:
-
@Kazuaki Ishizaki any update on this?
> GeneratedIterator
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387969#comment-16387969
]
imran shaik commented on SPARK-18492:
-
truetradescast schema
root
|-- Event_Time: long (nullable =
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384428#comment-16384428
]
Kazuaki Ishizaki commented on SPARK-18492:
--
Thanks, what is the definition of
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383950#comment-16383950
]
imran shaik commented on SPARK-18492:
-
val stremingagg =
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383936#comment-16383936
]
Kazuaki Ishizaki commented on SPARK-18492:
--
According to the screenshot, the number of the
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383933#comment-16383933
]
Kazuaki Ishizaki commented on SPARK-18492:
--
Thank you for reporting the issue. We would
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383891#comment-16383891
]
imran shaik commented on SPARK-18492:
-
Spark 2.3.0 has same issue unfortunately
Here is the
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383868#comment-16383868
]
imran shaik commented on SPARK-18492:
-
I will try to reproduce the error on Spark 2.3.0 and let you
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383843#comment-16383843
]
Nicholas Chammas commented on SPARK-18492:
--
Are you seeing the same on Spark 2.3.0? Apparently,
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383834#comment-16383834
]
imran shaik commented on SPARK-18492:
-
Facing the same issue:
Spark Version: 2.2.1
Scala Version :
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200682#comment-16200682
]
Kazuaki Ishizaki commented on SPARK-18492:
--
[~ramzanfarooq] I see. We do not need your original
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200625#comment-16200625
]
Muhammad Ramzan commented on SPARK-18492:
-
[~kiszk] i am sorry i can not share the code since its
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200606#comment-16200606
]
Kazuaki Ishizaki commented on SPARK-18492:
--
[~cenyuhai][~ramzanfarooq] Thank you for reporting
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198192#comment-16198192
]
Muhammad Ramzan commented on SPARK-18492:
-
I am using spark 2.1.1 on a production environment and
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158189#comment-16158189
]
cen yuhai commented on SPARK-18492:
---
spark 2.1.1 also have this problem
> GeneratedIterator grows
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16008163#comment-16008163
]
Biagio commented on SPARK-18492:
Same Error as Rupinder and sskadarkar when using the "window" function
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982550#comment-15982550
]
sskadarkar commented on SPARK-18492:
[~tdas] I am also getting the same error which Rupinder has
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981010#comment-15981010
]
Rupinder Virk commented on SPARK-18492:
---
I am getting the same error for 2.1.0 stable version and
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974766#comment-15974766
]
Kazuaki Ishizaki commented on SPARK-18492:
--
Do you see the same problem with the latest master
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823110#comment-15823110
]
Sean Owen commented on SPARK-18492:
---
64K is a JVM limit as far as I know. And there are lots of ways to
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15822940#comment-15822940
]
Nicholas Chammas commented on SPARK-18492:
--
Actually, on second look, I'm not entirely sure
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15822939#comment-15822939
]
Nicholas Chammas commented on SPARK-18492:
--
Oh, it looks like this issue is duplicated by
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15822934#comment-15822934
]
Nicholas Chammas commented on SPARK-18492:
--
I suppose the "correct" solution is to make code
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762785#comment-15762785
]
Roberto Mirizzi commented on SPARK-18492:
-
I would also like to understand if this error causes
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762706#comment-15762706
]
Nicholas Chammas commented on SPARK-18492:
--
Yup, I'm seeming the same high-level behavior as
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762628#comment-15762628
]
Roberto Mirizzi commented on SPARK-18492:
-
I'm having exactly the same issue on Spark 2.0.2. I
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762609#comment-15762609
]
Roberto Mirizzi commented on SPARK-18492:
-
I'm having exactly the same issue. My exception is:
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15755742#comment-15755742
]
Nicholas Chammas commented on SPARK-18492:
--
I'm hitting this problem as well when I try to apply
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702760#comment-15702760
]
Kazuaki Ishizaki commented on SPARK-18492:
--
I realized that the following code can reproduce
[
https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674599#comment-15674599
]
Kazuaki Ishizaki commented on SPARK-18492:
--
Can you post a small program that can reproduce this
35 matches
Mail list logo
