[jira] [Commented] (SPARK-22176) Dataset.show(Int.MaxValue) hits integer overflows

2017-10-02 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16189272#comment-16189272 ] Takeshi Yamamuro commented on SPARK-22176: -- [~smilegator] close this? thanks. >

[jira] [Assigned] (SPARK-19984) ERROR codegen.CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19984: Assignee: (was: Apache Spark) > ERROR codegen.CodeGenerator: failed to compile: >

[jira] [Commented] (SPARK-19984) ERROR codegen.CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16189265#comment-16189265 ] Apache Spark commented on SPARK-19984: -- User 'rekhajoshm' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19984) ERROR codegen.CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19984: Assignee: Apache Spark > ERROR codegen.CodeGenerator: failed to compile: >

[jira] [Updated] (SPARK-19809) NullPointerException on empty ORC file

2017-10-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-19809: -- Affects Version/s: 2.2.0 > NullPointerException on empty ORC file >

[jira] [Commented] (SPARK-22158) convertMetastore should not ignore table properties

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16189201#comment-16189201 ] Apache Spark commented on SPARK-22158: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16189199#comment-16189199 ] Apache Spark commented on SPARK-22187: -- User 'tdas' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22187: Assignee: (was: Apache Spark) > Update unsaferow format for saved state such that we

[jira] [Assigned] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22187: Assignee: Apache Spark > Update unsaferow format for saved state such that we can set

[jira] [Created] (SPARK-22187) Update unsaferow format for saved state such that we can set timeouts when state is null

2017-10-02 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-22187: - Summary: Update unsaferow format for saved state such that we can set timeouts when state is null Key: SPARK-22187 URL: https://issues.apache.org/jira/browse/SPARK-22187

[jira] [Commented] (SPARK-19984) ERROR codegen.CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

2017-10-02 Thread John Steidley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188952#comment-16188952 ] John Steidley commented on SPARK-19984: --- [~kiszk] Thank you for your quick response! I really

[jira] [Updated] (SPARK-19984) ERROR codegen.CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

2017-10-02 Thread John Steidley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Steidley updated SPARK-19984: -- Attachment: after_adding_count.txt before_adding_count.txt > ERROR

[jira] [Assigned] (SPARK-20466) HadoopRDD#addLocalConfiguration throws NPE

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20466: Assignee: Apache Spark > HadoopRDD#addLocalConfiguration throws NPE >

[jira] [Commented] (SPARK-20466) HadoopRDD#addLocalConfiguration throws NPE

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188827#comment-16188827 ] Apache Spark commented on SPARK-20466: -- User 'sahilTakiar' has created a pull request for this

[jira] [Assigned] (SPARK-20466) HadoopRDD#addLocalConfiguration throws NPE

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20466: Assignee: (was: Apache Spark) > HadoopRDD#addLocalConfiguration throws NPE >

[jira] [Updated] (SPARK-22167) Spark Packaging w/R distro issues

2017-10-02 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-22167: Fix Version/s: 2.3.0 2.2.1 2.1.2 > Spark Packaging w/R distro issues

[jira] [Resolved] (SPARK-22167) Spark Packaging w/R distro issues

2017-10-02 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-22167. - Resolution: Fixed > Spark Packaging w/R distro issues > - > >

[jira] [Resolved] (SPARK-22186) Getting this issue while initializing spark on windows

2017-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22186. --- Resolution: Invalid Target Version/s: (was: 2.1.1) Questions should go to the mailing

[jira] [Created] (SPARK-22186) Getting this issue while initializing spark on windows

2017-10-02 Thread Prabir Ghosh (JIRA)
Prabir Ghosh created SPARK-22186: Summary: Getting this issue while initializing spark on windows Key: SPARK-22186 URL: https://issues.apache.org/jira/browse/SPARK-22186 Project: Spark Issue

[jira] [Updated] (SPARK-22158) convertMetastore should not ignore table properties

2017-10-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22158: -- Description: >From the beginning, convertMetastoreOrc ignores table properties and use an

[jira] [Updated] (SPARK-22158) convertMetastore should not ignore table properties

2017-10-02 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-22158: -- Summary: convertMetastore should not ignore table properties (was: convertMetastoreOrc should

[jira] [Commented] (SPARK-22142) Move Flume support behind a profile

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188596#comment-16188596 ] Apache Spark commented on SPARK-22142: -- User 'srowen' has created a pull request for this issue:

[jira] [Updated] (SPARK-18971) Netty issue may cause the shuffle client hang

2017-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18971: -- Fix Version/s: 2.1.3 > Netty issue may cause the shuffle client hang >

[jira] [Commented] (SPARK-22184) GraphX fails in case of insufficient memory and checkpoints enabled

2017-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188475#comment-16188475 ] Sean Owen commented on SPARK-22184: --- It sounds like they're the same issue, but if you're saying

[jira] [Reopened] (SPARK-22184) GraphX fails in case of insufficient memory and checkpoints enabled

2017-10-02 Thread Sergey Zhemzhitsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Zhemzhitsky reopened SPARK-22184: > GraphX fails in case of insufficient memory and checkpoints enabled >

[jira] [Comment Edited] (SPARK-22184) GraphX fails in case of insufficient memory and checkpoints enabled

2017-10-02 Thread Sergey Zhemzhitsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188306#comment-16188306 ] Sergey Zhemzhitsky edited comment on SPARK-22184 at 10/2/17 5:27 PM: -

[jira] [Resolved] (SPARK-22185) Classpath cannot be set for jobs running on Spark Standalone Mode

2017-10-02 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-22185. Resolution: Not A Bug Daemon classpath and executor classpath are different things, don't

[jira] [Updated] (SPARK-22185) Classpath cannot be set for jobs running on Spark Standalone Mode

2017-10-02 Thread Parth Gandhi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Gandhi updated SPARK-22185: - Summary: Classpath cannot be set for jobs running on Spark Standalone Mode (was: Jobs running

[jira] [Commented] (SPARK-22185) Jobs running on Spark Standalone Mode cannot access HDFS

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188367#comment-16188367 ] Apache Spark commented on SPARK-22185: -- User 'pgandhi999' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22185) Jobs running on Spark Standalone Mode cannot access HDFS

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22185: Assignee: Apache Spark > Jobs running on Spark Standalone Mode cannot access HDFS >

[jira] [Assigned] (SPARK-22185) Jobs running on Spark Standalone Mode cannot access HDFS

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22185: Assignee: (was: Apache Spark) > Jobs running on Spark Standalone Mode cannot access

[jira] [Created] (SPARK-22185) Jobs running on Spark Standalone Mode cannot access HDFS

2017-10-02 Thread Parth Gandhi (JIRA)
Parth Gandhi created SPARK-22185: Summary: Jobs running on Spark Standalone Mode cannot access HDFS Key: SPARK-22185 URL: https://issues.apache.org/jira/browse/SPARK-22185 Project: Spark

[jira] [Commented] (SPARK-19984) ERROR codegen.CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

2017-10-02 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188320#comment-16188320 ] Kazuaki Ishizaki commented on SPARK-19984: -- [~JohnSteidley] Thank you for your report. I also

[jira] [Commented] (SPARK-22184) GraphX fails in case of insufficient memory and checkpoints enabled

2017-10-02 Thread Sergey Zhemzhitsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188306#comment-16188306 ] Sergey Zhemzhitsky commented on SPARK-22184: Hi [~sowen], Should I merge changes of PR that

[jira] [Commented] (SPARK-22184) GraphX fails in case of insufficient memory and checkpoints enabled

2017-10-02 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16188282#comment-16188282 ] Apache Spark commented on SPARK-22184: -- User 'szhem' has created a pull request for this issue:

[jira] [Resolved] (SPARK-22184) GraphX fails in case of insufficient memory and checkpoints enabled

2017-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22184. --- Resolution: Duplicate This is just a special case of the other item you opened > GraphX fails in

[jira] [Updated] (SPARK-22150) PeriodicCheckpointer fails with FileNotFoundException in case of dependant RDDs

2017-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22150: -- Target Version/s: (was: 2.2.1) > PeriodicCheckpointer fails with FileNotFoundException in case of

[jira] [Updated] (SPARK-22184) GraphX fails in case of insufficient memory and checkpoints enabled

2017-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22184: -- Fix Version/s: (was: 2.2.1) > GraphX fails in case of insufficient memory and checkpoints enabled

[jira] [Created] (SPARK-22184) GraphX fails in case of insufficient memory and checkpoints enabled

2017-10-02 Thread Sergey Zhemzhitsky (JIRA)
Sergey Zhemzhitsky created SPARK-22184: -- Summary: GraphX fails in case of insufficient memory and checkpoints enabled Key: SPARK-22184 URL: https://issues.apache.org/jira/browse/SPARK-22184

[jira] [Created] (SPARK-22183) Inconsistency in LIKE escaping between literal values and column-based ones

2017-10-02 Thread Adrien Lavoillotte (JIRA)
Adrien Lavoillotte created SPARK-22183: -- Summary: Inconsistency in LIKE escaping between literal values and column-based ones Key: SPARK-22183 URL: https://issues.apache.org/jira/browse/SPARK-22183

[jira] [Resolved] (SPARK-22040) current_date function with timezone id

2017-10-02 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved SPARK-22040. - Resolution: Invalid > current_date function with timezone id >

[jira] [Updated] (SPARK-22182) Incorrect Date and Timestamp conversion beyon before 1000 year

2017-10-02 Thread Vladimir Smelov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Smelov updated SPARK-22182: Description: I create DF with None values in each odd row {code:python} from

[jira] [Created] (SPARK-22182) Incorrect Date and Timestamp conversion beyon before 1000 year

2017-10-02 Thread Vladimir Smelov (JIRA)
Vladimir Smelov created SPARK-22182: --- Summary: Incorrect Date and Timestamp conversion beyon before 1000 year Key: SPARK-22182 URL: https://issues.apache.org/jira/browse/SPARK-22182 Project: Spark

[jira] [Comment Edited] (SPARK-22063) Upgrade lintr to latest commit sha1 ID

2017-10-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187574#comment-16187574 ] Felix Cheung edited comment on SPARK-22063 at 10/2/17 9:16 AM: --- surely, I

[jira] [Commented] (SPARK-22115) Add operator for linalg Matrix and Vector

2017-10-02 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16187740#comment-16187740 ] Nick Pentreath commented on SPARK-22115: Do we plan to make this private? Or are you suggesting

[jira] [Resolved] (SPARK-22173) Table CSS style needs to be adjusted in History Page and in Executors Page.

2017-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22173. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19397

[jira] [Assigned] (SPARK-22173) Table CSS style needs to be adjusted in History Page and in Executors Page.

2017-10-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-22173: - Assignee: guoxiaolongzte > Table CSS style needs to be adjusted in History Page and in