[jira] [Commented] (SPARK-10969) Spark Streaming Kinesis: Allow specifying separate credentials for Kinesis and DynamoDB

2017-11-26 Thread Christoph Pirkl (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266430#comment-16266430 ] Christoph Pirkl commented on SPARK-10969: - Thanks for the information, this solves my problem.

[jira] [Resolved] (SPARK-22602) remove ColumnVector#loadBytes

2017-11-26 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22602. - Resolution: Fixed Fix Version/s: 2.3.0 > remove ColumnVector#loadBytes >

[jira] [Commented] (SPARK-22611) Spark Kinesis ProvisionedThroughputExceededException leads to dropped records

2017-11-26 Thread Richard Moorhead (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266389#comment-16266389 ] Richard Moorhead commented on SPARK-22611: -- Thats correct. The Spark Streaming UI shows a

[jira] [Comment Edited] (SPARK-10969) Spark Streaming Kinesis: Allow specifying separate credentials for Kinesis and DynamoDB

2017-11-26 Thread Grega Kespret (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266374#comment-16266374 ] Grega Kespret edited comment on SPARK-10969 at 11/27/17 5:33 AM: - I

[jira] [Comment Edited] (SPARK-10969) Spark Streaming Kinesis: Allow specifying separate credentials for Kinesis and DynamoDB

2017-11-26 Thread Grega Kespret (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266374#comment-16266374 ] Grega Kespret edited comment on SPARK-10969 at 11/27/17 5:31 AM: - I

[jira] [Commented] (SPARK-10969) Spark Streaming Kinesis: Allow specifying separate credentials for Kinesis and DynamoDB

2017-11-26 Thread Grega Kespret (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266374#comment-16266374 ] Grega Kespret commented on SPARK-10969: --- I believe this is now possible through the

[jira] [Commented] (SPARK-7721) Generate test coverage report from Python

2017-11-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266358#comment-16266358 ] Reynold Xin commented on SPARK-7721: This is really cool. I took a look but it looks like doctests are

[jira] [Created] (SPARK-22612) NullPointerException in AppendOnlyMap

2017-11-26 Thread Lijie Xu (JIRA)
Lijie Xu created SPARK-22612: Summary: NullPointerException in AppendOnlyMap Key: SPARK-22612 URL: https://issues.apache.org/jira/browse/SPARK-22612 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-22611) Spark Kinesis ProvisionedThroughputExceededException leads to dropped records

2017-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266333#comment-16266333 ] Sean Owen commented on SPARK-22611: --- What's the Spark issue here -- somehow the error causes the

[jira] [Resolved] (SPARK-22610) AM restart in a other node send Jobs into a state of feign death

2017-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22610. --- Resolution: Invalid Questions to the mailing list please > AM restart in a other node send Jobs

[jira] [Created] (SPARK-22611) Spark Kinesis ProvisionedThroughputExceededException leads to dropped records

2017-11-26 Thread Richard Moorhead (JIRA)
Richard Moorhead created SPARK-22611: Summary: Spark Kinesis ProvisionedThroughputExceededException leads to dropped records Key: SPARK-22611 URL: https://issues.apache.org/jira/browse/SPARK-22611

[jira] [Created] (SPARK-22610) AM restart in a other node send Jobs into a state of feign death

2017-11-26 Thread Bang Xiao (JIRA)
Bang Xiao created SPARK-22610: - Summary: AM restart in a other node send Jobs into a state of feign death Key: SPARK-22610 URL: https://issues.apache.org/jira/browse/SPARK-22610 Project: Spark

[jira] [Closed] (SPARK-22609) Reuse CodeGeneration.nullSafeExec when possible

2017-11-26 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido closed SPARK-22609. --- > Reuse CodeGeneration.nullSafeExec when possible > --- > >

[jira] [Resolved] (SPARK-22609) Reuse CodeGeneration.nullSafeExec when possible

2017-11-26 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved SPARK-22609. - Resolution: Invalid > Reuse CodeGeneration.nullSafeExec when possible >

[jira] [Assigned] (SPARK-22601) Data load is getting displayed successful on providing non existing hdfs file path

2017-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22601: Assignee: (was: Apache Spark) > Data load is getting displayed successful on

[jira] [Assigned] (SPARK-22601) Data load is getting displayed successful on providing non existing hdfs file path

2017-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22601: Assignee: Apache Spark > Data load is getting displayed successful on providing non

[jira] [Commented] (SPARK-22601) Data load is getting displayed successful on providing non existing hdfs file path

2017-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266123#comment-16266123 ] Apache Spark commented on SPARK-22601: -- User 'sujith71955' has created a pull request for this

[jira] [Commented] (SPARK-22579) BlockManager.getRemoteValues and BlockManager.getRemoteBytes should be implemented using streaming

2017-11-26 Thread Eyal Farago (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266102#comment-16266102 ] Eyal Farago commented on SPARK-22579: - [~srowen], I couldn't see a place where this data is stored

[jira] [Updated] (SPARK-22608) Avoid code duplication regarding CodeGeneration.splitExpressions()

2017-11-26 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22608: - Issue Type: Improvement (was: Bug) > Avoid code duplication regarding

[jira] [Updated] (SPARK-22608) Avoid code duplication regarding CodeGeneration.splitExpressions()

2017-11-26 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22608: - Priority: Minor (was: Major) > Avoid code duplication regarding

[jira] [Resolved] (SPARK-22573) SQL Planner is including unnecessary columns in the projection

2017-11-26 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-22573. - Resolution: Duplicate > SQL Planner is including unnecessary columns in the projection >

[jira] [Resolved] (SPARK-22607) Set large stack size consistently for tests to avoid StackOverflowError

2017-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22607. --- Resolution: Fixed Fix Version/s: 2.3.0 2.2.2 Issue resolved by pull

[jira] [Updated] (SPARK-22607) Set large stack size consistently for tests to avoid StackOverflowError

2017-11-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22607: -- Description: I was seeing this error while testing the 2.2.1 RC: {code} OrderingSuite: ... -

[jira] [Assigned] (SPARK-22609) Reuse CodeGeneration.nullSafeExec when possible

2017-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22609: Assignee: (was: Apache Spark) > Reuse CodeGeneration.nullSafeExec when possible >

[jira] [Commented] (SPARK-22609) Reuse CodeGeneration.nullSafeExec when possible

2017-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266002#comment-16266002 ] Apache Spark commented on SPARK-22609: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22609) Reuse CodeGeneration.nullSafeExec when possible

2017-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22609: Assignee: Apache Spark > Reuse CodeGeneration.nullSafeExec when possible >

[jira] [Created] (SPARK-22609) Reuse CodeGeneration.nullSafeExec when possible

2017-11-26 Thread Marco Gaido (JIRA)
Marco Gaido created SPARK-22609: --- Summary: Reuse CodeGeneration.nullSafeExec when possible Key: SPARK-22609 URL: https://issues.apache.org/jira/browse/SPARK-22609 Project: Spark Issue Type:

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

2017-11-26 Thread ABHISHEK CHOUDHARY (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265993#comment-16265993 ] ABHISHEK CHOUDHARY commented on SPARK-18016: I found the same issue in Latest spark 2.2.0

[jira] [Assigned] (SPARK-22608) Avoid code duplication regarding CodeGeneration.splitExpressions()

2017-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22608: Assignee: (was: Apache Spark) > Avoid code duplication regarding

[jira] [Commented] (SPARK-22608) Avoid code duplication regarding CodeGeneration.splitExpressions()

2017-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265952#comment-16265952 ] Apache Spark commented on SPARK-22608: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22608) Avoid code duplication regarding CodeGeneration.splitExpressions()

2017-11-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22608: Assignee: Apache Spark > Avoid code duplication regarding

[jira] [Updated] (SPARK-22608) Avoid code duplication regarding CodeGeneration.splitExpressions()

2017-11-26 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-22608: - Summary: Avoid code duplication regarding CodeGeneration.splitExpressions() (was: Add

[jira] [Created] (SPARK-22608) Add new API to CodeGeneration.splitExpressions()

2017-11-26 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-22608: Summary: Add new API to CodeGeneration.splitExpressions() Key: SPARK-22608 URL: https://issues.apache.org/jira/browse/SPARK-22608 Project: Spark