[jira] [Comment Edited] (SPARK-13877) Consider removing Kafka modules from Spark / Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196805#comment-15196805 ] Hari Shreedharan edited comment on SPARK-13877 at 3/16/16 5:49 AM: ---

[jira] [Commented] (SPARK-13877) Consider removing Kafka modules from Spark / Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196805#comment-15196805 ] Hari Shreedharan commented on SPARK-13877: -- [~c...@koeninger.org] - Sure. I agree with having

[jira] [Created] (SPARK-13925) Expose R-like summary statistics in SparkR::glm for more family and link functions

Xiangrui Meng created SPARK-13925: - Summary: Expose R-like summary statistics in SparkR::glm for more family and link functions Key: SPARK-13925 URL: https://issues.apache.org/jira/browse/SPARK-13925

[jira] [Updated] (SPARK-13925) Expose R-like summary statistics in SparkR::glm for more family and link functions

[ https://issues.apache.org/jira/browse/SPARK-13925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13925: -- Priority: Critical (was: Major) > Expose R-like summary statistics in SparkR::glm for more

[jira] [Resolved] (SPARK-9837) Provide R-like summary statistics for GLMs via iteratively reweighted least squares

[ https://issues.apache.org/jira/browse/SPARK-9837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9837. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11694

[jira] [Resolved] (SPARK-13917) Generate code for broadcast left semi join

[ https://issues.apache.org/jira/browse/SPARK-13917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13917. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11742

[jira] [Updated] (SPARK-13903) Modify output nullability with constraints for Join and Filter operators

[ https://issues.apache.org/jira/browse/SPARK-13903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-13903: Summary: Modify output nullability with constraints for Join and Filter operators (was:

[jira] [Updated] (SPARK-13903) Modify output nullability with constraints for Join and Filter operators

[ https://issues.apache.org/jira/browse/SPARK-13903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-13903: Description: With constraints and optimization, we can make sure some outputs of a Join

[jira] [Commented] (SPARK-13641) getModelFeatures of ml.api.r.SparkRWrapper cannot (always) reveal the original column names

[ https://issues.apache.org/jira/browse/SPARK-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196765#comment-15196765 ] Xusen Yin commented on SPARK-13641: --- [~muralidh] I gonna close this JIRA since I find that it is

[jira] [Comment Edited] (SPARK-13641) getModelFeatures of ml.api.r.SparkRWrapper cannot (always) reveal the original column names

[ https://issues.apache.org/jira/browse/SPARK-13641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196765#comment-15196765 ] Xusen Yin edited comment on SPARK-13641 at 3/16/16 5:00 AM: I gonna close

[jira] [Assigned] (SPARK-13924) officially support multi-insert

[ https://issues.apache.org/jira/browse/SPARK-13924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13924: Assignee: Apache Spark > officially support multi-insert >

[jira] [Assigned] (SPARK-13924) officially support multi-insert

[ https://issues.apache.org/jira/browse/SPARK-13924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13924: Assignee: (was: Apache Spark) > officially support multi-insert >

[jira] [Commented] (SPARK-13924) officially support multi-insert

[ https://issues.apache.org/jira/browse/SPARK-13924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196760#comment-15196760 ] Apache Spark commented on SPARK-13924: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-13316) "SparkException: DStream has not been initialized" when restoring StreamingContext from checkpoint and the dstream is created afterwards

[ https://issues.apache.org/jira/browse/SPARK-13316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196758#comment-15196758 ] Apache Spark commented on SPARK-13316: -- User 'mwws' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13316) "SparkException: DStream has not been initialized" when restoring StreamingContext from checkpoint and the dstream is created afterwards

[ https://issues.apache.org/jira/browse/SPARK-13316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13316: Assignee: Apache Spark > "SparkException: DStream has not been initialized" when

[jira] [Assigned] (SPARK-13316) "SparkException: DStream has not been initialized" when restoring StreamingContext from checkpoint and the dstream is created afterwards

[ https://issues.apache.org/jira/browse/SPARK-13316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13316: Assignee: (was: Apache Spark) > "SparkException: DStream has not been initialized"

[jira] [Commented] (SPARK-13900) Spark SQL queries with OR condition is not optimized properly

[ https://issues.apache.org/jira/browse/SPARK-13900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196756#comment-15196756 ] Ashok kumar Rajendran commented on SPARK-13900: --- Along with dimensions condition, the above

[jira] [Commented] (SPARK-3308) Ability to read JSON Arrays as tables

[ https://issues.apache.org/jira/browse/SPARK-3308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196754#comment-15196754 ] Apache Spark commented on SPARK-3308: - User 'HyukjinKwon' has created a pull request for this issue:

[jira] [Commented] (SPARK-13900) Spark SQL queries with OR condition is not optimized properly

[ https://issues.apache.org/jira/browse/SPARK-13900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196753#comment-15196753 ] Ashok kumar Rajendran commented on SPARK-13900: --- Explain plan for query with OR condition

[jira] [Commented] (SPARK-13900) Spark SQL queries with OR condition is not optimized properly

[ https://issues.apache.org/jira/browse/SPARK-13900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196752#comment-15196752 ] Ashok kumar Rajendran commented on SPARK-13900: --- Hi Xio Li, Thanks for looking into this.

[jira] [Comment Edited] (SPARK-13821) TPC-DS Query 20 fails to compile

[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196464#comment-15196464 ] Dilip Biswal edited comment on SPARK-13821 at 3/16/16 4:41 AM: --- [~roycecil]

[jira] [Created] (SPARK-13924) officially support multi-insert

Wenchen Fan created SPARK-13924: --- Summary: officially support multi-insert Key: SPARK-13924 URL: https://issues.apache.org/jira/browse/SPARK-13924 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-13920) MIMA checks should apply to @Experimental and @DeveloperAPI APIs

[ https://issues.apache.org/jira/browse/SPARK-13920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13920: Assignee: Apache Spark > MIMA checks should apply to @Experimental and @DeveloperAPI APIs

[jira] [Commented] (SPARK-13920) MIMA checks should apply to @Experimental and @DeveloperAPI APIs

[ https://issues.apache.org/jira/browse/SPARK-13920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196743#comment-15196743 ] Apache Spark commented on SPARK-13920: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-13920) MIMA checks should apply to @Experimental and @DeveloperAPI APIs

[ https://issues.apache.org/jira/browse/SPARK-13920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13920: Assignee: (was: Apache Spark) > MIMA checks should apply to @Experimental and

[jira] [Resolved] (SPARK-13918) merge SortMergeJoin and SortMergeOuterJoin

[ https://issues.apache.org/jira/browse/SPARK-13918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13918. - Resolution: Fixed Fix Version/s: 2.0.0 > merge SortMergeJoin and SortMergeOuterJoin >

[jira] [Commented] (SPARK-13764) Parse modes in JSON data source

[ https://issues.apache.org/jira/browse/SPARK-13764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196665#comment-15196665 ] Hyukjin Kwon commented on SPARK-13764: -- The issue SPARK-3308 is related with supporting each row

[jira] [Comment Edited] (SPARK-13843) Move streaming-flume, streaming-mqtt, streaming-zeromq, streaming-akka, streaming-twitter to Spark packages

[ https://issues.apache.org/jira/browse/SPARK-13843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196661#comment-15196661 ] Liwei Lin edited comment on SPARK-13843 at 3/16/16 2:50 AM: hi [~zsxwing], we

[jira] [Assigned] (SPARK-13923) Implement SessionCatalog to manage temp functions and tables

[ https://issues.apache.org/jira/browse/SPARK-13923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13923: Assignee: Andrew Or (was: Apache Spark) > Implement SessionCatalog to manage temp

[jira] [Commented] (SPARK-13923) Implement SessionCatalog to manage temp functions and tables

[ https://issues.apache.org/jira/browse/SPARK-13923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196664#comment-15196664 ] Apache Spark commented on SPARK-13923: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13923) Implement SessionCatalog to manage temp functions and tables

[ https://issues.apache.org/jira/browse/SPARK-13923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13923: Assignee: Apache Spark (was: Andrew Or) > Implement SessionCatalog to manage temp

[jira] [Commented] (SPARK-13843) Move streaming-flume, streaming-mqtt, streaming-zeromq, streaming-akka, streaming-twitter to Spark packages

[ https://issues.apache.org/jira/browse/SPARK-13843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196661#comment-15196661 ] Liwei Lin commented on SPARK-13843: --- hi [~zsxwing], we didn't move streaming-kinesis (which is also

[jira] [Created] (SPARK-13923) Implement SessionCatalog to manage temp functions and tables

Andrew Or created SPARK-13923: - Summary: Implement SessionCatalog to manage temp functions and tables Key: SPARK-13923 URL: https://issues.apache.org/jira/browse/SPARK-13923 Project: Spark

[jira] [Comment Edited] (SPARK-13920) MIMA checks should apply to @Experimental and @DeveloperAPI APIs

[ https://issues.apache.org/jira/browse/SPARK-13920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196626#comment-15196626 ] Dongjoon Hyun edited comment on SPARK-13920 at 3/16/16 2:16 AM: Oh,

[jira] [Commented] (SPARK-13920) MIMA checks should apply to @Experimental and @DeveloperAPI APIs

[ https://issues.apache.org/jira/browse/SPARK-13920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196626#comment-15196626 ] Dongjoon Hyun commented on SPARK-13920: --- Oh, [~joshrosen]. I totally agree with the purpose of

[jira] [Commented] (SPARK-13915) Allow bin/spark-submit to be called via symbolic link

[ https://issues.apache.org/jira/browse/SPARK-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196590#comment-15196590 ] Saisai Shao commented on SPARK-13915: - I suppose it should be worked if you set {{SPARK_HOME}} in

[jira] [Commented] (SPARK-13872) Memory leak in SortMergeOuterJoin

[ https://issues.apache.org/jira/browse/SPARK-13872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196585#comment-15196585 ] Yin Huai commented on SPARK-13872: -- Also cc [~davies] > Memory leak in SortMergeOuterJoin >

[jira] [Commented] (SPARK-13914) Add functionality to back up spark event logs

[ https://issues.apache.org/jira/browse/SPARK-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196580#comment-15196580 ] Saisai Shao commented on SPARK-13914: - Agree with [~srowen], this feature is quite user specific,

[jira] [Assigned] (SPARK-13922) Filter rows with null attributes in parquet vectorized reader

[ https://issues.apache.org/jira/browse/SPARK-13922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13922: Assignee: (was: Apache Spark) > Filter rows with null attributes in parquet

[jira] [Commented] (SPARK-13922) Filter rows with null attributes in parquet vectorized reader

[ https://issues.apache.org/jira/browse/SPARK-13922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196577#comment-15196577 ] Apache Spark commented on SPARK-13922: -- User 'sameeragarwal' has created a pull request for this

[jira] [Assigned] (SPARK-13922) Filter rows with null attributes in parquet vectorized reader

[ https://issues.apache.org/jira/browse/SPARK-13922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13922: Assignee: Apache Spark > Filter rows with null attributes in parquet vectorized reader >

[jira] [Created] (SPARK-13922) Filter rows with null attributes in parquet vectorized reader

Sameer Agarwal created SPARK-13922: -- Summary: Filter rows with null attributes in parquet vectorized reader Key: SPARK-13922 URL: https://issues.apache.org/jira/browse/SPARK-13922 Project: Spark

[jira] [Assigned] (SPARK-13921) Store serialized blocks as multiple chunks in MemoryStore

[ https://issues.apache.org/jira/browse/SPARK-13921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13921: Assignee: Josh Rosen (was: Apache Spark) > Store serialized blocks as multiple chunks in

[jira] [Commented] (SPARK-13921) Store serialized blocks as multiple chunks in MemoryStore

[ https://issues.apache.org/jira/browse/SPARK-13921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196567#comment-15196567 ] Apache Spark commented on SPARK-13921: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13921) Store serialized blocks as multiple chunks in MemoryStore

[ https://issues.apache.org/jira/browse/SPARK-13921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13921: Assignee: Apache Spark (was: Josh Rosen) > Store serialized blocks as multiple chunks in

[jira] [Created] (SPARK-13921) Store serialized blocks as multiple chunks in MemoryStore

Josh Rosen created SPARK-13921: -- Summary: Store serialized blocks as multiple chunks in MemoryStore Key: SPARK-13921 URL: https://issues.apache.org/jira/browse/SPARK-13921 Project: Spark Issue

[jira] [Commented] (SPARK-13872) Memory leak in SortMergeOuterJoin

[ https://issues.apache.org/jira/browse/SPARK-13872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196561#comment-15196561 ] Mark Hamstra commented on SPARK-13872: -- [~joshrosen] > Memory leak in SortMergeOuterJoin >

[jira] [Comment Edited] (SPARK-13832) TPC-DS Query 36 fails with Parser error

[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196377#comment-15196377 ] Xin Wu edited comment on SPARK-13832 at 3/16/16 12:39 AM: -- Trying this query in

[jira] [Commented] (SPARK-2208) local metrics tests can fail on fast machines

[ https://issues.apache.org/jira/browse/SPARK-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196556#comment-15196556 ] Apache Spark commented on SPARK-2208: - User 'joan38' has created a pull request for this issue:

[jira] [Assigned] (SPARK-2208) local metrics tests can fail on fast machines

[ https://issues.apache.org/jira/browse/SPARK-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2208: --- Assignee: (was: Apache Spark) > local metrics tests can fail on fast machines >

[jira] [Assigned] (SPARK-2208) local metrics tests can fail on fast machines

[ https://issues.apache.org/jira/browse/SPARK-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2208: --- Assignee: Apache Spark > local metrics tests can fail on fast machines >

[jira] [Commented] (SPARK-13920) MIMA checks should apply to @Experimental and @DeveloperAPI APIs

[ https://issues.apache.org/jira/browse/SPARK-13920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196548#comment-15196548 ] Josh Rosen commented on SPARK-13920: I am not planning to work on this, so this task is up for grabs.

[jira] [Created] (SPARK-13920) MIMA checks should apply to @Experimental and @DeveloperAPI APIs

Josh Rosen created SPARK-13920: -- Summary: MIMA checks should apply to @Experimental and @DeveloperAPI APIs Key: SPARK-13920 URL: https://issues.apache.org/jira/browse/SPARK-13920 Project: Spark

[jira] [Commented] (SPARK-13602) o.a.s.deploy.worker.DriverRunner may leak the driver processes

[ https://issues.apache.org/jira/browse/SPARK-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196537#comment-15196537 ] Apache Spark commented on SPARK-13602: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-13602) o.a.s.deploy.worker.DriverRunner may leak the driver processes

[ https://issues.apache.org/jira/browse/SPARK-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13602: Assignee: (was: Apache Spark) > o.a.s.deploy.worker.DriverRunner may leak the driver

[jira] [Assigned] (SPARK-13602) o.a.s.deploy.worker.DriverRunner may leak the driver processes

[ https://issues.apache.org/jira/browse/SPARK-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13602: Assignee: Apache Spark > o.a.s.deploy.worker.DriverRunner may leak the driver processes >

[jira] [Assigned] (SPARK-13919) Resolving the Conflicts of ColumnPruning and PushPredicateThroughProject

[ https://issues.apache.org/jira/browse/SPARK-13919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13919: Assignee: Apache Spark > Resolving the Conflicts of ColumnPruning and

[jira] [Commented] (SPARK-13919) Resolving the Conflicts of ColumnPruning and PushPredicateThroughProject

[ https://issues.apache.org/jira/browse/SPARK-13919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196535#comment-15196535 ] Apache Spark commented on SPARK-13919: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13919) Resolving the Conflicts of ColumnPruning and PushPredicateThroughProject

[ https://issues.apache.org/jira/browse/SPARK-13919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13919: Assignee: (was: Apache Spark) > Resolving the Conflicts of ColumnPruning and

[jira] [Reopened] (SPARK-13804) Spark SQL's DataFrame.count() Major Divergent (Non-Linear) Performance Slowdown going from 4million rows to 16+ million rows

[ https://issues.apache.org/jira/browse/SPARK-13804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Nguyen reopened SPARK-13804: I posted this issue to user@ at

[jira] [Updated] (SPARK-13919) Resolving the Conflicts of ColumnPruning and PushPredicateThroughProject

[ https://issues.apache.org/jira/browse/SPARK-13919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13919: Description: Now, {{ColumnPruning}} and {{PushPredicateThroughProject}} reverse each other's effect.

[jira] [Created] (SPARK-13919) Resolving the Conflicts of ColumnPruning and PushPredicateThroughProject

Xiao Li created SPARK-13919: --- Summary: Resolving the Conflicts of ColumnPruning and PushPredicateThroughProject Key: SPARK-13919 URL: https://issues.apache.org/jira/browse/SPARK-13919 Project: Spark

[jira] [Commented] (SPARK-8489) Add regression tests for SPARK-8470

[ https://issues.apache.org/jira/browse/SPARK-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196517#comment-15196517 ] Apache Spark commented on SPARK-8489: - User 'dongjoon-hyun' has created a pull request for this issue:

[jira] [Commented] (SPARK-12653) Re-enable test "SPARK-8489: MissingRequirementError during reflection"

[ https://issues.apache.org/jira/browse/SPARK-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196516#comment-15196516 ] Apache Spark commented on SPARK-12653: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-13118) Support for classes defined in package objects

[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196487#comment-15196487 ] Reynold Xin commented on SPARK-13118: - The JIRA is the same. > Support for classes defined in

[jira] [Commented] (SPARK-13118) Support for classes defined in package objects

[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196463#comment-15196463 ] Jakob Odersky commented on SPARK-13118: --- Should I remove the JIRA ID from my existing PR? >

[jira] [Commented] (SPARK-13821) TPC-DS Query 20 fails to compile

[ https://issues.apache.org/jira/browse/SPARK-13821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196464#comment-15196464 ] Dilip Biswal commented on SPARK-13821: -- [~roycecil] Just tried the original query no. 20 against

[jira] [Commented] (SPARK-13820) TPC-DS Query 10 fails to compile

[ https://issues.apache.org/jira/browse/SPARK-13820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196430#comment-15196430 ] Davies Liu commented on SPARK-13820: Unfortunately, subquery is not target for 2.0. > TPC-DS Query

[jira] [Commented] (SPARK-13118) Support for classes defined in package objects

[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196427#comment-15196427 ] Reynold Xin commented on SPARK-13118: - I'm moving this out to its own ticket. I think there is

[jira] [Updated] (SPARK-13118) Support for classes defined in package objects

[ https://issues.apache.org/jira/browse/SPARK-13118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13118: Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-) > Support for

[jira] [Resolved] (SPARK-9999) Dataset API on top of Catalyst/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-. Resolution: Fixed Fix Version/s: 2.0.0 > Dataset API on top of Catalyst/DataFrame >

[jira] [Commented] (SPARK-13820) TPC-DS Query 10 fails to compile

[ https://issues.apache.org/jira/browse/SPARK-13820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196419#comment-15196419 ] Suresh Thalamati commented on SPARK-13820: -- This query contains correlated subquery, it is not

[jira] [Comment Edited] (SPARK-13832) TPC-DS Query 36 fails with Parser error

[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196377#comment-15196377 ] Xin Wu edited comment on SPARK-13832 at 3/15/16 10:43 PM: -- Trying this query in

[jira] [Comment Edited] (SPARK-13832) TPC-DS Query 36 fails with Parser error

[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196377#comment-15196377 ] Xin Wu edited comment on SPARK-13832 at 3/15/16 10:44 PM: -- Trying this query in

[jira] [Comment Edited] (SPARK-13832) TPC-DS Query 36 fails with Parser error

[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196377#comment-15196377 ] Xin Wu edited comment on SPARK-13832 at 3/15/16 10:41 PM: -- Trying this query in

[jira] [Commented] (SPARK-13918) merge SortMergeJoin and SortMergeOuterJoin

[ https://issues.apache.org/jira/browse/SPARK-13918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196376#comment-15196376 ] Apache Spark commented on SPARK-13918: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13918) merge SortMergeJoin and SortMergeOuterJoin

[ https://issues.apache.org/jira/browse/SPARK-13918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13918: Assignee: Davies Liu (was: Apache Spark) > merge SortMergeJoin and SortMergeOuterJoin >

[jira] [Assigned] (SPARK-13918) merge SortMergeJoin and SortMergeOuterJoin

[ https://issues.apache.org/jira/browse/SPARK-13918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13918: Assignee: Apache Spark (was: Davies Liu) > merge SortMergeJoin and SortMergeOuterJoin >

[jira] [Commented] (SPARK-13832) TPC-DS Query 36 fails with Parser error

[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196377#comment-15196377 ] Xin Wu commented on SPARK-13832: Trying this query in Spark 2.0 and I needed to change grouping__id to

[jira] [Created] (SPARK-13918) merge SortMergeJoin and SortMergeOuterJoin

Davies Liu created SPARK-13918: -- Summary: merge SortMergeJoin and SortMergeOuterJoin Key: SPARK-13918 URL: https://issues.apache.org/jira/browse/SPARK-13918 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-13912) spark.hadoop.* configurations are not applied for Parquet Data Frame Readers

[ https://issues.apache.org/jira/browse/SPARK-13912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196366#comment-15196366 ] Matt Cheah commented on SPARK-13912: Yup workarounds for me have been putting all spark.hadoop.*

[jira] [Updated] (SPARK-13912) spark.hadoop.* configurations are not applied for Parquet Data Frame Readers

[ https://issues.apache.org/jira/browse/SPARK-13912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13912: - Target Version/s: 2.0.0 > spark.hadoop.* configurations are not applied for Parquet Data Frame Readers >

[jira] [Commented] (SPARK-13912) spark.hadoop.* configurations are not applied for Parquet Data Frame Readers

[ https://issues.apache.org/jira/browse/SPARK-13912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196361#comment-15196361 ] Yin Huai commented on SPARK-13912: -- [~mcheah] Let's target this for 2.0. This behavior is confusing.

[jira] [Issue Comment Deleted] (SPARK-13832) TPC-DS Query 36 fails with Parser error

[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin Wu updated SPARK-13832: --- Comment: was deleted (was: Hi Roy, I will validate and look into this one. ) > TPC-DS Query 36 fails with

[jira] [Updated] (SPARK-13895) DataFrameReader.text should return Dataset[String]

[ https://issues.apache.org/jira/browse/SPARK-13895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13895: - Assignee: Reynold Xin > DataFrameReader.text should return Dataset[String] >

[jira] [Resolved] (SPARK-13895) DataFrameReader.text should return Dataset[String]

[ https://issues.apache.org/jira/browse/SPARK-13895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-13895. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11739

[jira] [Assigned] (SPARK-13917) Generate code for broadcast left semi join

[ https://issues.apache.org/jira/browse/SPARK-13917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13917: Assignee: Apache Spark (was: Davies Liu) > Generate code for broadcast left semi join >

[jira] [Assigned] (SPARK-13917) Generate code for broadcast left semi join

[ https://issues.apache.org/jira/browse/SPARK-13917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13917: Assignee: Davies Liu (was: Apache Spark) > Generate code for broadcast left semi join >

[jira] [Commented] (SPARK-13917) Generate code for broadcast left semi join

[ https://issues.apache.org/jira/browse/SPARK-13917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196338#comment-15196338 ] Apache Spark commented on SPARK-13917: -- User 'davies' has created a pull request for this issue:

[jira] [Created] (SPARK-13917) Generate code for broadcast left semi join

Davies Liu created SPARK-13917: -- Summary: Generate code for broadcast left semi join Key: SPARK-13917 URL: https://issues.apache.org/jira/browse/SPARK-13917 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-13916) For whole stage codegen, measure and add the execution duration as a metric

[ https://issues.apache.org/jira/browse/SPARK-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13916: Assignee: Apache Spark > For whole stage codegen, measure and add the execution duration

[jira] [Assigned] (SPARK-13916) For whole stage codegen, measure and add the execution duration as a metric

[ https://issues.apache.org/jira/browse/SPARK-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13916: Assignee: (was: Apache Spark) > For whole stage codegen, measure and add the

[jira] [Commented] (SPARK-13916) For whole stage codegen, measure and add the execution duration as a metric

[ https://issues.apache.org/jira/browse/SPARK-13916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196151#comment-15196151 ] Apache Spark commented on SPARK-13916: -- User 'nongli' has created a pull request for this issue:

[jira] [Created] (SPARK-13916) For whole stage codegen, measure and add the execution duration as a metric

Nong Li created SPARK-13916: --- Summary: For whole stage codegen, measure and add the execution duration as a metric Key: SPARK-13916 URL: https://issues.apache.org/jira/browse/SPARK-13916 Project: Spark

[jira] [Commented] (SPARK-13914) Add functionality to back up spark event logs

[ https://issues.apache.org/jira/browse/SPARK-13914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196117#comment-15196117 ] Sean Owen commented on SPARK-13914: --- This is just a problem because you have an ephemeral FS, but you

[jira] [Commented] (SPARK-13915) Allow bin/spark-submit to be called via symbolic link

[ https://issues.apache.org/jira/browse/SPARK-13915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196113#comment-15196113 ] Sean Owen commented on SPARK-13915: --- I'm not clear if you're suggesting a change to the spark-submit as

[jira] [Assigned] (SPARK-13873) Avoid the copy in whole stage codegen when there is no joins

[ https://issues.apache.org/jira/browse/SPARK-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13873: Assignee: Apache Spark (was: Davies Liu) > Avoid the copy in whole stage codegen when

[jira] [Commented] (SPARK-13873) Avoid the copy in whole stage codegen when there is no joins

[ https://issues.apache.org/jira/browse/SPARK-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196108#comment-15196108 ] Apache Spark commented on SPARK-13873: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13873) Avoid the copy in whole stage codegen when there is no joins

[ https://issues.apache.org/jira/browse/SPARK-13873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13873: Assignee: Davies Liu (was: Apache Spark) > Avoid the copy in whole stage codegen when

[jira] [Created] (SPARK-13915) Allow bin/spark-submit to be called via symbolic link

Rafael Pecin Ferreira created SPARK-13915: - Summary: Allow bin/spark-submit to be called via symbolic link Key: SPARK-13915 URL: https://issues.apache.org/jira/browse/SPARK-13915 Project:

  1   2   3   >