[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081712#comment-16081712 ] Felix Cheung commented on SPARK-21367: -- it looks like instead of 5.x, the older 4.0 is being loaded?

[jira] [Commented] (SPARK-21360) Spark failing to query SQL Server. Query contains a column having space in where clause

[ https://issues.apache.org/jira/browse/SPARK-21360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081685#comment-16081685 ] feroz khan commented on SPARK-21360: Thanks for inputs. I will go through the link. > Spark failing

[jira] [Updated] (SPARK-21360) Spark failing to query SQL Server. Query contains a column having space in where clause

[ https://issues.apache.org/jira/browse/SPARK-21360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feroz khan updated SPARK-21360: --- Description: I have a table on table on Microsoft SQL server

[jira] [Closed] (SPARK-21361) Spark failing to query SQL Server. Query contains a column having space in where clause

[ https://issues.apache.org/jira/browse/SPARK-21361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feroz khan closed SPARK-21361. -- Created a duplicate issue. SPARK-21360 is open for resolution. > Spark failing to query SQL Server.

[jira] [Commented] (SPARK-21349) Make TASK_SIZE_TO_WARN_KB configurable

[ https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081518#comment-16081518 ] Jiang Xingbo commented on SPARK-21349: -- [~dongjoon] Are you running the test for Spark SQL? Or

[jira] [Assigned] (SPARK-19285) Java - Provide user-defined function of 0 arguments (UDF0)

[ https://issues.apache.org/jira/browse/SPARK-19285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-19285: --- Assignee: Xiao Li > Java - Provide user-defined function of 0 arguments (UDF0) >

[jira] [Commented] (SPARK-19285) Java - Provide user-defined function of 0 arguments (UDF0)

[ https://issues.apache.org/jira/browse/SPARK-19285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081662#comment-16081662 ] Apache Spark commented on SPARK-19285: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19285) Java - Provide user-defined function of 0 arguments (UDF0)

[ https://issues.apache.org/jira/browse/SPARK-19285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19285: Assignee: Apache Spark (was: Xiao Li) > Java - Provide user-defined function of 0

[jira] [Assigned] (SPARK-19285) Java - Provide user-defined function of 0 arguments (UDF0)

[ https://issues.apache.org/jira/browse/SPARK-19285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19285: Assignee: Xiao Li (was: Apache Spark) > Java - Provide user-defined function of 0

[jira] [Created] (SPARK-21371) dev/make-distribution.sh scripts use of $@ without ""

liuzhaokun created SPARK-21371: -- Summary: dev/make-distribution.sh scripts use of $@ without "" Key: SPARK-21371 URL: https://issues.apache.org/jira/browse/SPARK-21371 Project: Spark Issue

[jira] [Commented] (SPARK-20456) Add examples for functions collection for pyspark

[ https://issues.apache.org/jira/browse/SPARK-20456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081628#comment-16081628 ] Apache Spark commented on SPARK-20456: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-21315) Skip some spill files when generateIterator(startIndex) in ExternalAppendOnlyUnsafeRowArray.

[ https://issues.apache.org/jira/browse/SPARK-21315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21315. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18541

[jira] [Assigned] (SPARK-21315) Skip some spill files when generateIterator(startIndex) in ExternalAppendOnlyUnsafeRowArray.

[ https://issues.apache.org/jira/browse/SPARK-21315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21315: --- Assignee: jin xing > Skip some spill files when generateIterator(startIndex) in >

[jira] [Assigned] (SPARK-21371) dev/make-distribution.sh scripts use of $@ without ""

[ https://issues.apache.org/jira/browse/SPARK-21371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21371: Assignee: Apache Spark > dev/make-distribution.sh scripts use of $@ without "" >

[jira] [Resolved] (SPARK-21350) Fix the error message when the number of arguments is wrong when invoking a UDF

[ https://issues.apache.org/jira/browse/SPARK-21350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21350. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18574

[jira] [Resolved] (SPARK-21369) Don't use Scala classes in external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-21369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21369. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved by pull

[jira] [Assigned] (SPARK-21371) dev/make-distribution.sh scripts use of $@ without ""

[ https://issues.apache.org/jira/browse/SPARK-21371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21371: Assignee: (was: Apache Spark) > dev/make-distribution.sh scripts use of $@ without ""

[jira] [Commented] (SPARK-21371) dev/make-distribution.sh scripts use of $@ without ""

[ https://issues.apache.org/jira/browse/SPARK-21371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081585#comment-16081585 ] Apache Spark commented on SPARK-21371: -- User 'liu-zhaokun' has created a pull request for this

[jira] [Resolved] (SPARK-21043) Add unionByName API to Dataset

[ https://issues.apache.org/jira/browse/SPARK-21043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21043. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.3.0 > Add unionByName API

[jira] [Closed] (SPARK-21370) Avoid doing anything on HDFSBackedStateStore.abort() when there are no updates to commit

[ https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz closed SPARK-21370. --- Resolution: Not A Problem > Avoid doing anything on HDFSBackedStateStore.abort() when there are no

[jira] [Updated] (SPARK-20604) Allow Imputer to handle all numeric types

[ https://issues.apache.org/jira/browse/SPARK-20604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20604: -- Issue Type: Improvement (was: Bug) > Allow Imputer to handle all numeric types >

[jira] [Updated] (SPARK-21241) Add intercept to StreamingLinearRegressionWithSGD

[ https://issues.apache.org/jira/browse/SPARK-21241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-21241: -- Issue Type: New Feature (was: Bug) > Add intercept to

[jira] [Commented] (SPARK-20133) User guide for spark.ml.stat.ChiSquareTest

[ https://issues.apache.org/jira/browse/SPARK-20133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081503#comment-16081503 ] Joseph K. Bradley commented on SPARK-20133: --- Sorry for the slow response; please feel free to!

[jira] [Updated] (SPARK-21370) Avoid doing anything on HDFSBackedStateStore.abort() when there are no updates to commit

[ https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-21370: -- Priority: Minor (was: Major) > Avoid doing anything on HDFSBackedStateStore.abort() when

[jira] [Commented] (SPARK-21359) frequency discretizer

[ https://issues.apache.org/jira/browse/SPARK-21359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081467#comment-16081467 ] Fu Shanshan commented on SPARK-21359: - but why in the example: Array((0, 18.0), (1, 19.0), (2, 8.0),

[jira] [Commented] (SPARK-21086) CrossValidator, TrainValidationSplit should preserve all models after fitting

[ https://issues.apache.org/jira/browse/SPARK-21086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081500#comment-16081500 ] Joseph K. Bradley commented on SPARK-21086: --- I like the idea for that path, but it could become

[jira] [Resolved] (SPARK-21358) Argument of repartitionandsortwithinpartitions at pyspark

[ https://issues.apache.org/jira/browse/SPARK-21358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-21358. - Resolution: Fixed Assignee: chie hayashida Fix Version/s: 2.3.0 > Argument of

[jira] [Commented] (SPARK-21341) Spark 2.1.1: I want to be able to serialize wordVectors on Word2VecModel

[ https://issues.apache.org/jira/browse/SPARK-21341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081483#comment-16081483 ] Joseph K. Bradley commented on SPARK-21341: --- +1 for the built-in save/load. Saving as an

[jira] [Updated] (SPARK-21208) Ability to "setLocalProperty" from sc, in sparkR

[ https://issues.apache.org/jira/browse/SPARK-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-21208: -- Issue Type: New Feature (was: Bug) > Ability to "setLocalProperty" from sc, in sparkR

[jira] [Resolved] (SPARK-21341) Spark 2.1.1: I want to be able to serialize wordVectors on Word2VecModel

[ https://issues.apache.org/jira/browse/SPARK-21341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-21341. --- Resolution: Not A Problem > Spark 2.1.1: I want to be able to serialize wordVectors

[jira] [Resolved] (SPARK-21364) IndexOutOfBoundsException on equality check of two complex array elements

[ https://issues.apache.org/jira/browse/SPARK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21364. -- Resolution: Cannot Reproduce I can't reproduce this against the current master by the same

[jira] [Updated] (SPARK-21370) Avoid doing anything on HDFSBackedStateStore.abort() when there are no updates to commit

[ https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-21370: -- Description: Currently the HDFSBackedStateStore sets it's state as UPDATING as it is

[jira] [Updated] (SPARK-21370) Avoid doing anything on HDFSBackedStateStore.abort() when there are no updates to commit

[ https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-21370: -- Summary: Avoid doing anything on HDFSBackedStateStore.abort() when there are no updates to

[jira] [Created] (SPARK-21370) Clarify In-Memory State Store purpose (read-only, read-write) with an additional state

Burak Yavuz created SPARK-21370: --- Summary: Clarify In-Memory State Store purpose (read-only, read-write) with an additional state Key: SPARK-21370 URL: https://issues.apache.org/jira/browse/SPARK-21370

[jira] [Commented] (SPARK-21349) Make TASK_SIZE_TO_WARN_KB configurable

[ https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081431#comment-16081431 ] Wenchen Fan commented on SPARK-21349: - [~rxin] that only helps with internal accumulators, but seems

[jira] [Commented] (SPARK-21370) Clarify In-Memory State Store purpose (read-only, read-write) with an additional state

[ https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081436#comment-16081436 ] Apache Spark commented on SPARK-21370: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21370) Clarify In-Memory State Store purpose (read-only, read-write) with an additional state

[ https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21370: Assignee: Burak Yavuz (was: Apache Spark) > Clarify In-Memory State Store purpose

[jira] [Assigned] (SPARK-21370) Clarify In-Memory State Store purpose (read-only, read-write) with an additional state

[ https://issues.apache.org/jira/browse/SPARK-21370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21370: Assignee: Apache Spark (was: Burak Yavuz) > Clarify In-Memory State Store purpose

[jira] [Assigned] (SPARK-20904) Task failures during shutdown cause problems with preempted executors

[ https://issues.apache.org/jira/browse/SPARK-20904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20904: Assignee: Apache Spark > Task failures during shutdown cause problems with preempted

[jira] [Commented] (SPARK-20904) Task failures during shutdown cause problems with preempted executors

[ https://issues.apache.org/jira/browse/SPARK-20904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081404#comment-16081404 ] Apache Spark commented on SPARK-20904: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20904) Task failures during shutdown cause problems with preempted executors

[ https://issues.apache.org/jira/browse/SPARK-20904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20904: Assignee: (was: Apache Spark) > Task failures during shutdown cause problems with

[jira] [Commented] (SPARK-21362) Add JDBCDialect for Apache Drill

[ https://issues.apache.org/jira/browse/SPARK-21362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081377#comment-16081377 ] Dongjoon Hyun commented on SPARK-21362: --- Hi, [~radford1] Usually, in Spark community, *Assiginee*

[jira] [Updated] (SPARK-20920) ForkJoinPool pools are leaked when writing hive tables with many partitions

[ https://issues.apache.org/jira/browse/SPARK-20920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20920: Fix Version/s: (was: 2.3.0) > ForkJoinPool pools are leaked when writing hive tables with many

[jira] [Updated] (SPARK-21059) LikeSimplification can NPE on null pattern

[ https://issues.apache.org/jira/browse/SPARK-21059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21059: Fix Version/s: (was: 2.3.0) > LikeSimplification can NPE on null pattern >

[jira] [Updated] (SPARK-21079) ANALYZE TABLE fails to calculate totalSize for a partitioned table

[ https://issues.apache.org/jira/browse/SPARK-21079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21079: Labels: (was: easyfix) > ANALYZE TABLE fails to calculate totalSize for a partitioned table >

[jira] [Resolved] (SPARK-17196) Can not initializeing SparkConent plus Kerberos env

[ https://issues.apache.org/jira/browse/SPARK-17196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-17196. Resolution: Invalid There's not a whole lot of information here, but from the fact that

[jira] [Commented] (SPARK-20394) Replication factor value Not changing properly

[ https://issues.apache.org/jira/browse/SPARK-20394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081318#comment-16081318 ] Marcelo Vanzin commented on SPARK-20394: Have you tried setting the replication to 1 in your

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081206#comment-16081206 ] shane knapp commented on SPARK-21367: - reverting now. > R older version of Roxygen2 on Jenkins >

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081274#comment-16081274 ] Dongjoon Hyun commented on SPARK-21367: --- Thank you, [~shaneknapp]. It seems to be `Had CRAN check

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081230#comment-16081230 ] shane knapp commented on SPARK-21367: - shiv: some of the builds that launched post-upgrade were

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081226#comment-16081226 ] shane knapp commented on SPARK-21367: - ill take a closer look at this tomorrow. > R older version of

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081223#comment-16081223 ] Shivaram Venkataraman commented on SPARK-21367: --- [~dongjoon] Do you have a particular

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081220#comment-16081220 ] shane knapp commented on SPARK-21367: - reverted > R older version of Roxygen2 on Jenkins >

[jira] [Reopened] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp reopened SPARK-21367: - > R older version of Roxygen2 on Jenkins > -- > >

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081173#comment-16081173 ] Dongjoon Hyun commented on SPARK-21367: --- Hi, All. After this, many builds seems to fail

[jira] [Closed] (SPARK-17044) Add window function test in SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-17044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-17044. - Resolution: Duplicate > Add window function test in SQLQueryTestSuite >

[jira] [Reopened] (SPARK-17044) Add window function test in SQLQueryTestSuite

[ https://issues.apache.org/jira/browse/SPARK-17044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-17044: --- > Add window function test in SQLQueryTestSuite > -

[jira] [Comment Edited] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081173#comment-16081173 ] Dongjoon Hyun edited comment on SPARK-21367 at 7/10/17 9:21 PM: Hi, All.

[jira] [Commented] (SPARK-21289) Text and CSV formats do not support custom end-of-line delimiters

[ https://issues.apache.org/jira/browse/SPARK-21289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081136#comment-16081136 ] Andrew Ash commented on SPARK-21289: Looks like this will fix SPARK-17227 also > Text and CSV

[jira] [Commented] (SPARK-21369) Don't use Scala classes in external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-21369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081113#comment-16081113 ] Apache Spark commented on SPARK-21369: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-21067) Thrift Server - CTAS fail with Unable to move source

[ https://issues.apache.org/jira/browse/SPARK-21067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080503#comment-16080503 ] Dominic Ricard edited comment on SPARK-21067 at 7/10/17 9:04 PM: -

[jira] [Closed] (SPARK-15226) CSV file data-line with newline at first line load error

[ https://issues.apache.org/jira/browse/SPARK-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash closed SPARK-15226. -- Resolution: Fixed Fix Version/s: 2.2.0 Fixed by Fixed by

[jira] [Comment Edited] (SPARK-15226) CSV file data-line with newline at first line load error

[ https://issues.apache.org/jira/browse/SPARK-15226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081154#comment-16081154 ] Andrew Ash edited comment on SPARK-15226 at 7/10/17 9:07 PM: - Fixed by

[jira] [Commented] (SPARK-20263) create empty dataframes in sparkR

[ https://issues.apache.org/jira/browse/SPARK-20263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081126#comment-16081126 ] Grishma Jena commented on SPARK-20263: -- [~otoomet] Have you tried creating a Spark dataframe with a

[jira] [Commented] (SPARK-21349) Make TASK_SIZE_TO_WARN_KB configurable

[ https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081128#comment-16081128 ] Reynold Xin commented on SPARK-21349: - cc [~cloud_fan] Shouldn't task metric just be a single

[jira] [Updated] (SPARK-21369) Don't use Scala classes in external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-21369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-21369: - Description: Right now the external shuffle service uses Scala Tuple2. However, the Scala

[jira] [Updated] (SPARK-21369) Don't use Scala classes in external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-21369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-21369: - Description: Right now the external shuffle service uses Scala Tuple2. However, the Scala

[jira] [Assigned] (SPARK-21369) Don't use Scala classes in external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-21369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21369: Assignee: Shixiong Zhu (was: Apache Spark) > Don't use Scala classes in external shuffle

[jira] [Assigned] (SPARK-21369) Don't use Scala classes in external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-21369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21369: Assignee: Apache Spark (was: Shixiong Zhu) > Don't use Scala classes in external shuffle

[jira] [Created] (SPARK-21369) Don't use Scala classes in external shuffle service

Shixiong Zhu created SPARK-21369: Summary: Don't use Scala classes in external shuffle service Key: SPARK-21369 URL: https://issues.apache.org/jira/browse/SPARK-21369 Project: Spark Issue

[jira] [Commented] (SPARK-21364) IndexOutOfBoundsException on equality check of two complex array elements

[ https://issues.apache.org/jira/browse/SPARK-21364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080963#comment-16080963 ] Kazuaki Ishizaki commented on SPARK-21364: -- When I ran the following test case that is derived

[jira] [Resolved] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp resolved SPARK-21367. - Resolution: Fixed > R older version of Roxygen2 on Jenkins >

[jira] [Commented] (SPARK-21349) Make TASK_SIZE_TO_WARN_KB configurable

[ https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080890#comment-16080890 ] Dongjoon Hyun commented on SPARK-21349: --- Thank you, [~shivaram] and @Kay Ousterhout. Okay. It looks

[jira] [Comment Edited] (SPARK-21349) Make TASK_SIZE_TO_WARN_KB configurable

[ https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080890#comment-16080890 ] Dongjoon Hyun edited comment on SPARK-21349 at 7/10/17 7:04 PM: Thank

[jira] [Assigned] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp reassigned SPARK-21367: --- Assignee: shane knapp > R older version of Roxygen2 on Jenkins >

[jira] [Commented] (SPARK-21349) Make TASK_SIZE_TO_WARN_KB configurable

[ https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080875#comment-16080875 ] Shivaram Venkataraman commented on SPARK-21349: --- Well 100K is already too large IMHO and

[jira] [Commented] (SPARK-21368) TPCDSQueryBenchmark can't refer query files.

[ https://issues.apache.org/jira/browse/SPARK-21368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080857#comment-16080857 ] Apache Spark commented on SPARK-21368: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-21349) Make TASK_SIZE_TO_WARN_KB configurable

[ https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080817#comment-16080817 ] Dongjoon Hyun commented on SPARK-21349: --- I usually saw 200K~300K. And, the following is our

[jira] [Assigned] (SPARK-21368) TPCDSQueryBenchmark can't refer query files.

[ https://issues.apache.org/jira/browse/SPARK-21368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21368: Assignee: Apache Spark > TPCDSQueryBenchmark can't refer query files. >

[jira] [Assigned] (SPARK-21368) TPCDSQueryBenchmark can't refer query files.

[ https://issues.apache.org/jira/browse/SPARK-21368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21368: Assignee: (was: Apache Spark) > TPCDSQueryBenchmark can't refer query files. >

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080827#comment-16080827 ] shane knapp commented on SPARK-21367: - copy that. installing this version now... > R older version

[jira] [Created] (SPARK-21368) TPCDSQueryBenchmark can't refer query files.

Kousuke Saruta created SPARK-21368: -- Summary: TPCDSQueryBenchmark can't refer query files. Key: SPARK-21368 URL: https://issues.apache.org/jira/browse/SPARK-21368 Project: Spark Issue Type:

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080830#comment-16080830 ] shane knapp commented on SPARK-21367: - ...and this is done. > R older version of Roxygen2 on Jenkins

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080826#comment-16080826 ] Shivaram Venkataraman commented on SPARK-21367: --- I just checked the transitive dependencies

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080801#comment-16080801 ] shane knapp commented on SPARK-21367: - we haven't ever explicitly installed any version of Roxygen2,

[jira] [Commented] (SPARK-21362) Add JDBCDialect for Apache Drill

[ https://issues.apache.org/jira/browse/SPARK-21362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080810#comment-16080810 ] David Radford commented on SPARK-21362: --- I'm planning to work on this but cannot assign myself the

[jira] [Commented] (SPARK-21349) Make TASK_SIZE_TO_WARN_KB configurable

[ https://issues.apache.org/jira/browse/SPARK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080789#comment-16080789 ] Kay Ousterhout commented on SPARK-21349: Out of curiosity, what are the task sizes that you're

[jira] [Assigned] (SPARK-21366) Add sql test for window functions

[ https://issues.apache.org/jira/browse/SPARK-21366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21366: Assignee: (was: Apache Spark) > Add sql test for window functions >

[jira] [Commented] (SPARK-21366) Add sql test for window functions

[ https://issues.apache.org/jira/browse/SPARK-21366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080720#comment-16080720 ] Apache Spark commented on SPARK-21366: -- User 'jiangxb1987' has created a pull request for this

[jira] [Updated] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21367: - Description: Getting this message from a recent build.

[jira] [Comment Edited] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080728#comment-16080728 ] Felix Cheung edited comment on SPARK-21367 at 7/10/17 5:45 PM: ---

[jira] [Commented] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080728#comment-16080728 ] Felix Cheung commented on SPARK-21367: -- @shane knapp could you check? thanks! > R older version of

[jira] [Comment Edited] (SPARK-21367) R older version of Roxygen2 on Jenkins

[ https://issues.apache.org/jira/browse/SPARK-21367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080728#comment-16080728 ] Felix Cheung edited comment on SPARK-21367 at 7/10/17 5:44 PM: --- ~shane

[jira] [Created] (SPARK-21366) Add sql test for window functions

Jiang Xingbo created SPARK-21366: Summary: Add sql test for window functions Key: SPARK-21366 URL: https://issues.apache.org/jira/browse/SPARK-21366 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-21367) R older version of Roxygen2 on Jenkins

Felix Cheung created SPARK-21367: Summary: R older version of Roxygen2 on Jenkins Key: SPARK-21367 URL: https://issues.apache.org/jira/browse/SPARK-21367 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-21266) Support schema a DDL-formatted string in dapply/gapply/from_json

[ https://issues.apache.org/jira/browse/SPARK-21266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21266. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

[jira] [Assigned] (SPARK-21366) Add sql test for window functions

[ https://issues.apache.org/jira/browse/SPARK-21366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21366: Assignee: Apache Spark > Add sql test for window functions >

[jira] [Assigned] (SPARK-21365) Deduplicate logics parsing DDL-like type definition

[ https://issues.apache.org/jira/browse/SPARK-21365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21365: Assignee: (was: Apache Spark) > Deduplicate logics parsing DDL-like type definition >

[jira] [Assigned] (SPARK-21365) Deduplicate logics parsing DDL-like type definition

[ https://issues.apache.org/jira/browse/SPARK-21365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21365: Assignee: Apache Spark > Deduplicate logics parsing DDL-like type definition >

[jira] [Commented] (SPARK-21365) Deduplicate logics parsing DDL-like type definition

[ https://issues.apache.org/jira/browse/SPARK-21365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080665#comment-16080665 ] Apache Spark commented on SPARK-21365: -- User 'HyukjinKwon' has created a pull request for this

  1   2   >