[jira] [Commented] (SPARK-12154) Upgrade to Jersey 2

[ https://issues.apache.org/jira/browse/SPARK-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126818#comment-15126818 ] Matt Cheah commented on SPARK-12154: I can look at this next week! > Upgrade to Jersey 2 >

[jira] [Assigned] (SPARK-10820) Initial infrastructure

[ https://issues.apache.org/jira/browse/SPARK-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-10820: Assignee: Michael Armbrust > Initial infrastructure > -- > >

[jira] [Commented] (SPARK-13011) K-means wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-13011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126885#comment-15126885 ] Xusen Yin commented on SPARK-13011: --- Thanks! I've already worked on it. > K-means wrapper in SparkR >

[jira] [Updated] (SPARK-13119) SparkR Ser/De fail to handle "columns(df)"

[ https://issues.apache.org/jira/browse/SPARK-13119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xusen Yin updated SPARK-13119: -- Description: When I want to extract names of columns of a DataFrame for

[jira] [Commented] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126976#comment-15126976 ] Deenar Toraskar commented on SPARK-13101: - [~lian cheng] Thanks for the explanation now makes

[jira] [Updated] (SPARK-13094) Dataset Aggregators do not work with complex types

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13094: - Description: Dataset aggregators with complex types fail with unable to find encoder for

[jira] [Resolved] (SPARK-12465) Remove spark.deploy.mesos.zookeeper.dir and use spark.deploy.zookeeper.dir

[ https://issues.apache.org/jira/browse/SPARK-12465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12465. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Remove

[jira] [Commented] (SPARK-13094) Dataset Aggregators do not work with complex types

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126996#comment-15126996 ] Michael Armbrust commented on SPARK-13094: -- Sorry, I'm looking at this closer now. The problem

[jira] [Updated] (SPARK-10749) Support multiple roles with Spark Mesos dispatcher

[ https://issues.apache.org/jira/browse/SPARK-10749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10749: -- Assignee: Timothy Chen > Support multiple roles with Spark Mesos dispatcher >

[jira] [Updated] (SPARK-10749) Support multiple roles with Spark Mesos dispatcher

[ https://issues.apache.org/jira/browse/SPARK-10749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10749: -- Target Version/s: 2.0.0 > Support multiple roles with Spark Mesos dispatcher >

[jira] [Resolved] (SPARK-12265) Spark calls System.exit inside driver instead of throwing exception

[ https://issues.apache.org/jira/browse/SPARK-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12265. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Spark calls

[jira] [Resolved] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-6847. -- Resolution: Fixed Fix Version/s: 2.0.0 > Stack overflow on updateStateByKey which followed by a

[jira] [Updated] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6847: - Target Version/s: 2.0.0 > Stack overflow on updateStateByKey which followed by a dstream with >

[jira] [Updated] (SPARK-10820) Initial infrastructure

[ https://issues.apache.org/jira/browse/SPARK-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10820: - Summary: Initial infrastructure (was: Physical plan: determine physical operators

[jira] [Resolved] (SPARK-10777) order by fails when column is aliased and projection includes windowed aggregate

[ https://issues.apache.org/jira/browse/SPARK-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10777. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10678

[jira] [Updated] (SPARK-13087) Grouping by a complex expression may lead to incorrect AttributeReferences in aggregations

[ https://issues.apache.org/jira/browse/SPARK-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13087: - Priority: Critical (was: Major) > Grouping by a complex expression may lead to

[jira] [Commented] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127021#comment-15127021 ] Cheng Lian commented on SPARK-13101: [~deenar] Just had an offline discussion with [~marmbrus] and

[jira] [Assigned] (SPARK-12126) JDBC datasource processes filters only commonly pushed down.

[ https://issues.apache.org/jira/browse/SPARK-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12126: Assignee: (was: Apache Spark) > JDBC datasource processes filters only commonly

[jira] [Created] (SPARK-13116) TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows

Asif Hussain Shahid created SPARK-13116: --- Summary: TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows Key: SPARK-13116 URL:

[jira] [Commented] (SPARK-12506) Push down WHERE clause arithmetic operator to JDBC layer

[ https://issues.apache.org/jira/browse/SPARK-12506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126788#comment-15126788 ] Apache Spark commented on SPARK-12506: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-13009) spark-streaming-twitter_2.10 does not make it possible to access the raw twitter json

[ https://issues.apache.org/jira/browse/SPARK-13009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126936#comment-15126936 ] Andrew Davidson commented on SPARK-13009: - Agreed. they ask me to file a spark RFE. I post your

[jira] [Commented] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126982#comment-15126982 ] Deenar Toraskar commented on SPARK-13101: - [~lian cheng] [~joshrosen] [~marmbrus] Alternatively

[jira] [Updated] (SPARK-13094) No encoder implicits for Seq[Primitive]

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13094: - Summary: No encoder implicits for Seq[Primitive] (was: Dataset Aggregators do not work

[jira] [Updated] (SPARK-13094) Dataset Aggregators do not work with complex types

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13094: - Issue Type: Improvement (was: Bug) > Dataset Aggregators do not work with complex types

[jira] [Commented] (SPARK-12126) JDBC datasource processes filters only commonly pushed down.

[ https://issues.apache.org/jira/browse/SPARK-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126789#comment-15126789 ] Apache Spark commented on SPARK-12126: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126890#comment-15126890 ] Cheng Lian commented on SPARK-13101: I think this is expected behavior. The problem in snippet

[jira] [Commented] (SPARK-13117) WebUI should use the local ip not 0.0.0.0

[ https://issues.apache.org/jira/browse/SPARK-13117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126892#comment-15126892 ] Josh Rosen commented on SPARK-13117: Would you like to submit a patch for this? > WebUI should use

[jira] [Created] (SPARK-13118) Support for classes defined in package objects

Michael Armbrust created SPARK-13118: Summary: Support for classes defined in package objects Key: SPARK-13118 URL: https://issues.apache.org/jira/browse/SPARK-13118 Project: Spark Issue

[jira] [Resolved] (SPARK-12705) Sorting column can't be resolved if it's not in projection

[ https://issues.apache.org/jira/browse/SPARK-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12705. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10678

[jira] [Commented] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126928#comment-15126928 ] Shixiong Zhu commented on SPARK-6847: - As my PR changed internal semantics, it's only merged to master

[jira] [Commented] (SPARK-13083) Small spark sql queries get blocked if there is a long running query over a lot a partitions

[ https://issues.apache.org/jira/browse/SPARK-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126954#comment-15126954 ] Michael Armbrust commented on SPARK-13083: -- The other possibility is that you are blocking the

[jira] [Commented] (SPARK-13119) SparkR Ser/De fail to handle "columns(df)"

[ https://issues.apache.org/jira/browse/SPARK-13119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126974#comment-15126974 ] Xusen Yin commented on SPARK-13119: --- [~mengxr] [~shivaram] Please help me checking it. I don't have a

[jira] [Resolved] (SPARK-12463) Remove spark.deploy.mesos.recoveryMode and use spark.deploy.recoveryMode

[ https://issues.apache.org/jira/browse/SPARK-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12463. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Remove

[jira] [Resolved] (SPARK-12464) Remove spark.deploy.mesos.zookeeper.url and use spark.deploy.zookeeper.url

[ https://issues.apache.org/jira/browse/SPARK-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12464. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Remove

[jira] [Resolved] (SPARK-10647) Mesos HA mode misuses spark.deploy.zookeeper.dir property; configs should be documented

[ https://issues.apache.org/jira/browse/SPARK-10647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10647. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > Mesos HA mode

[jira] [Commented] (SPARK-12715) Improve test coverage

[ https://issues.apache.org/jira/browse/SPARK-12715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126825#comment-15126825 ] Reynold Xin commented on SPARK-12715: - I think [~hvanhovell] looked into it and didn't find parser

[jira] [Commented] (SPARK-13011) K-means wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-13011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126865#comment-15126865 ] Xiangrui Meng commented on SPARK-13011: --- Assigned. Thanks for taking this task! > K-means wrapper

[jira] [Updated] (SPARK-13011) K-means wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-13011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13011: -- Assignee: Xusen Yin > K-means wrapper in SparkR > - > >

[jira] [Commented] (SPARK-13083) Small spark sql queries get blocked if there is a long running query over a lot a partitions

[ https://issues.apache.org/jira/browse/SPARK-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126905#comment-15126905 ] Michael Armbrust commented on SPARK-13083: -- You need to also ensure the queries are running in

[jira] [Reopened] (SPARK-13083) Small spark sql queries get blocked if there is a long running query over a lot a partitions

[ https://issues.apache.org/jira/browse/SPARK-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishal Gupta reopened SPARK-13083: -- But the scheduling mode within the "default" pool is FAIR. So both the jobs being submitted to

[jira] [Comment Edited] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127021#comment-15127021 ] Cheng Lian edited comment on SPARK-13101 at 2/1/16 9:03 PM: [~deenar] Just

[jira] [Comment Edited] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127021#comment-15127021 ] Cheng Lian edited comment on SPARK-13101 at 2/1/16 9:02 PM: [~deenar] Just

[jira] [Created] (SPARK-13117) WebUI should use the local ip not 0.0.0.0

Jeremiah Jordan created SPARK-13117: --- Summary: WebUI should use the local ip not 0.0.0.0 Key: SPARK-13117 URL: https://issues.apache.org/jira/browse/SPARK-13117 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-12989) Bad interaction between StarExpansion and ExtractWindowExpressions

[ https://issues.apache.org/jira/browse/SPARK-12989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12989. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved

[jira] [Commented] (SPARK-12731) PySpark docstring cleanup

[ https://issues.apache.org/jira/browse/SPARK-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126886#comment-15126886 ] Bryan Cutler commented on SPARK-12731: -- Just to add my 2cents since I've been working on a similar

[jira] [Commented] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126894#comment-15126894 ] Cheng Lian commented on SPARK-13101: [~deenar] I also tried the last two snippets and they both work.

[jira] [Commented] (SPARK-13065) streaming-twitter pass twitter4j.FilterQuery argument to TwitterUtils.createStream()

[ https://issues.apache.org/jira/browse/SPARK-13065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126931#comment-15126931 ] Andrew Davidson commented on SPARK-13065: - Thanks Sachin I do not know Scala. As a temporary

[jira] [Commented] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126932#comment-15126932 ] Cheng Lian commented on SPARK-13101: The reason why 1.6.0 allows this illegal situation is that we

[jira] [Issue Comment Deleted] (SPARK-13083) Small spark sql queries get blocked if there is a long running query over a lot a partitions

[ https://issues.apache.org/jira/browse/SPARK-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishal Gupta updated SPARK-13083: - Comment: was deleted (was: But the scheduling mode within the "default" pool is FAIR. So both

[jira] [Updated] (SPARK-12265) Spark calls System.exit inside driver instead of throwing exception

[ https://issues.apache.org/jira/browse/SPARK-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12265: -- Assignee: Iulian Dragos > Spark calls System.exit inside driver instead of throwing exception >

[jira] [Assigned] (SPARK-12126) JDBC datasource processes filters only commonly pushed down.

[ https://issues.apache.org/jira/browse/SPARK-12126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12126: Assignee: Apache Spark > JDBC datasource processes filters only commonly pushed down. >

[jira] [Assigned] (SPARK-10820) Initial infrastructure

[ https://issues.apache.org/jira/browse/SPARK-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10820: Assignee: Apache Spark > Initial infrastructure > -- > >

[jira] [Assigned] (SPARK-10820) Initial infrastructure

[ https://issues.apache.org/jira/browse/SPARK-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10820: Assignee: (was: Apache Spark) > Initial infrastructure > -- > >

[jira] [Commented] (SPARK-10820) Initial infrastructure

[ https://issues.apache.org/jira/browse/SPARK-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126815#comment-15126815 ] Apache Spark commented on SPARK-10820: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Resolved] (SPARK-13083) Small spark sql queries get blocked if there is a long running query over a lot a partitions

[ https://issues.apache.org/jira/browse/SPARK-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13083. -- Resolution: Not A Problem Assignee: Michael Armbrust > Small spark sql queries

[jira] [Commented] (SPARK-13116) TungstenAggregate though it is supposedly capable of all processing unsafe & safe rows, fails if the input is safe rows

[ https://issues.apache.org/jira/browse/SPARK-13116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126947#comment-15126947 ] Asif Hussain Shahid commented on SPARK-13116: - This issue surfaces when the TungstenAggregate

[jira] [Comment Edited] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126894#comment-15126894 ] Cheng Lian edited comment on SPARK-13101 at 2/1/16 7:45 PM: [~deenar] I also

[jira] [Comment Edited] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126890#comment-15126890 ] Cheng Lian edited comment on SPARK-13101 at 2/1/16 7:55 PM: I think this is

[jira] [Resolved] (SPARK-11780) Provide type aliases in org.apache.spark.sql.types for backwards compatibility

[ https://issues.apache.org/jira/browse/SPARK-11780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11780. -- Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 10915

[jira] [Commented] (SPARK-13083) Small spark sql queries get blocked if there is a long running query over a lot a partitions

[ https://issues.apache.org/jira/browse/SPARK-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126943#comment-15126943 ] Vishal Gupta commented on SPARK-13083: -- But the scheduling mode within the "default" pool is FAIR.

[jira] [Updated] (SPARK-12832) Mesos cluster mode should handle constraints

[ https://issues.apache.org/jira/browse/SPARK-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12832: -- Summary: Mesos cluster mode should handle constraints (was: spark on mesos dispacher need a

[jira] [Created] (SPARK-13121) java mapWithState mishandles scala Option

Gabriele Nizzoli created SPARK-13121: Summary: java mapWithState mishandles scala Option Key: SPARK-13121 URL: https://issues.apache.org/jira/browse/SPARK-13121 Project: Spark Issue

[jira] [Updated] (SPARK-12265) Spark calls System.exit inside driver instead of throwing exception

[ https://issues.apache.org/jira/browse/SPARK-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12265: -- Assignee: Nilanjan Raychaudhuri (was: Iulian Dragos) > Spark calls System.exit inside driver instead

[jira] [Commented] (SPARK-13103) HashTF dosn't count TF correctly

[ https://issues.apache.org/jira/browse/SPARK-13103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127130#comment-15127130 ] holdenk commented on SPARK-13103: - I don't think this is unique to chinese (e.g. the hash of the word

[jira] [Resolved] (SPARK-13078) Create internal catalog API

[ https://issues.apache.org/jira/browse/SPARK-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13078. - Resolution: Fixed Fix Version/s: 2.0.0 > Create internal catalog API >

[jira] [Commented] (SPARK-12874) ML StringIndexer does not protect itself from column name duplication

[ https://issues.apache.org/jira/browse/SPARK-12874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127242#comment-15127242 ] holdenk commented on SPARK-12874: - So inside of the validateAndTransformSchema function in StringIndexer

[jira] [Assigned] (SPARK-13120) Shade protobuf-java

[ https://issues.apache.org/jira/browse/SPARK-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13120: Assignee: Apache Spark > Shade protobuf-java > --- > >

[jira] [Commented] (SPARK-13120) Shade protobuf-java

[ https://issues.apache.org/jira/browse/SPARK-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127106#comment-15127106 ] Apache Spark commented on SPARK-13120: -- User 'tedyu' has created a pull request for this issue:

[jira] [Created] (SPARK-13120) Shade protobuf-java

Ted Yu created SPARK-13120: -- Summary: Shade protobuf-java Key: SPARK-13120 URL: https://issues.apache.org/jira/browse/SPARK-13120 Project: Spark Issue Type: Improvement Components: Build

[jira] [Assigned] (SPARK-13120) Shade protobuf-java

[ https://issues.apache.org/jira/browse/SPARK-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13120: Assignee: (was: Apache Spark) > Shade protobuf-java > --- > >

[jira] [Resolved] (SPARK-13043) Support remaining types in ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-13043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13043. - Resolution: Fixed Assignee: Nong Li Fix Version/s: 2.0.0 > Support remaining

[jira] [Commented] (SPARK-13084) Utilize @SerialVersionUID to avoid local class incompatibility

[ https://issues.apache.org/jira/browse/SPARK-13084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127142#comment-15127142 ] holdenk commented on SPARK-13084: - Looking at the mailing list this seems to be coming from trying to run

[jira] [Commented] (SPARK-13059) Sort inputsplits by size in HadoopRDD to avoid long tails

[ https://issues.apache.org/jira/browse/SPARK-13059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127153#comment-15127153 ] holdenk commented on SPARK-13059: - This sounds interesting - although having first() and take(1) still

[jira] [Commented] (SPARK-12729) phantom references to replace the finalize call in python broadcast

[ https://issues.apache.org/jira/browse/SPARK-12729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127164#comment-15127164 ] Gayathri Murali commented on SPARK-12729: - I can work on this, if no one else is. > phantom

[jira] [Resolved] (SPARK-13084) Utilize @SerialVersionUID to avoid local class incompatibility

[ https://issues.apache.org/jira/browse/SPARK-13084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-13084. Resolution: Won't Fix > Utilize @SerialVersionUID to avoid local class incompatibility >

[jira] [Assigned] (SPARK-13121) java mapWithState mishandles scala Option

[ https://issues.apache.org/jira/browse/SPARK-13121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13121: Assignee: Apache Spark > java mapWithState mishandles scala Option >

[jira] [Commented] (SPARK-13121) java mapWithState mishandles scala Option

[ https://issues.apache.org/jira/browse/SPARK-13121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127234#comment-15127234 ] Apache Spark commented on SPARK-13121: -- User 'gabrielenizzoli' has created a pull request for this

[jira] [Assigned] (SPARK-13121) java mapWithState mishandles scala Option

[ https://issues.apache.org/jira/browse/SPARK-13121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13121: Assignee: (was: Apache Spark) > java mapWithState mishandles scala Option >

[jira] [Commented] (SPARK-12729) phantom references to replace the finalize call in python broadcast

[ https://issues.apache.org/jira/browse/SPARK-12729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127247#comment-15127247 ] Reynold Xin commented on SPARK-12729: - Go for it. Just do it against Spark master branch. >

[jira] [Commented] (SPARK-13119) SparkR Ser/De fail to handle "columns(df)"

[ https://issues.apache.org/jira/browse/SPARK-13119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127093#comment-15127093 ] Shivaram Venkataraman commented on SPARK-13119: --- cc [~sunrui] Thanks [~yinxusen] -- I'll

[jira] [Commented] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127179#comment-15127179 ] holdenk commented on SPARK-13048: - This sounds useful, although we probably wouldn't want to always leave

[jira] [Comment Edited] (SPARK-13048) EMLDAOptimizer deletes dependent checkpoint of DistributedLDAModel

[ https://issues.apache.org/jira/browse/SPARK-13048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127179#comment-15127179 ] holdenk edited comment on SPARK-13048 at 2/1/16 10:43 PM: -- This sounds useful,

[jira] [Commented] (SPARK-12423) Mesos executor home should not be resolved on the driver's file system

[ https://issues.apache.org/jira/browse/SPARK-12423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127083#comment-15127083 ] Andrew Or commented on SPARK-12423: --- Is this resolved then now that its duplicate is resolved? > Mesos

[jira] [Commented] (SPARK-13094) No encoder implicits for Seq[Primitive]

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127081#comment-15127081 ] Deenar Toraskar commented on SPARK-13094: - [~marmbrus] thanks for looking into this. Look forward

[jira] [Resolved] (SPARK-12979) Paths are resolved relative to the local file system

[ https://issues.apache.org/jira/browse/SPARK-12979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12979. --- Resolution: Fixed Assignee: Iulian Dragos Fix Version/s: 2.0.0 Target

[jira] [Closed] (SPARK-12958) Map accumulator in spark

[ https://issues.apache.org/jira/browse/SPARK-12958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Souri closed SPARK-12958. - It was decided that its not something in very high demand right now and users who want it can manage it themselves,

[jira] [Updated] (SPARK-11638) Run Spark on Mesos with bridge networking

[ https://issues.apache.org/jira/browse/SPARK-11638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11638: -- Summary: Run Spark on Mesos with bridge networking (was: Apache Spark in Docker with Bridge

[jira] [Comment Edited] (SPARK-12729) phantom references to replace the finalize call in python broadcast

[ https://issues.apache.org/jira/browse/SPARK-12729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127164#comment-15127164 ] Gayathri Murali edited comment on SPARK-12729 at 2/1/16 11:28 PM: -- I can

[jira] [Assigned] (SPARK-13123) Add wholestage codegen for sort

[ https://issues.apache.org/jira/browse/SPARK-13123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13123: Assignee: (was: Apache Spark) > Add wholestage codegen for sort >

[jira] [Commented] (SPARK-13123) Add wholestage codegen for sort

[ https://issues.apache.org/jira/browse/SPARK-13123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127332#comment-15127332 ] Apache Spark commented on SPARK-13123: -- User 'nongli' has created a pull request for this issue:

[jira] [Commented] (SPARK-12987) Drop fails when columns contain dots

[ https://issues.apache.org/jira/browse/SPARK-12987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127349#comment-15127349 ] kevin yu commented on SPARK-12987: -- @thomas @jayadevan: Are you still working on this problem? I was

[jira] [Assigned] (SPARK-12987) Drop fails when columns contain dots

[ https://issues.apache.org/jira/browse/SPARK-12987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12987: Assignee: (was: Apache Spark) > Drop fails when columns contain dots >

[jira] [Updated] (SPARK-13087) Grouping by a complex expression may lead to incorrect AttributeReferences in aggregations

[ https://issues.apache.org/jira/browse/SPARK-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13087: - Affects Version/s: 2.0.0 > Grouping by a complex expression may lead to incorrect

[jira] [Commented] (SPARK-13094) No encoder implicits for Seq[Primitive]

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127425#comment-15127425 ] Apache Spark commented on SPARK-13094: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13094) No encoder implicits for Seq[Primitive]

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13094: Assignee: (was: Apache Spark) > No encoder implicits for Seq[Primitive] >

[jira] [Created] (SPARK-13124) Adding JQuery DataTables messed up the Web UI css and js

Alex Bozarth created SPARK-13124: Summary: Adding JQuery DataTables messed up the Web UI css and js Key: SPARK-13124 URL: https://issues.apache.org/jira/browse/SPARK-13124 Project: Spark

[jira] [Resolved] (SPARK-12790) Remove HistoryServer old multiple files format

[ https://issues.apache.org/jira/browse/SPARK-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12790. --- Resolution: Fixed Fix Version/s: 2.0.0 > Remove HistoryServer old multiple files format >

[jira] [Commented] (SPARK-9141) DataFrame recomputed instead of using cached parent.

[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127395#comment-15127395 ] Placek commented on SPARK-9141: --- Should I create a new issue with my case? > DataFrame recomputed instead

[jira] [Comment Edited] (SPARK-11918) WLS can not resolve some kinds of equation

[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127437#comment-15127437 ] Imran Younus edited comment on SPARK-11918 at 2/2/16 2:12 AM: -- Several

[jira] [Resolved] (SPARK-13115) RandomForest is stuck at computing same stage over and over

[ https://issues.apache.org/jira/browse/SPARK-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13115. --- Resolution: Invalid Target Version/s: (was: 1.5.2) Without more info, this didn't

  1   2   3   >