[jira] [Created] (SPARK-7554) Throw errors when an active StreamingContext is used to create DStreams and output operations

Tathagata Das created SPARK-7554: Summary: Throw errors when an active StreamingContext is used to create DStreams and output operations Key: SPARK-7554 URL: https://issues.apache.org/jira/browse/SPARK-7554

[jira] [Closed] (SPARK-7026) LeftSemiJoin can not work when it has both equal condition and not equal condition.

[ https://issues.apache.org/jira/browse/SPARK-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei closed SPARK-7026. - Resolution: Duplicate LeftSemiJoin can not work when it has both equal condition and not equal

[jira] [Commented] (SPARK-7545) Bernoulli NaiveBayes should validate data

[ https://issues.apache.org/jira/browse/SPARK-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539081#comment-14539081 ] Joseph K. Bradley commented on SPARK-7545: -- OK, I appreciate it! Bernoulli

[jira] [Resolved] (SPARK-7331) Create HiveConf per application instead of per query in HiveQl.scala

[ https://issues.apache.org/jira/browse/SPARK-7331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7331. - Resolution: Fixed Fix Version/s: 1.2.3 Issue resolved by pull request 6036

[jira] [Resolved] (SPARK-7538) Kafka stream fails: java.lang.NoClassDefFound com/yammer/metrics/core/Gauge

[ https://issues.apache.org/jira/browse/SPARK-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7538. Resolution: Fixed This was a cross post from the mailing list. The poster closed the thread

[jira] [Resolved] (SPARK-7520) Install Jekyll On Jenkins Machines

[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7520. Resolution: Fixed Fix Version/s: 1.4.0 All green - awesome thanks [~shaneknapp]!

[jira] [Updated] (SPARK-6876) DataFrame.na.replace value support for Python

[ https://issues.apache.org/jira/browse/SPARK-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6876: -- Assignee: Adrian Wang DataFrame.na.replace value support for Python

[jira] [Resolved] (SPARK-7411) CTAS parser is incomplete

[ https://issues.apache.org/jira/browse/SPARK-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7411. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5963

[jira] [Updated] (SPARK-7553) Add methods to maintain a singleton StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7553: - Description: In a REPL/notebook environment, its very easy to lose a reference to a

[jira] [Created] (SPARK-7553) Add methods to maintain a singleton StreamingContext

Tathagata Das created SPARK-7553: Summary: Add methods to maintain a singleton StreamingContext Key: SPARK-7553 URL: https://issues.apache.org/jira/browse/SPARK-7553 Project: Spark Issue

[jira] [Assigned] (SPARK-7552) Close files correctly when iteration is finished in WAL recovery

[ https://issues.apache.org/jira/browse/SPARK-7552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7552: --- Assignee: Apache Spark Close files correctly when iteration is finished in WAL recovery

[jira] [Updated] (SPARK-7553) Add methods to maintain a singleton StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7553: - Description: In a REPL/notebook environment, its very easy to lose a reference to a

[jira] [Updated] (SPARK-7553) Add methods to maintain a singleton StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7553: - Description: In a REPL/notebook environment, its very easy to lose a reference to a

[jira] [Updated] (SPARK-7552) Close files correctly when iteration is finished in WAL recovery

[ https://issues.apache.org/jira/browse/SPARK-7552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-7552: --- Labels: backport-needed (was: ) Close files correctly when iteration is finished in WAL recovery

[jira] [Assigned] (SPARK-7553) Add methods to maintain a singleton StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7553: --- Assignee: Tathagata Das (was: Apache Spark) Add methods to maintain a singleton

[jira] [Commented] (SPARK-7553) Add methods to maintain a singleton StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539140#comment-14539140 ] Apache Spark commented on SPARK-7553: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-7553) Add methods to maintain a singleton StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7553: --- Assignee: Apache Spark (was: Tathagata Das) Add methods to maintain a singleton

[jira] [Updated] (SPARK-7554) Throw exception when an active StreamingContext is used to create DStreams and output operations

[ https://issues.apache.org/jira/browse/SPARK-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7554: - Priority: Blocker (was: Critical) Throw exception when an active StreamingContext is used to

[jira] [Updated] (SPARK-7554) Throw errors when an active StreamingContext is used to create DStreams and output operations

[ https://issues.apache.org/jira/browse/SPARK-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7554: - Component/s: Streaming Target Version/s: 1.4.0 Throw errors when an active

[jira] [Updated] (SPARK-7554) Throw exception when an active StreamingContext is used to create DStreams and output operations

[ https://issues.apache.org/jira/browse/SPARK-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7554: - Summary: Throw exception when an active StreamingContext is used to create DStreams and output

[jira] [Commented] (SPARK-7554) Throw exception when an active StreamingContext is used to create DStreams and output operations

[ https://issues.apache.org/jira/browse/SPARK-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539143#comment-14539143 ] Tathagata Das commented on SPARK-7554: -- Currently, adding DStreams to an active

[jira] [Resolved] (SPARK-7509) Add drop column to Python DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7509. Resolution: Fixed Fix Version/s: 1.4.0 Add drop column to Python DataFrame API

[jira] [Closed] (SPARK-6198) Support select current_database()

[ https://issues.apache.org/jira/browse/SPARK-6198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei closed SPARK-6198. - Resolution: Won't Fix Support select current_database() ---

[jira] [Closed] (SPARK-5129) make SqlContext support select date +/- XX DAYS from table

[ https://issues.apache.org/jira/browse/SPARK-5129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei closed SPARK-5129. - Resolution: Won't Fix make SqlContext support select date +/- XX DAYS from table

[jira] [Closed] (SPARK-6768) Do not support float/double union decimal or decimal(a ,b) union decimal(c, d)

[ https://issues.apache.org/jira/browse/SPARK-6768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei closed SPARK-6768. - Resolution: Fixed Do not support float/double union decimal or decimal(a ,b) union decimal(c,

[jira] [Created] (SPARK-7530) Add API to get the current state of a StreamingContext

Tathagata Das created SPARK-7530: Summary: Add API to get the current state of a StreamingContext Key: SPARK-7530 URL: https://issues.apache.org/jira/browse/SPARK-7530 Project: Spark Issue

[jira] [Commented] (SPARK-7531) Install GPG on Jenkins machines

[ https://issues.apache.org/jira/browse/SPARK-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538154#comment-14538154 ] shane knapp commented on SPARK-7531: is this version sufficient? -bash-4.1$ gpg

[jira] [Updated] (SPARK-7532) Make StreamingContext.start() idempotent

[ https://issues.apache.org/jira/browse/SPARK-7532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7532: - Component/s: Streaming Make StreamingContext.start() idempotent

[jira] [Updated] (SPARK-7458) Check 1.3- 1.4 MLlib API compliance using java-compliance-checker

[ https://issues.apache.org/jira/browse/SPARK-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7458: - Description: We should do this after 1.4-rc1 is cut. Check 1.3- 1.4 MLlib API compliance using

[jira] [Assigned] (SPARK-7355) FlakyTest - o.a.s.DriverSuite

[ https://issues.apache.org/jira/browse/SPARK-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7355: --- Assignee: Andrew Or (was: Apache Spark) FlakyTest - o.a.s.DriverSuite

[jira] [Commented] (SPARK-7355) FlakyTest - o.a.s.DriverSuite

[ https://issues.apache.org/jira/browse/SPARK-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538185#comment-14538185 ] Apache Spark commented on SPARK-7355: - User 'tedyu' has created a pull request for

[jira] [Assigned] (SPARK-7355) FlakyTest - o.a.s.DriverSuite

[ https://issues.apache.org/jira/browse/SPARK-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7355: --- Assignee: Apache Spark (was: Andrew Or) FlakyTest - o.a.s.DriverSuite

[jira] [Assigned] (SPARK-7532) Make StreamingContext.start() idempotent

[ https://issues.apache.org/jira/browse/SPARK-7532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7532: --- Assignee: Tathagata Das (was: Apache Spark) Make StreamingContext.start() idempotent

[jira] [Commented] (SPARK-7532) Make StreamingContext.start() idempotent

[ https://issues.apache.org/jira/browse/SPARK-7532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538193#comment-14538193 ] Apache Spark commented on SPARK-7532: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-7532) Make StreamingContext.start() idempotent

[ https://issues.apache.org/jira/browse/SPARK-7532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7532: --- Assignee: Apache Spark (was: Tathagata Das) Make StreamingContext.start() idempotent

[jira] [Commented] (SPARK-7133) Implement struct, array, and map field accessor using apply in Scala and __getitem__ in Python

[ https://issues.apache.org/jira/browse/SPARK-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538272#comment-14538272 ] Nicholas Chammas commented on SPARK-7133: - [~rxin] - Should we also implement

[jira] [Resolved] (SPARK-7361) Throw unambiguous exception when attempting to start multiple StreamingContexts in the same JVM

[ https://issues.apache.org/jira/browse/SPARK-7361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7361. -- Resolution: Fixed Fix Version/s: 1.4.0 Throw unambiguous exception when attempting to

[jira] [Updated] (SPARK-7497) test_count_by_value_and_window is flaky

[ https://issues.apache.org/jira/browse/SPARK-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7497: - Assignee: Davies Liu (was: Tathagata Das) test_count_by_value_and_window is flaky

[jira] [Resolved] (SPARK-7522) ML Examples option for dataFormat should not be enclosed in angle brackets

[ https://issues.apache.org/jira/browse/SPARK-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7522. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6049

[jira] [Created] (SPARK-7534) Fix the Stage table when a stage is missing

Shixiong Zhu created SPARK-7534: --- Summary: Fix the Stage table when a stage is missing Key: SPARK-7534 URL: https://issues.apache.org/jira/browse/SPARK-7534 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7400) PortableDataStream UDT

[ https://issues.apache.org/jira/browse/SPARK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538236#comment-14538236 ] Eron Wright commented on SPARK-7400: - Given the above, my proposal is to modify

[jira] [Updated] (SPARK-7443) MLlib 1.4 QA plan

[ https://issues.apache.org/jira/browse/SPARK-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7443: - Description: TODO: create JIRAs for each task and assign them accordingly. h2. API * Check API

[jira] [Resolved] (SPARK-6092) Add RankingMetrics in PySpark/MLlib

[ https://issues.apache.org/jira/browse/SPARK-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6092. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6044

[jira] [Created] (SPARK-7529) Java compatibility check for MLlib 1.4

Xiangrui Meng created SPARK-7529: Summary: Java compatibility check for MLlib 1.4 Key: SPARK-7529 URL: https://issues.apache.org/jira/browse/SPARK-7529 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-7530) Add API to get the current state of a StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7530: --- Assignee: Tathagata Das (was: Apache Spark) Add API to get the current state of a

[jira] [Updated] (SPARK-7522) ML Examples option for dataFormat should not be enclosed in angle brackets

[ https://issues.apache.org/jira/browse/SPARK-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7522: - Target Version/s: 1.1.2, 1.2.3, 1.3.2 Affects Version/s: 1.4.0 1.1.1

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538148#comment-14538148 ] shane knapp commented on SPARK-7520: any particular version of ruby? 1.8.7? Install

[jira] [Commented] (SPARK-7504) NullPointerException when initializing SparkContext in YARN-cluster mode

[ https://issues.apache.org/jira/browse/SPARK-7504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538159#comment-14538159 ] Marcelo Vanzin commented on SPARK-7504: --- If I understand correctly, what you're

[jira] [Commented] (SPARK-7507) pyspark.sql.types.StructType and Row should implement __iter__()

[ https://issues.apache.org/jira/browse/SPARK-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538283#comment-14538283 ] Nicholas Chammas commented on SPARK-7507: - On a related note, perhaps we should

[jira] [Created] (SPARK-7528) Java compatibility of RankingMetrics

Xiangrui Meng created SPARK-7528: Summary: Java compatibility of RankingMetrics Key: SPARK-7528 URL: https://issues.apache.org/jira/browse/SPARK-7528 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-7530) Add API to get the current state of a StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538126#comment-14538126 ] Apache Spark commented on SPARK-7530: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-7530) Add API to get the current state of a StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7530: --- Assignee: Apache Spark (was: Tathagata Das) Add API to get the current state of a

[jira] [Commented] (SPARK-5575) Artificial neural networks for MLlib deep learning

[ https://issues.apache.org/jira/browse/SPARK-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538209#comment-14538209 ] Alexander Ulanov commented on SPARK-5575: - Current implementation:

[jira] [Created] (SPARK-7533) Decrease spacing between AM-RM heartbeats.

Sandy Ryza created SPARK-7533: - Summary: Decrease spacing between AM-RM heartbeats. Key: SPARK-7533 URL: https://issues.apache.org/jira/browse/SPARK-7533 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-7531) Install GPG on Jenkins machines

Patrick Wendell created SPARK-7531: -- Summary: Install GPG on Jenkins machines Key: SPARK-7531 URL: https://issues.apache.org/jira/browse/SPARK-7531 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-7534) Fix the Stage table when a stage is missing

[ https://issues.apache.org/jira/browse/SPARK-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7534: --- Assignee: (was: Apache Spark) Fix the Stage table when a stage is missing

[jira] [Commented] (SPARK-7534) Fix the Stage table when a stage is missing

[ https://issues.apache.org/jira/browse/SPARK-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538222#comment-14538222 ] Apache Spark commented on SPARK-7534: - User 'zsxwing' has created a pull request for

[jira] [Commented] (SPARK-7483) [MLLib] Using Kryo with FPGrowth fails with an exception

[ https://issues.apache.org/jira/browse/SPARK-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14538288#comment-14538288 ] Joseph K. Bradley commented on SPARK-7483: -- I agree; it should work, but I'm not

<    1   2   3