[jira] [Commented] (SPARK-14136) Spark 2.0 can't start with yarn mode with ClassNotFoundException: org.apache.spark.deploy.yarn.history.YarnHistoryService

[ https://issues.apache.org/jira/browse/SPARK-14136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559540#comment-15559540 ] Mike Fang commented on SPARK-14136: --- To be more specific, it should be SPARK_CONF_DIR instead of

[jira] [Commented] (SPARK-17815) Report committed offsets

[ https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559541#comment-15559541 ] Ofir Manor commented on SPARK-17815: As far as I understand, there is a clear single-point-of-truth:

[jira] [Commented] (SPARK-17815) Report committed offsets

[ https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559549#comment-15559549 ] Ofir Manor commented on SPARK-17815: Good, we are on the same page, no argument that SPARK-16963

[jira] [Commented] (SPARK-17820) Spark sqlContext.sql() performs only first insert for HiveQL "FROM target INSERT INTO dest" command to insert into multiple target tables from same source

[ https://issues.apache.org/jira/browse/SPARK-17820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559565#comment-15559565 ] Jiang Xingbo commented on SPARK-17820: -- [~kmbeyond]I tried on Spark 1.6.0 and was unable to repro

[jira] [Commented] (SPARK-17219) QuantileDiscretizer does strange things with NaN values

[ https://issues.apache.org/jira/browse/SPARK-17219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559597#comment-15559597 ] Vincent commented on SPARK-17219: - No problem. I will try to submit another PR based on above

[jira] [Resolved] (SPARK-17287) PySpark sc.AddFile method does not support the recursive keyword argument

[ https://issues.apache.org/jira/browse/SPARK-17287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17287. --- Resolution: Duplicate > PySpark sc.AddFile method does not support the recursive keyword argument >

[jira] [Resolved] (SPARK-11326) Support for authentication and encryption in standalone mode

[ https://issues.apache.org/jira/browse/SPARK-11326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11326. --- Resolution: Won't Fix > Support for authentication and encryption in standalone mode >

[jira] [Commented] (SPARK-17607) --driver-url doesn't point to my master_ip.

[ https://issues.apache.org/jira/browse/SPARK-17607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559636#comment-15559636 ] Sasi commented on SPARK-17607: -- Hey, Is there any workaround? my system run on production and I need

[jira] [Commented] (SPARK-10501) support UUID as an atomic type

[ https://issues.apache.org/jira/browse/SPARK-10501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559405#comment-15559405 ] Hyukjin Kwon commented on SPARK-10501: -- Ah, it was type not the function. I just rushed the JIRA.

[jira] [Created] (SPARK-17838) Strict type checking for arguments with a better messages across APIs.

Hyukjin Kwon created SPARK-17838: Summary: Strict type checking for arguments with a better messages across APIs. Key: SPARK-17838 URL: https://issues.apache.org/jira/browse/SPARK-17838 Project:

[jira] [Commented] (SPARK-17815) Report committed offsets

[ https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560906#comment-15560906 ] Ofir Manor commented on SPARK-17815: I totally understand your concerns, and yes, I hope you will

[jira] [Commented] (SPARK-10838) Repeat to join one DataFrame twice，there will be AnalysisException.

[ https://issues.apache.org/jira/browse/SPARK-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560164#comment-15560164 ] Xiao Li commented on SPARK-10838: - The root cause is the same as Spark-13801. Close it now. > Repeat to

[jira] [Commented] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560241#comment-15560241 ] Cody Koeninger commented on SPARK-17147: [~graphex] My WIP is at

[jira] [Commented] (SPARK-8780) Move Python doctest code example from models to algorithms

[ https://issues.apache.org/jira/browse/SPARK-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559886#comment-15559886 ] Jiayue Zhang commented on SPARK-8780: - I will work on this, thanks. > Move Python doctest code

[jira] [Commented] (SPARK-17815) Report committed offsets

[ https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559911#comment-15559911 ] Cody Koeninger commented on SPARK-17815: The WAL cannot be the only source of truth, because it

[jira] [Created] (SPARK-17839) UnsafeSorterSpillReader should use Nio's directbuffer to read the spill files in order to avoid additional copy

Sital Kedia created SPARK-17839: --- Summary: UnsafeSorterSpillReader should use Nio's directbuffer to read the spill files in order to avoid additional copy Key: SPARK-17839 URL:

[jira] [Commented] (SPARK-17745) Update Python API for NB to support weighted instances

[ https://issues.apache.org/jira/browse/SPARK-17745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560231#comment-15560231 ] Apache Spark commented on SPARK-17745: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-17745) Update Python API for NB to support weighted instances

[ https://issues.apache.org/jira/browse/SPARK-17745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17745: Assignee: Apache Spark > Update Python API for NB to support weighted instances >

[jira] [Closed] (SPARK-8780) Move Python doctest code example from models to algorithms

[ https://issues.apache.org/jira/browse/SPARK-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang closed SPARK-8780. -- Resolution: Won't Fix > Move Python doctest code example from models to algorithms >

[jira] [Assigned] (SPARK-17745) Update Python API for NB to support weighted instances

[ https://issues.apache.org/jira/browse/SPARK-17745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17745: Assignee: (was: Apache Spark) > Update Python API for NB to support weighted

[jira] [Updated] (SPARK-17840) Add some pointers for wiki/CONTRIBUTING.md in README.md and some warnings in PULL_REQUEST_TEMPLATE

[ https://issues.apache.org/jira/browse/SPARK-17840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-17840: - Description: It seems it'd better to give best efforts for describing the guides for creating

[jira] [Created] (SPARK-17840) Add some pointers for wiki/CONTRIBUTING.md in README.md and some warnings in PULL_REQUEST_TEMPLATE

Hyukjin Kwon created SPARK-17840: Summary: Add some pointers for wiki/CONTRIBUTING.md in README.md and some warnings in PULL_REQUEST_TEMPLATE Key: SPARK-17840 URL:

[jira] [Commented] (SPARK-17607) --driver-url doesn't point to my master_ip.

[ https://issues.apache.org/jira/browse/SPARK-17607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559882#comment-15559882 ] Sean Owen commented on SPARK-17607: --- Same as https://issues.apache.org/jira/browse/SPARK-4563 ? It's

[jira] [Closed] (SPARK-10838) Repeat to join one DataFrame twice，there will be AnalysisException.

[ https://issues.apache.org/jira/browse/SPARK-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-10838. --- Resolution: Duplicate > Repeat to join one DataFrame twice，there will be AnalysisException. >

[jira] [Commented] (SPARK-17607) --driver-url doesn't point to my master_ip.

[ https://issues.apache.org/jira/browse/SPARK-17607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15559888#comment-15559888 ] Sasi commented on SPARK-17607: -- I'll check it out. I ping because I don't find any relative issues or

[jira] [Commented] (SPARK-8780) Move Python doctest code example from models to algorithms

[ https://issues.apache.org/jira/browse/SPARK-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560103#comment-15560103 ] Yanbo Liang commented on SPARK-8780: Since spark.mllib package is in maintenance mode, only bug fix

[jira] [Updated] (SPARK-8842) Spark SQL - Insert into table Issue

[ https://issues.apache.org/jira/browse/SPARK-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Greenwood updated SPARK-8842: --- Affects Version/s: 2.0.1 > Spark SQL - Insert into table Issue >

[jira] [Updated] (SPARK-17840) Add some pointers for wiki/CONTRIBUTING.md in README.md and some warnings in PULL_REQUEST_TEMPLATE

[ https://issues.apache.org/jira/browse/SPARK-17840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-17840: - Description: It seems it'd better to give best efforts for describing the guides for creating

[jira] [Assigned] (SPARK-15917) Define the number of executors in standalone mode with an easy-to-use property

[ https://issues.apache.org/jira/browse/SPARK-15917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15917: Assignee: Apache Spark > Define the number of executors in standalone mode with an

[jira] [Assigned] (SPARK-15917) Define the number of executors in standalone mode with an easy-to-use property

[ https://issues.apache.org/jira/browse/SPARK-15917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15917: Assignee: (was: Apache Spark) > Define the number of executors in standalone mode

[jira] [Commented] (SPARK-15917) Define the number of executors in standalone mode with an easy-to-use property

[ https://issues.apache.org/jira/browse/SPARK-15917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560115#comment-15560115 ] Apache Spark commented on SPARK-15917: -- User 'JonathanTaws' has created a pull request for this

[jira] [Commented] (SPARK-17841) Kafka 0.10 commitQueue needs to be drained

[ https://issues.apache.org/jira/browse/SPARK-17841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560370#comment-15560370 ] Apache Spark commented on SPARK-17841: -- User 'koeninger' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17841) Kafka 0.10 commitQueue needs to be drained

[ https://issues.apache.org/jira/browse/SPARK-17841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17841: Assignee: Apache Spark > Kafka 0.10 commitQueue needs to be drained >

[jira] [Assigned] (SPARK-17841) Kafka 0.10 commitQueue needs to be drained

[ https://issues.apache.org/jira/browse/SPARK-17841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17841: Assignee: (was: Apache Spark) > Kafka 0.10 commitQueue needs to be drained >

[jira] [Commented] (SPARK-17840) Add some pointers for wiki/CONTRIBUTING.md in README.md and some warnings in PULL_REQUEST_TEMPLATE

[ https://issues.apache.org/jira/browse/SPARK-17840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560914#comment-15560914 ] Reynold Xin commented on SPARK-17840: - My comment on the dev list email thread: Github already links

[jira] [Assigned] (SPARK-17844) DataFrame API should simplify defining frame boundaries without partitioning/ordering

[ https://issues.apache.org/jira/browse/SPARK-17844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17844: Assignee: Apache Spark (was: Reynold Xin) > DataFrame API should simplify defining frame

[jira] [Commented] (SPARK-17844) DataFrame API should simplify defining frame boundaries without partitioning/ordering

[ https://issues.apache.org/jira/browse/SPARK-17844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560966#comment-15560966 ] Apache Spark commented on SPARK-17844: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17844) DataFrame API should simplify defining frame boundaries without partitioning/ordering

[ https://issues.apache.org/jira/browse/SPARK-17844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17844: Assignee: Reynold Xin (was: Apache Spark) > DataFrame API should simplify defining frame

[jira] [Commented] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561008#comment-15561008 ] Takeshi Yamamuro commented on SPARK-14393: -- yea, since this ticket is totally inactive for a

[jira] [Updated] (SPARK-17846) A bad state of Running Applications with spark standalone HA

[ https://issues.apache.org/jira/browse/SPARK-17846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dylanzhou updated SPARK-17846: -- Attachment: QQ截图20161010121745.jpg Problem screenshots > A bad state of Running Applications with

[jira] [Updated] (SPARK-17846) A bad state of Running Applications with spark standalone HA

[ https://issues.apache.org/jira/browse/SPARK-17846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dylanzhou updated SPARK-17846: -- Attachment: (was: QQ截图20161010121745.jpg) > A bad state of Running Applications with spark

[jira] [Resolved] (SPARK-17741) Grammar to parse top level and nested data fields separately

[ https://issues.apache.org/jira/browse/SPARK-17741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17741. --- Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.1.0 >

[jira] [Resolved] (SPARK-10673) spark.sql.hive.verifyPartitionPath Attempts to Verify Unregistered Partitions

[ https://issues.apache.org/jira/browse/SPARK-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-10673. - Resolution: Not A Problem > spark.sql.hive.verifyPartitionPath Attempts to Verify Unregistered

[jira] [Commented] (SPARK-10673) spark.sql.hive.verifyPartitionPath Attempts to Verify Unregistered Partitions

[ https://issues.apache.org/jira/browse/SPARK-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561348#comment-15561348 ] Xiao Li commented on SPARK-10673: - This should be resolved in 2.0. Please retry it. If it is still an

[jira] [Resolved] (SPARK-10503) incorrect predicate evaluation involving NULL value

[ https://issues.apache.org/jira/browse/SPARK-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-10503. - Resolution: Cannot Reproduce Need info. from users. Please reopen it when you still hit this issues.

[jira] [Commented] (SPARK-17845) Improve window function frame boundary API in DataFrame

[ https://issues.apache.org/jira/browse/SPARK-17845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561376#comment-15561376 ] Cheng Lian commented on SPARK-17845: One thing is that ANSI SQL also allows using arbitrary integral

[jira] [Created] (SPARK-17844) DataFrame API should simplify defining frame boundaries without partitioning/ordering

Reynold Xin created SPARK-17844: --- Summary: DataFrame API should simplify defining frame boundaries without partitioning/ordering Key: SPARK-17844 URL: https://issues.apache.org/jira/browse/SPARK-17844

[jira] [Commented] (SPARK-16938) Cannot resolve column name after a join

[ https://issues.apache.org/jira/browse/SPARK-16938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561067#comment-15561067 ] Dongjoon Hyun commented on SPARK-16938: --- This issue is not in progress anymore. Please take this if

[jira] [Updated] (SPARK-17845) Improve window function frame boundary API in DataFrame

[ https://issues.apache.org/jira/browse/SPARK-17845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17845: Description: ANSI SQL uses the following to specify the frame boundaries for window functions:

[jira] [Updated] (SPARK-17845) Improve window function frame boundary API in DataFrame

[ https://issues.apache.org/jira/browse/SPARK-17845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17845: Description: In SQL, we use the following to specify the frame boundaries for window functions:

[jira] [Commented] (SPARK-17845) Improve window function frame boundary API in DataFrame

[ https://issues.apache.org/jira/browse/SPARK-17845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561305#comment-15561305 ] Russell Spitzer commented on SPARK-17845: - FWIW, I Find (2) much more readable > Improve window

[jira] [Comment Edited] (SPARK-17845) Improve window function frame boundary API in DataFrame

[ https://issues.apache.org/jira/browse/SPARK-17845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561305#comment-15561305 ] Russell Spitzer edited comment on SPARK-17845 at 10/10/16 5:14 AM: ---

[jira] [Commented] (SPARK-9762) ALTER TABLE cannot find column

[ https://issues.apache.org/jira/browse/SPARK-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561337#comment-15561337 ] Xiao Li commented on SPARK-9762: Now, we do not support ALTER TABLE CHANGE COLUMN since 2.0, no matter

[jira] [Commented] (SPARK-17848) Move LabelCol datatype cast into Predictor.fit

[ https://issues.apache.org/jira/browse/SPARK-17848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561367#comment-15561367 ] Apache Spark commented on SPARK-17848: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-17848) Move LabelCol datatype cast into Predictor.fit

[ https://issues.apache.org/jira/browse/SPARK-17848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17848: Assignee: (was: Apache Spark) > Move LabelCol datatype cast into Predictor.fit >

[jira] [Assigned] (SPARK-17848) Move LabelCol datatype cast into Predictor.fit

[ https://issues.apache.org/jira/browse/SPARK-17848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17848: Assignee: Apache Spark > Move LabelCol datatype cast into Predictor.fit >

[jira] [Commented] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560941#comment-15560941 ] Takeshi Yamamuro commented on SPARK-14393: -- [~hyukjin.kwon] What do u think the issue of this

[jira] [Commented] (SPARK-17840) Add some pointers for wiki/CONTRIBUTING.md in README.md and some warnings in PULL_REQUEST_TEMPLATE

[ https://issues.apache.org/jira/browse/SPARK-17840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560968#comment-15560968 ] Hyukjin Kwon commented on SPARK-17840: -- I do agree and thank you for your prompt response. Maybe, I

[jira] [Comment Edited] (SPARK-16938) Cannot resolve column name after a join

[ https://issues.apache.org/jira/browse/SPARK-16938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561067#comment-15561067 ] Dongjoon Hyun edited comment on SPARK-16938 at 10/10/16 2:30 AM: - This

[jira] [Commented] (SPARK-14958) Failed task hangs if error is encountered when getting task result

[ https://issues.apache.org/jira/browse/SPARK-14958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561094#comment-15561094 ] Rui Li commented on SPARK-14958: I hit the issue with Spark 1.6.1 > Failed task hangs if error is

[jira] [Commented] (SPARK-17842) Thread and memory leak in WindowDstream (UnionRDD ) when parallelPartition computation gets enabled.

[ https://issues.apache.org/jira/browse/SPARK-17842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561099#comment-15561099 ] Liwei Lin commented on SPARK-17842: --- [~sreelalsl] thanks for the very clear reproducer -- it can be

[jira] [Updated] (SPARK-17845) Improve window function frame boundary API in DataFrame

[ https://issues.apache.org/jira/browse/SPARK-17845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17845: Description: ANSI SQL uses the following to specify the frame boundaries for window functions:

[jira] [Created] (SPARK-17847) Copy GaussianMixture implementation from mllib to ml

Yanbo Liang created SPARK-17847: --- Summary: Copy GaussianMixture implementation from mllib to ml Key: SPARK-17847 URL: https://issues.apache.org/jira/browse/SPARK-17847 Project: Spark Issue

[jira] [Assigned] (SPARK-17847) Copy GaussianMixture implementation from mllib to ml

[ https://issues.apache.org/jira/browse/SPARK-17847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17847: Assignee: (was: Apache Spark) > Copy GaussianMixture implementation from mllib to ml

[jira] [Commented] (SPARK-17847) Copy GaussianMixture implementation from mllib to ml

[ https://issues.apache.org/jira/browse/SPARK-17847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561294#comment-15561294 ] Apache Spark commented on SPARK-17847: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17847) Copy GaussianMixture implementation from mllib to ml

[ https://issues.apache.org/jira/browse/SPARK-17847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17847: Assignee: Apache Spark > Copy GaussianMixture implementation from mllib to ml >

[jira] [Resolved] (SPARK-11584) The attribute of temporay table shows false

[ https://issues.apache.org/jira/browse/SPARK-11584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-11584. - Resolution: Not A Problem This has been resolved in the native DDL support since 2.0 Close it now.

[jira] [Updated] (SPARK-6962) Netty BlockTransferService hangs in the middle of SQL query

[ https://issues.apache.org/jira/browse/SPARK-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-6962: --- Component/s: Spark Core > Netty BlockTransferService hangs in the middle of SQL query >

[jira] [Commented] (SPARK-17812) More granular control of starting offsets

[ https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560925#comment-15560925 ] Cody Koeninger commented on SPARK-17812: I want to start a pattern subscription at known good

[jira] [Commented] (SPARK-14393) monotonicallyIncreasingId not monotonically increasing with downstream coalesce

[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560991#comment-15560991 ] Hyukjin Kwon commented on SPARK-14393: -- Thanks for pinging me!, in my personal opinion, we should

[jira] [Comment Edited] (SPARK-16938) Cannot resolve column name after a join

[ https://issues.apache.org/jira/browse/SPARK-16938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561067#comment-15561067 ] Dongjoon Hyun edited comment on SPARK-16938 at 10/10/16 2:30 AM: - This

[jira] [Created] (SPARK-17845) Improve window function frame boundary API in DataFrame

Reynold Xin created SPARK-17845: --- Summary: Improve window function frame boundary API in DataFrame Key: SPARK-17845 URL: https://issues.apache.org/jira/browse/SPARK-17845 Project: Spark Issue

[jira] [Created] (SPARK-17846) A bad state of Running Applications with spark standalone HA

dylanzhou created SPARK-17846: - Summary: A bad state of Running Applications with spark standalone HA Key: SPARK-17846 URL: https://issues.apache.org/jira/browse/SPARK-17846 Project: Spark

[jira] [Assigned] (SPARK-17656) Decide on the variant of @scala.annotation.varargs and use consistently

[ https://issues.apache.org/jira/browse/SPARK-17656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-17656: --- Assignee: Reynold Xin > Decide on the variant of @scala.annotation.varargs and use

[jira] [Updated] (SPARK-17846) A bad state of Running Applications with spark standalone HA

[ https://issues.apache.org/jira/browse/SPARK-17846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dylanzhou updated SPARK-17846: -- Attachment: Problem screenshots.jpg > A bad state of Running Applications with spark standalone HA >

[jira] [Resolved] (SPARK-17832) TableIdentifier.quotedString creates un-parseable names when name contains a backtick

[ https://issues.apache.org/jira/browse/SPARK-17832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17832. --- Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.1.0

[jira] [Created] (SPARK-17848) Move LabelCol datatype cast into Predictor.fit

zhengruifeng created SPARK-17848: Summary: Move LabelCol datatype cast into Predictor.fit Key: SPARK-17848 URL: https://issues.apache.org/jira/browse/SPARK-17848 Project: Spark Issue Type:

[jira] [Reopened] (SPARK-10848) Applied JSON Schema Works for json RDD but not when loading json file

[ https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-10848: - > Applied JSON Schema Works for json RDD but not when loading json file >

[jira] [Resolved] (SPARK-10848) Applied JSON Schema Works for json RDD but not when loading json file

[ https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-10848. - Resolution: Fixed > Applied JSON Schema Works for json RDD but not when loading json file >

[jira] [Resolved] (SPARK-10848) Applied JSON Schema Works for json RDD but not when loading json file

[ https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-10848. - Resolution: Not A Problem > Applied JSON Schema Works for json RDD but not when loading json file >

[jira] [Commented] (SPARK-10848) Applied JSON Schema Works for json RDD but not when loading json file

[ https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15561328#comment-15561328 ] Xiao Li commented on SPARK-10848: - This should be resolved in the latest file format refactoring in Spark

[jira] [Resolved] (SPARK-9762) ALTER TABLE cannot find column

[ https://issues.apache.org/jira/browse/SPARK-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-9762. Resolution: Not A Problem > ALTER TABLE cannot find column > -- > >

[jira] [Resolved] (SPARK-8712) Hive's Parser does not support distinct aggregations with OVER clause

[ https://issues.apache.org/jira/browse/SPARK-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-8712. Resolution: Not A Problem > Hive's Parser does not support distinct aggregations with OVER clause >

[jira] [Resolved] (SPARK-11254) Thriftserver on kerberos secured cluster in YARN mode

[ https://issues.apache.org/jira/browse/SPARK-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-11254. - Resolution: Cannot Reproduce > Thriftserver on kerberos secured cluster in YARN mode >

[jira] [Commented] (SPARK-17812) More granular control of starting offsets

[ https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560719#comment-15560719 ] Cody Koeninger commented on SPARK-17812: Generally agree with the direction of what you're

[jira] [Commented] (SPARK-17839) UnsafeSorterSpillReader should use Nio's directbuffer to read the spill files in order to avoid additional copy

[ https://issues.apache.org/jira/browse/SPARK-17839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560381#comment-15560381 ] Apache Spark commented on SPARK-17839: -- User 'sitalkedia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17839) UnsafeSorterSpillReader should use Nio's directbuffer to read the spill files in order to avoid additional copy

[ https://issues.apache.org/jira/browse/SPARK-17839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17839: Assignee: Apache Spark > UnsafeSorterSpillReader should use Nio's directbuffer to read

[jira] [Assigned] (SPARK-17839) UnsafeSorterSpillReader should use Nio's directbuffer to read the spill files in order to avoid additional copy

[ https://issues.apache.org/jira/browse/SPARK-17839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17839: Assignee: (was: Apache Spark) > UnsafeSorterSpillReader should use Nio's directbuffer

[jira] [Commented] (SPARK-17820) Spark sqlContext.sql() performs only first insert for HiveQL "FROM target INSERT INTO dest" command to insert into multiple target tables from same source

[ https://issues.apache.org/jira/browse/SPARK-17820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560423#comment-15560423 ] Kiran Miryala commented on SPARK-17820: --- Yes, data exists in sqoop_import.departments table.

[jira] [Comment Edited] (SPARK-17812) More granular control of starting offsets

[ https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560696#comment-15560696 ] Ofir Manor edited comment on SPARK-17812 at 10/9/16 10:00 PM: -- Cody, you are

[jira] [Created] (SPARK-17842) Thread and memory leak in WindowDstream (UnionRDD ) when parallelPartition computation gets enabled.

Sreelal S L created SPARK-17842: --- Summary: Thread and memory leak in WindowDstream (UnionRDD ) when parallelPartition computation gets enabled. Key: SPARK-17842 URL:

[jira] [Commented] (SPARK-17815) Report committed offsets

[ https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560749#comment-15560749 ] Ofir Manor commented on SPARK-17815: Thanks Cody, this is much clearer. (BTW - I've been bitten

[jira] [Created] (SPARK-17841) Kafka 0.10 commitQueue needs to be drained

Cody Koeninger created SPARK-17841: -- Summary: Kafka 0.10 commitQueue needs to be drained Key: SPARK-17841 URL: https://issues.apache.org/jira/browse/SPARK-17841 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17815) Report committed offsets

[ https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560661#comment-15560661 ] Ofir Manor commented on SPARK-17815: I hope others with better understanding of Spark internals can

[jira] [Commented] (SPARK-17815) Report committed offsets

[ https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560684#comment-15560684 ] Cody Koeninger commented on SPARK-17815: Regarding kafka consumer behavior, I'm not saying it's

[jira] [Commented] (SPARK-17815) Report committed offsets

[ https://issues.apache.org/jira/browse/SPARK-17815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560837#comment-15560837 ] Cody Koeninger commented on SPARK-17815: My personal concerns about complexity are because I'm

[jira] [Commented] (SPARK-17812) More granular control of starting offsets

[ https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560839#comment-15560839 ] Cody Koeninger commented on SPARK-17812: That totally kills the usability of SubscribePattern. >

[jira] [Created] (SPARK-17843) History Server gives no feedback about the application list being incomplete

Vinayak Joshi created SPARK-17843: - Summary: History Server gives no feedback about the application list being incomplete Key: SPARK-17843 URL: https://issues.apache.org/jira/browse/SPARK-17843

[jira] [Commented] (SPARK-17812) More granular control of starting offsets

[ https://issues.apache.org/jira/browse/SPARK-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560865#comment-15560865 ] Ofir Manor commented on SPARK-17812: Why? If you choose oldest, latest or by timestamp, you can

[jira] [Commented] (SPARK-14761) PySpark DataFrame.join should reject invalid join methods even when join columns are not specified

[ https://issues.apache.org/jira/browse/SPARK-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15560874#comment-15560874 ] Apache Spark commented on SPARK-14761: -- User 'bkpathak' has created a pull request for this issue:

  1   2   >