[jira] [Commented] (SPARK-6797) Add support for YARN cluster mode

[ https://issues.apache.org/jira/browse/SPARK-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568863#comment-14568863 ] Sun Rui commented on SPARK-6797: @shivaram, I can run SparkR in the YARN cluster mode (nee

[jira] [Commented] (SPARK-8037) Ignores files whose name starts with "." while enumerating files in HadoopFsRelation

[ https://issues.apache.org/jira/browse/SPARK-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568857#comment-14568857 ] Apache Spark commented on SPARK-8037: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-8037) Ignores files whose name starts with "." while enumerating files in HadoopFsRelation

[ https://issues.apache.org/jira/browse/SPARK-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8037: --- Assignee: Cheng Lian (was: Apache Spark) > Ignores files whose name starts with "." while en

[jira] [Assigned] (SPARK-8037) Ignores files whose name starts with "." while enumerating files in HadoopFsRelation

[ https://issues.apache.org/jira/browse/SPARK-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8037: --- Assignee: Apache Spark (was: Cheng Lian) > Ignores files whose name starts with "." while en

[jira] [Commented] (SPARK-7122) KafkaUtils.createDirectStream - unreasonable processing time in absence of load

[ https://issues.apache.org/jira/browse/SPARK-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568854#comment-14568854 ] Nicolas PHUNG commented on SPARK-7122: -- For _KafkaUtils.createStream_, jobs take betw

[jira] [Updated] (SPARK-7893) Complex Operators between Graphs

[ https://issues.apache.org/jira/browse/SPARK-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Huang updated SPARK-7893: -- Description: Currently there are 30+ operators in GraphX, while few of them consider operators between

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568839#comment-14568839 ] Saisai Shao commented on SPARK-4352: Hi [~steve_l], thanks a lot for your suggestions,

[jira] [Assigned] (SPARK-8038) PySpark SQL when functions is broken on Column

[ https://issues.apache.org/jira/browse/SPARK-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8038: --- Assignee: (was: Apache Spark) > PySpark SQL when functions is broken on Column >

[jira] [Commented] (SPARK-8038) PySpark SQL when functions is broken on Column

[ https://issues.apache.org/jira/browse/SPARK-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568836#comment-14568836 ] Apache Spark commented on SPARK-8038: - User 'ogirardot' has created a pull request for

[jira] [Assigned] (SPARK-8038) PySpark SQL when functions is broken on Column

[ https://issues.apache.org/jira/browse/SPARK-8038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8038: --- Assignee: Apache Spark > PySpark SQL when functions is broken on Column > ---

[jira] [Created] (SPARK-8038) PySpark SQL when functions is broken on Column

Olivier Girardot created SPARK-8038: --- Summary: PySpark SQL when functions is broken on Column Key: SPARK-8038 URL: https://issues.apache.org/jira/browse/SPARK-8038 Project: Spark Issue Type

[jira] [Comment Edited] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568726#comment-14568726 ] Saisai Shao edited comment on SPARK-4352 at 6/2/15 9:23 AM: Hi

[jira] [Commented] (SPARK-8011) DecimalType is not a datatype

[ https://issues.apache.org/jira/browse/SPARK-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568823#comment-14568823 ] Liang-Chi Hsieh commented on SPARK-8011: Try DecimalType.Unlimited? > DecimalType

[jira] [Commented] (SPARK-6816) Add SparkConf API to configure SparkR

[ https://issues.apache.org/jira/browse/SPARK-6816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568807#comment-14568807 ] Rick Moritz commented on SPARK-6816: [~shivaram], I am integrating SparkR into an RStu

[jira] [Comment Edited] (SPARK-6816) Add SparkConf API to configure SparkR

[ https://issues.apache.org/jira/browse/SPARK-6816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14567187#comment-14567187 ] Rick Moritz edited comment on SPARK-6816 at 6/2/15 8:55 AM: On

[jira] [Commented] (SPARK-6988) Fix Spark SQL documentation for 1.3.x

[ https://issues.apache.org/jira/browse/SPARK-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568798#comment-14568798 ] Sean Owen commented on SPARK-6988: -- [~Saurabh Santhosh] This isn't how you report new iss

[jira] [Resolved] (SPARK-8033) spark-sql thriftserver security authorization bugs!

[ https://issues.apache.org/jira/browse/SPARK-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8033. -- Resolution: Duplicate > spark-sql thriftserver security authorization bugs! > --

[jira] [Resolved] (SPARK-8033) spark-sql thriftserver security authorization bugs!

[ https://issues.apache.org/jira/browse/SPARK-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8033. -- Resolution: Fixed [~nilone] Please read https://cwiki.apache.org/confluence/display/SPARK/Contributing+

[jira] [Reopened] (SPARK-8033) spark-sql thriftserver security authorization bugs!

[ https://issues.apache.org/jira/browse/SPARK-8033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-8033: -- > spark-sql thriftserver security authorization bugs! > ---

[jira] [Created] (SPARK-8037) Ignores files whose name starts with "." while enumerating files in HadoopFsRelation

Cheng Lian created SPARK-8037: - Summary: Ignores files whose name starts with "." while enumerating files in HadoopFsRelation Key: SPARK-8037 URL: https://issues.apache.org/jira/browse/SPARK-8037 Project:

[jira] [Created] (SPARK-8036) Ignores files whose name starts with "." while enumerating files in HadoopFsRelation

Cheng Lian created SPARK-8036: - Summary: Ignores files whose name starts with "." while enumerating files in HadoopFsRelation Key: SPARK-8036 URL: https://issues.apache.org/jira/browse/SPARK-8036 Project:

[jira] [Comment Edited] (SPARK-7680) Add a fake Receiver that generates random strings, useful for prototyping

[ https://issues.apache.org/jira/browse/SPARK-7680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564815#comment-14564815 ] Rohith Yeravothula edited comment on SPARK-7680 at 6/2/15 8:03 AM: -

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568726#comment-14568726 ] Saisai Shao commented on SPARK-4352: Hi [~sandyr], I have a proposal based on ratio to

[jira] [Issue Comment Deleted] (SPARK-7980) Support SQLContext.range(end)

[ https://issues.apache.org/jira/browse/SPARK-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Animesh Baranawal updated SPARK-7980: - Comment: was deleted (was: Regarding the python support for range, I am unable to check th

[jira] [Commented] (SPARK-7980) Support SQLContext.range(end)

[ https://issues.apache.org/jira/browse/SPARK-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568722#comment-14568722 ] Animesh Baranawal commented on SPARK-7980: -- Regarding the python support for rang

[jira] [Commented] (SPARK-7980) Support SQLContext.range(end)

[ https://issues.apache.org/jira/browse/SPARK-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568720#comment-14568720 ] Animesh Baranawal commented on SPARK-7980: -- Regarding the python support for rang

[jira] [Commented] (SPARK-7993) Improve DataFrame.show() output

[ https://issues.apache.org/jira/browse/SPARK-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568717#comment-14568717 ] Akhil Thatipamula commented on SPARK-7993: -- I am planning to check whether the da

[jira] [Closed] (SPARK-8035) 2

[ https://issues.apache.org/jira/browse/SPARK-8035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nilone closed SPARK-8035. - Resolution: Invalid > 2 > - > > Key: SPARK-8035 > URL: https://issues.apache.org/j

[jira] [Closed] (SPARK-8034) spark-sql security authorization bug

[ https://issues.apache.org/jira/browse/SPARK-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nilone closed SPARK-8034. - Resolution: Invalid > spark-sql security authorization bug > > >

[jira] [Commented] (SPARK-6988) Fix Spark SQL documentation for 1.3.x

[ https://issues.apache.org/jira/browse/SPARK-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568705#comment-14568705 ] Saurabh Santhosh commented on SPARK-6988: - Hey, Can someone update the Spark docum

[jira] [Commented] (SPARK-6988) Fix Spark SQL documentation for 1.3.x

[ https://issues.apache.org/jira/browse/SPARK-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568704#comment-14568704 ] Saurabh Santhosh commented on SPARK-6988: - Hey Can someone update the spark docume

[jira] [Created] (SPARK-8035) 2

nilone created SPARK-8035: - Summary: 2 Key: SPARK-8035 URL: https://issues.apache.org/jira/browse/SPARK-8035 Project: Spark Issue Type: Bug Reporter: nilone -- This message was sent

[jira] [Created] (SPARK-8034) spark-sql security authorization bug

nilone created SPARK-8034: - Summary: spark-sql security authorization bug Key: SPARK-8034 URL: https://issues.apache.org/jira/browse/SPARK-8034 Project: Spark Issue Type: Bug Components: Bu

[jira] [Created] (SPARK-8033) spark-sql thriftserver security authorization bugs!

nilone created SPARK-8033: - Summary: spark-sql thriftserver security authorization bugs! Key: SPARK-8033 URL: https://issues.apache.org/jira/browse/SPARK-8033 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-8023) Random Number Generation inconsistent in projections in DataFrame

[ https://issues.apache.org/jira/browse/SPARK-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8023. Resolution: Fixed Fix Version/s: 1.4.0 > Random Number Generation inconsistent in projections

[jira] [Resolved] (SPARK-8020) Spark SQL conf in spark-defaults.conf make metadataHive get constructed too early

[ https://issues.apache.org/jira/browse/SPARK-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-8020. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6571 [https://github.com/apac

[jira] [Assigned] (SPARK-8032) Make NumPy version checking in mllib/__init__.py

[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8032: --- Assignee: (was: Apache Spark) > Make NumPy version checking in mllib/__init__.py > --

[jira] [Commented] (SPARK-8032) Make NumPy version checking in mllib/__init__.py

[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568679#comment-14568679 ] Apache Spark commented on SPARK-8032: - User 'MechCoder' has created a pull request for

[jira] [Assigned] (SPARK-8032) Make NumPy version checking in mllib/__init__.py

[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8032: --- Assignee: Apache Spark > Make NumPy version checking in mllib/__init__.py > -

[jira] [Updated] (SPARK-8032) Make version checking in mllib/__init__.py

[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-8032: --- Summary: Make version checking in mllib/__init__.py (was: Make version checking in mllib/__init__.py

[jira] [Updated] (SPARK-8032) Make NumPy version checking in mllib/__init__.py

[ https://issues.apache.org/jira/browse/SPARK-8032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-8032: --- Summary: Make NumPy version checking in mllib/__init__.py (was: Make version checking in mllib/__init

[jira] [Created] (SPARK-8032) Make version checking in mllib/__init__.py more robust for version NumPy 1.10

Manoj Kumar created SPARK-8032: -- Summary: Make version checking in mllib/__init__.py more robust for version NumPy 1.10 Key: SPARK-8032 URL: https://issues.apache.org/jira/browse/SPARK-8032 Project: Spar

[jira] [Assigned] (SPARK-8021) DataFrameReader/Writer in Python does not match Scala

[ https://issues.apache.org/jira/browse/SPARK-8021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8021: --- Assignee: Apache Spark (was: Davies Liu) > DataFrameReader/Writer in Python does not match S

[jira] [Commented] (SPARK-8021) DataFrameReader/Writer in Python does not match Scala

[ https://issues.apache.org/jira/browse/SPARK-8021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568672#comment-14568672 ] Apache Spark commented on SPARK-8021: - User 'davies' has created a pull request for th

[jira] [Assigned] (SPARK-8021) DataFrameReader/Writer in Python does not match Scala

[ https://issues.apache.org/jira/browse/SPARK-8021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8021: --- Assignee: Davies Liu (was: Apache Spark) > DataFrameReader/Writer in Python does not match S

<    1   2   3