[jira] [Created] (SPARK-20196) Python to add catalog API for refreshByPath

2017-04-02 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-20196: Summary: Python to add catalog API for refreshByPath Key: SPARK-20196 URL: https://issues.apache.org/jira/browse/SPARK-20196 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-20195) SparkR to add createTable catalog API and deprecate createExternalTable

2017-04-02 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-20195: Summary: SparkR to add createTable catalog API and deprecate createExternalTable Key: SPARK-20195 URL: https://issues.apache.org/jira/browse/SPARK-20195 Project

[jira] [Resolved] (SPARK-20159) Support complete Catalog API in R

2017-04-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20159. -- Resolution: Fixed Fix Version/s: 2.2.0 > Support complete Catalog API i

[jira] [Commented] (SPARK-18570) Consider supporting other R formula operators

2017-04-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952808#comment-15952808 ] Felix Cheung commented on SPARK-18570: -- [~KrishnaKalyan3]are you working on this? > Consi

[jira] [Commented] (SPARK-18822) Support ML Pipeline in SparkR

2017-04-02 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952806#comment-15952806 ] Felix Cheung commented on SPARK-18822: -- right, sorry didn't get around to work on this... > Supp

[jira] [Updated] (SPARK-20192) SparkR 2.2.0 release note

2017-04-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20192: - Component/s: Documentation > SparkR 2.2.0 release n

[jira] [Updated] (SPARK-20192) SparkR 2.2.0 release note

2017-04-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20192: - Summary: SparkR 2.2.0 release note (was: SparkR 2.2.0 release ref note) > SparkR 2.2.0 rele

[jira] [Created] (SPARK-20192) SparkR 2.2.0 release ref note

2017-04-01 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-20192: Summary: SparkR 2.2.0 release ref note Key: SPARK-20192 URL: https://issues.apache.org/jira/browse/SPARK-20192 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-20188) Catalog recoverPartitions should allow specifying the database name

2017-04-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952519#comment-15952519 ] Felix Cheung commented on SPARK-20188: -- also, perhaps it's good to clarify "tableName" fo

[jira] [Commented] (SPARK-20188) Catalog recoverPartitions should allow specifying the database name

2017-04-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952518#comment-15952518 ] Felix Cheung commented on SPARK-20188: -- hmm, then why dbName and tableName for listColumns https

[jira] [Created] (SPARK-20188) Catalog recoverPartitions should allow specifying the database name

2017-04-01 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-20188: Summary: Catalog recoverPartitions should allow specifying the database name Key: SPARK-20188 URL: https://issues.apache.org/jira/browse/SPARK-20188 Project: Spark

[jira] [Commented] (SPARK-20188) Catalog recoverPartitions should allow specifying the database name

2017-04-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952447#comment-15952447 ] Felix Cheung commented on SPARK-20188: -- [~smilegator] > Catalog recoverPartitions should al

Re: [VOTE] Release Apache Zeppelin 0.7.1 (RC3)

2017-03-30 Thread Felix Cheung
+1 Tested bin, checked signature, ran through a bunch of tests, checked report mode, UI etc I don't think it's a blocker: When I search I see a list of note names but with empty white boxes under each of them. Isn't it suppose to show where the match is found?

[jira] [Updated] (SPARK-20159) Support complete Catalog API in R

2017-03-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20159: - Summary: Support complete Catalog API in R (was: Complete Catalog API in R) > Support compl

[jira] [Created] (SPARK-20159) Complete Catalog API in R

2017-03-30 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-20159: Summary: Complete Catalog API in R Key: SPARK-20159 URL: https://issues.apache.org/jira/browse/SPARK-20159 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-20105) Add tests for checkType and type string in structField in R

2017-03-27 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20105. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.2.0

[jira] [Resolved] (SPARK-20092) Trigger AppVeyor R tests for changes in Scala code related with R API

2017-03-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20092. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.2.0

[jira] [Resolved] (SPARK-18579) spark-csv strips whitespace (pyspark)

2017-03-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-18579. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.2.0

Re: Roadmap for 0.8.0

2017-03-22 Thread Felix Cheung
2.0.0-preview.html On Mon, Mar 20, 2017 at 11:31 PM Jongyoul Lee <jongy...@gmail.com<mailto:jongy...@gmail.com>> wrote: I agree that it will help prolong RC period and use it actually. And also we need code freeze for the new features and spend time to stabilize RC. On Tue, Mar 21,

Re: Roadmap for 0.8.0

2017-03-21 Thread Felix Cheung
g new features. And with subsequent minor release, 0.8.1, 0.8.2 ... moment we feel confident about the quality, release it as a 1.0.0 instead of 0.8.x. Once we have 1.0.0 released, then I think we can make larger, experimental changes on 2.0.0 branch aggressively, while we keep maintaining 1.

Re: Roadmap for 0.8.0

2017-03-20 Thread Felix Cheung
ures. And with subsequent minor release, 0.8.1, 0.8.2 ... moment we feel confident about the quality, release it as a 1.0.0 instead of 0.8.x. Once we have 1.0.0 released, then I think we can make larger, experimental changes on 2.0.0 branch aggressively, while we keep maintaining 1.

Re: Outstanding Spark 2.1.1 issues

2017-03-20 Thread Felix Cheung
I've been scrubbing R and think we are tracking 2 issues https://issues.apache.org/jira/browse/SPARK-19237 https://issues.apache.org/jira/browse/SPARK-19925 From: holden.ka...@gmail.com on behalf of Holden Karau

[jira] [Updated] (SPARK-19237) SparkR package on Windows waiting for a long time when no java is found launching spark-submit

2017-03-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19237: - Target Version/s: 2.1.1 > SparkR package on Windows waiting for a long time when no j

Re: Roadmap for 0.8.0

2017-03-20 Thread Felix Cheung
There are several pending visualization improvements/PRs that would be very good to get them in as well. From: Jongyoul Lee Sent: Sunday, March 19, 2017 9:03:24 PM To: dev; us...@zeppelin.apache.org Subject: Roadmap for 0.8.0 Hi dev &

Re: Roadmap for 0.8.0

2017-03-20 Thread Felix Cheung
There are several pending visualization improvements/PRs that would be very good to get them in as well. From: Jongyoul Lee Sent: Sunday, March 19, 2017 9:03:24 PM To: dev; users@zeppelin.apache.org Subject: Roadmap for 0.8.0 Hi dev &

[jira] [Resolved] (SPARK-20020) SparkR should support checkpointing DataFrame

2017-03-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20020. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.2.0

[jira] [Updated] (SPARK-20015) Document R Structured Streaming (experimental) in R vignettes and R & SS programming guide

2017-03-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20015: - Component/s: Documentation > Document R Structured Streaming (experimental) in R vignettes an

[jira] [Updated] (SPARK-20020) SparkR should support checkpointing DataFrame

2017-03-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20020: - Component/s: Documentation > SparkR should support checkpointing DataFr

[jira] [Updated] (SPARK-20026) Document R GLM Tweedie family support in programming guide and code example

2017-03-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20026: - Component/s: Documentation > Document R GLM Tweedie family support in programming guide and c

[jira] [Created] (SPARK-20026) Document R GLM Tweedie family support in programming guide and code example

2017-03-19 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-20026: Summary: Document R GLM Tweedie family support in programming guide and code example Key: SPARK-20026 URL: https://issues.apache.org/jira/browse/SPARK-20026 Project

[jira] [Resolved] (SPARK-19849) Support ArrayType in to_json function/expression

2017-03-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19849. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.2.0

[jira] [Created] (SPARK-20020) SparkR should support checkpointing DataFrame

2017-03-19 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-20020: Summary: SparkR should support checkpointing DataFrame Key: SPARK-20020 URL: https://issues.apache.org/jira/browse/SPARK-20020 Project: Spark Issue Type

[jira] [Updated] (SPARK-20020) SparkR should support checkpointing DataFrame

2017-03-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20020: - Description: As an user I want to be able to checkpoint DataFrame to run complex queries

[jira] [Updated] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2017-03-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18817: - Affects Version/s: 2.0.2 2.1.0 > Ensure nothing is written outside

[jira] [Commented] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2017-03-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931848#comment-15931848 ] Felix Cheung commented on SPARK-18817: -- we have more discussions on the PR thread and agreed

[jira] [Resolved] (SPARK-18817) Ensure nothing is written outside R's tempdir() by default

2017-03-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-18817. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.2.0

[jira] [Commented] (SPARK-19288) Failure (at test_sparkSQL.R#1300): date functions on a DataFrame in R/run-tests.sh

2017-03-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931586#comment-15931586 ] Felix Cheung commented on SPARK-19288: -- If he's on IST, it's exactly 12hr 30min ahead of PST (where

[jira] [Updated] (SPARK-19237) SparkR package on Windows waiting for a long time when no java is found launching spark-submit

2017-03-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19237: - Description: When installing SparkR as a R package (install.packages) on Windows, it will check

[jira] [Updated] (SPARK-19237) SparkR package on Windows waiting for a long time when no java is found launching spark-submit

2017-03-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19237: - Summary: SparkR package on Windows waiting for a long time when no java is found launching spark

[jira] [Created] (SPARK-20015) Document R Structured Streaming (experimental) in R vignettes and R & SS programming guide

2017-03-18 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-20015: Summary: Document R Structured Streaming (experimental) in R vignettes and R & SS programming guide Key: SPARK-20015 URL: https://issues.apache.org/jira/browse/SPARK-2

[jira] [Resolved] (SPARK-19654) Structured Streaming API for R

2017-03-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19654. -- Resolution: Fixed Fix Version/s: 2.2.0 Target Version/s: 2.2.0 > Structu

[jira] [Updated] (SPARK-19237) SparkR package waiting for a long time when no java is found launching spark-submit

2017-03-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19237: - Summary: SparkR package waiting for a long time when no java is found launching spark-submit

[jira] [Updated] (SPARK-19237) SparkR package waiting for a long time when no java is found launching spark-submit

2017-03-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19237: - Component/s: Spark Core > SparkR package waiting for a long time when no java is found launch

[jira] [Commented] (SPARK-20007) Make SparkR apply() functions robust to workers that return empty data.frame

2017-03-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931310#comment-15931310 ] Felix Cheung commented on SPARK-20007: -- +1 - also I've been meaning to add checks for data type

Re: Tensorflow not working in Zeppelin 0.7.0

2017-03-18 Thread Felix Cheung
it out on both Zeppelin and Jupyter and it seems to work. Do you have a better version of this in mind? On Tue, Mar 14, 2017 at 8:45 PM Felix Cheung <felixcheun...@hotmail.com<mailto:felixcheun...@hotmail.com>> wrote: I realize there is a discussion on be Tensorflow issue, aside fro

Re: Tensorflow not working in Zeppelin 0.7.0

2017-03-14 Thread Felix Cheung
sorflow not working in Zeppelin 0.7.0 Thanks. I have submitted a Jira ticket: https://issues.apache.org/jira/browse/ZEPPELIN-2259 Also, opened an issue on tensorflow: https://github.com/tensorflow/tensorflow/issues/8401 On Tue, Mar 14, 2017 at 8:38 AM, Felix Cheung <felixcheun...@hotmail.com<m

[jira] [Resolved] (SPARK-19828) R to support JSON array in column from_json

2017-03-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19828. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.2.0

[jira] [Commented] (SPARK-19899) FPGrowth input column naming

2017-03-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924677#comment-15924677 ] Felix Cheung commented on SPARK-19899: -- +1 on "itemsCol" looks like it is defaulting

Re: Tensorflow not working in Zeppelin 0.7.0

2017-03-14 Thread Felix Cheung
This sounds like more an issue with Tensorflow when working in notebook environment in general. Would you please open a JIRA. Also feel free to open an issue on Tensorflow as well. From: Sriram Narayanamoorthy Sent: Tuesday, March 14,

[jira] [Resolved] (SPARK-19391) Tweedie GLM API in SparkR

2017-03-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19391. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.2.0

Re: How can i convert below DataFrame array to string

2017-03-13 Thread Felix Cheung
Explode? https://spark.apache.org/docs/latest/api/python/pyspark.sql.html?highlight=explode#pyspark.sql.functions.explode For Spark questions like this, try stackoverflow spark.apache.org/community.html From: Suresh

Re: Should we consider a Spark 2.1.1 release?

2017-03-13 Thread Felix Cheung
+1 there are a lot of good fixes in overall and we need a release for Python and R packages. From: Holden Karau <hol...@pigscanfly.ca> Sent: Monday, March 13, 2017 12:06:47 PM To: Felix Cheung; Shivaram Venkataraman; dev@spark.apache.org Subject: Sho

[jira] [Updated] (SPARK-19282) R RandomForestRegressionModel summary should expose getMaxDepth

2017-03-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19282: - Summary: R RandomForestRegressionModel summary should expose getMaxDepth

[jira] [Updated] (SPARK-19282) RandomForestRegressionModel summary should expose getMaxDepth

2017-03-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19282: - Component/s: SparkR > RandomForestRegressionModel summary should expose getMaxDe

[jira] [Updated] (SPARK-19282) RandomForestRegressionModel summary should expose getMaxDepth

2017-03-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19282: - Summary: RandomForestRegressionModel summary should expose getMaxDepth

[jira] [Resolved] (SPARK-19282) RandomForestRegressionModel should expose getMaxDepth

2017-03-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19282. -- Resolution: Fixed Fix Version/s: 2.2.0 Target Version/s: 2.2.0

[jira] [Assigned] (SPARK-19282) RandomForestRegressionModel should expose getMaxDepth

2017-03-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-19282: Assignee: Xin Ren > RandomForestRegressionModel should expose getMaxDe

[jira] [Resolved] (SPARK-19818) rbind should check for name consistency of input data frames

2017-03-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19818. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.2.0

[jira] [Updated] (SPARK-19818) rbind should check for name consistency of input data frames

2017-03-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19818: - Labels: releasenotes (was: ) > rbind should check for name consistency of input data fra

[jira] [Updated] (SPARK-19818) rbind should check for name consistency of input data frames

2017-03-06 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19818: - Summary: rbind should check for name consistency of input data frames (was: SparkR union should

[jira] [Updated] (SPARK-19828) R to support JSON array in column from_json

2017-03-05 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19828: - Summary: R to support JSON array in column from_json (was: R support JSON array in column

[jira] [Commented] (SPARK-19828) R support JSON array in column from_json

2017-03-05 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896622#comment-15896622 ] Felix Cheung commented on SPARK-19828: -- see SPARK-19595 > R support JSON array in column from_j

[jira] [Created] (SPARK-19828) R support JSON array in column from_json

2017-03-05 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19828: Summary: R support JSON array in column from_json Key: SPARK-19828 URL: https://issues.apache.org/jira/browse/SPARK-19828 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-19795) R should support column functions to_json, from_json

2017-03-05 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19795. -- Resolution: Fixed Fix Version/s: 2.2.0 Target Version/s: 2.2.0 > R sho

[jira] [Updated] (SPARK-19827) spark.ml R API for PIC

2017-03-05 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19827: - Shepherd: Felix Cheung > spark.ml R API for PIC > -- > >

[jira] [Updated] (SPARK-19825) spark.ml R API for FPGrowth

2017-03-05 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19825: - Shepherd: Felix Cheung > spark.ml R API for FPGro

[jira] [Created] (SPARK-19827) spark.ml R API for PIC

2017-03-05 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19827: Summary: spark.ml R API for PIC Key: SPARK-19827 URL: https://issues.apache.org/jira/browse/SPARK-19827 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-19826) spark.ml Python API for PIC

2017-03-05 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19826: Summary: spark.ml Python API for PIC Key: SPARK-19826 URL: https://issues.apache.org/jira/browse/SPARK-19826 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-19825) spark.ml R API for FPGrowth

2017-03-05 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19825: Summary: spark.ml R API for FPGrowth Key: SPARK-19825 URL: https://issues.apache.org/jira/browse/SPARK-19825 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-19795) R should support column functions to_json, from_json

2017-03-02 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19795: Summary: R should support column functions to_json, from_json Key: SPARK-19795 URL: https://issues.apache.org/jira/browse/SPARK-19795 Project: Spark Issue

[jira] [Created] (BIGTOP-2693) Update readme for build and configuring git repo for packages

2017-03-01 Thread Felix Cheung (JIRA)
Felix Cheung created BIGTOP-2693: Summary: Update readme for build and configuring git repo for packages Key: BIGTOP-2693 URL: https://issues.apache.org/jira/browse/BIGTOP-2693 Project: Bigtop

[jira] [Commented] (SPARK-19773) SparkDataFrame should not allow duplicate names

2017-03-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890740#comment-15890740 ] Felix Cheung commented on SPARK-19773: -- Let's close this unless you want to look into getting mutate

[jira] [Resolved] (SPARK-19460) Update dataset used in R documentation, examples to reduce warning noise and confusions

2017-02-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19460. -- Resolution: Fixed Assignee: Miao Wang Fix Version/s: 2.2.0 Target

[jira] [Resolved] (SPARK-19572) Allow to disable hive in sparkR shell

2017-02-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19572. -- Resolution: Fixed Assignee: Jeff Zhang Fix Version/s: 2.2.0

[jira] [Updated] (SPARK-19572) Allow to disable hive in sparkR shell

2017-02-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19572: - Target Version/s: (was: 2.1.1) > Allow to disable hive in sparkR sh

[jira] [Commented] (SPARK-19711) Bug in gapply function

2017-02-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883337#comment-15883337 ] Felix Cheung commented on SPARK-19711: -- Thanks I'll look into this shortly. > Bug in gap

[jira] [Commented] (SPARK-19711) Bug in gapply function

2017-02-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882204#comment-15882204 ] Felix Cheung commented on SPARK-19711: -- Hmm, if you have a way to dump the data.frame in your UDF so

[jira] [Resolved] (SPARK-19682) Issue warning (or error) when subset method "[[" takes vector index

2017-02-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19682. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.2.0

[jira] [Commented] (SPARK-19711) Bug in gapply function

2017-02-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15880980#comment-15880980 ] Felix Cheung commented on SPARK-19711: -- This could happen when the return data does not match

[jira] [Resolved] (SPARK-19616) weightCol and aggregationDepth should be improved for some SparkR APIs

2017-02-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19616. -- Resolution: Fixed Assignee: Miao Wang Fix Version/s: 2.2.0 Target

[jira] [Commented] (SPARK-19639) Add spark.svmLinear example and update vignettes

2017-02-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877576#comment-15877576 ] Felix Cheung commented on SPARK-19639: -- right, I left it out because of the programming guide which

[jira] [Resolved] (SPARK-19639) Add spark.svmLinear example and update vignettes

2017-02-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19639. -- Resolution: Fixed Assignee: Miao Wang Fix Version/s: 2.2.0 Target

[jira] [Resolved] (SPARK-19337) Documentation and examples for LinearSVC

2017-02-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19337. -- Resolution: Fixed Assignee: yuhao yang Fix Version/s: 2.2.0 > Documentat

[jira] [Created] (BIGTOP-2690) gradlew toolchain fails trying to download Ant 1.9.8

2017-02-19 Thread Felix Cheung (JIRA)
Felix Cheung created BIGTOP-2690: Summary: gradlew toolchain fails trying to download Ant 1.9.8 Key: BIGTOP-2690 URL: https://issues.apache.org/jira/browse/BIGTOP-2690 Project: Bigtop Issue

[jira] [Created] (SPARK-19654) Structured Streaming API for R

2017-02-17 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19654: Summary: Structured Streaming API for R Key: SPARK-19654 URL: https://issues.apache.org/jira/browse/SPARK-19654 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-19643) Document how to use Spark/SparkR on Windows

2017-02-16 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19643: Summary: Document how to use Spark/SparkR on Windows Key: SPARK-19643 URL: https://issues.apache.org/jira/browse/SPARK-19643 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-19621) R Windows AppVeyor test should run CRAN checks

2017-02-16 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869506#comment-15869506 ] Felix Cheung commented on SPARK-19621: -- looking for contributor to help with this! > R Wind

[jira] [Created] (SPARK-19621) R Windows AppVeyor test should run CRAN checks

2017-02-15 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19621: Summary: R Windows AppVeyor test should run CRAN checks Key: SPARK-19621 URL: https://issues.apache.org/jira/browse/SPARK-19621 Project: Spark Issue Type

[jira] [Commented] (SPARK-19619) SparkR approxQuantile supports input multiple columns

2017-02-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869337#comment-15869337 ] Felix Cheung commented on SPARK-19619: -- dup of SPARK-18285 > SparkR approxQuantile supports in

[jira] [Updated] (SPARK-19460) Update dataset used in R documentation, examples to reduce warning noise and confusions

2017-02-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19460: - Yes- it's better to address the root issue with column name but it wouldn't hurt to avoid confusing

[jira] [Commented] (SPARK-19568) Must include class/method documentation for CRAN check

2017-02-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868376#comment-15868376 ] Felix Cheung commented on SPARK-19568: -- that would be great - it looks like nightly build

[jira] [Resolved] (SPARK-19399) R Coalesce on DataFrame and coalesce on column

2017-02-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19399. -- Resolution: Fixed Assignee: Felix Cheung Fix Version/s: 2.2.0

[jira] [Resolved] (SPARK-19456) Add LinearSVC R API

2017-02-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19456. -- Resolution: Fixed Assignee: Miao Wang Fix Version/s: 2.2.0 Target

[jira] [Commented] (SPARK-19456) Add LinearSVC R API

2017-02-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15867508#comment-15867508 ] Felix Cheung commented on SPARK-19456: -- need to follow up with programming guide, example, vignettes

[jira] [Resolved] (SPARK-19571) tests are failing to run on Windows with another instance Derby error with Hadoop 2.6.5

2017-02-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19571. -- Resolution: Fixed Assignee: Hyukjin Kwon > tests are failing to run on Wind

[jira] [Updated] (SPARK-19571) tests are failing to run on Windows with another instance Derby error with Hadoop 2.6.5

2017-02-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19571: - Summary: tests are failing to run on Windows with another instance Derby error with Hadoop 2.6.5

Re: welcoming Takuya Ueshin as a new Apache Spark committer

2017-02-13 Thread Felix Cheung
Congratulations! From: Xuefu Zhang Sent: Monday, February 13, 2017 11:29:12 AM To: Xiao Li Cc: Holden Karau; Reynold Xin; dev@spark.apache.org Subject: Re: welcoming Takuya Ueshin as a new Apache Spark committer Congratulations, Takuya! --Xuefu

[jira] [Resolved] (SPARK-19342) Datatype tImestamp is converted to numeric in collect method

2017-02-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19342. -- Resolution: Fixed > Datatype tImestamp is converted to numeric in collect met

[jira] [Commented] (SPARK-19571) appveyor windows tests are failing

2017-02-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863152#comment-15863152 ] Felix Cheung commented on SPARK-19571: -- possibly the originating point of the exception

[jira] [Commented] (SPARK-19571) appveyor windows tests are failing

2017-02-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863147#comment-15863147 ] Felix Cheung commented on SPARK-19571: -- https://ci.appveyor.com/project/ApacheSoftwareFoundation

<    11   12   13   14   15   16   17   18   19   20   >