[jira] [Resolved] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

2017-07-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20307. -- Resolution: Fixed Assignee: Miao Wang Fix Version/s: 2.3.0 Target

Re: ZeroMQ licensing in Apache MXNet

2017-07-07 Thread Felix Cheung
t; > > If it is optional at compile-time, then a header file is very allowable. > As > > long as MXNet can be compiled without ZeroMQ on the box, then I see no > > issue at all. > > > > On Thu, Jul 6, 2017 at 3:51 PM, Felix Cheung > > wrote: > >

Re: Rcpp licensing in Apache MXNet

2017-07-07 Thread Felix Cheung
ally thank you for the info. Can you tell us a little more on how Spark handles the R package? The building of R package is skipped when releasing, right? Best wishes, KK On Fri, Jul 7, 2017 at 7:41 AM, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: > Re this > > T

Re: Rcpp licensing in Apache MXNet

2017-07-07 Thread Felix Cheung
t; > The Spark R package includes "R.h" and "Rinternals.h", which are both LGPL > ( > https://github.com/apache/spark/blob/master/R/pkg/src- > native/string_hash_code.c#L24-L25 > ). > > Best wishes, > > Qiang Kou > > On Thu, Jul 6, 2017 at 6:09 P

Re: ZeroMQ licensing in Apache MXNet

2017-07-07 Thread Felix Cheung
issue at all. > > On Thu, Jul 6, 2017 at 3:51 PM, Felix Cheung > wrote: > > > Isn't the release binaries going to contain bits from zeromq because of > > #include though? > > > > That header file is still going to be LGPL 3.0 licensed right? > &g

Re: Rcpp licensing in Apache MXNet

2017-07-06 Thread Felix Cheung
ckage-Dependencies). (3) Many R packages who use Rcpp to communicate with C++ have been released under Apache License, like feather (https://github.com/wesm/ feather/blob/master/R/DESCRIPTION). Best, Qiang Kou On Thu, Jul 6, 2017 at 1:20 AM, Felix Cheung mailto:felixcheun...@hotmail.com>&g

Re: ZeroMQ licensing in Apache MXNet

2017-07-06 Thread Felix Cheung
Isn't the release binaries going to contain bits from zeromq because of #include though? That header file is still going to be LGPL 3.0 licensed right? On Thu, Jul 6, 2017 at 12:45 PM John D. Ament wrote: > Mu, > > So what happens when ZeroMQ is not available, do you fall back to something > e

Re: ZeroMQ licensing in Apache MXNet

2017-07-06 Thread Felix Cheung
Isn't the release binaries going to contain bits from zeromq because of #include though? That header file is still going to be LGPL 3.0 licensed right? On Thu, Jul 6, 2017 at 12:45 PM John D. Ament wrote: > Mu, > > So what happens when ZeroMQ is not available, do you fall back to something > e

Re: Rcpp licensing in Apache MXNet

2017-07-06 Thread Felix Cheung
:46 AM Subject: Re: Rcpp licensing in Apache MXNet To: mailto:dev@mxnet.incubator.apache.org>> Hi, I am also in the Rcpp core team. Rcpp11 is a reimplementation of Rcpp using C++ 11 features. However, it lacks some features we used in MXNet R pacakge. Best, KK On Thu, Jul 6, 2017 at 1:

Rcpp licensing in Apache MXNet

2017-07-06 Thread Felix Cheung
On a related note, Rcpp, used extensively in the R package, is GPLv2/GPLv3 licensed. I'm not aware of any other R package available that supports R<->C++. https://www.apache.org/legal/resolved.html#category-x https://cran.r-project.org/web/packages/Rcpp/index.html _

Re: [VOTE] Apache Spark 2.2.0 (RC6)

2017-07-05 Thread Felix Cheung
+1 (non binding) Tested R, R package on Ubuntu and Windows, CRAN checks, manual tests with steaming & udf. _ From: Denny Lee mailto:denny.g@gmail.com>> Sent: Monday, July 3, 2017 9:30 PM Subject: Re: [VOTE] Apache Spark 2.2.0 (RC6) To: Liang-Chi Hsieh mailto:vii..

[jira] [Assigned] (SPARK-21293) R document update structured streaming

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-21293: Assignee: Felix Cheung > R document update structured stream

[jira] [Commented] (SPARK-21293) R document update structured streaming

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16072771#comment-16072771 ] Felix Cheung commented on SPARK-21293: -- and remove `(experimental).` from R g

[jira] [Closed] (SPARK-21294) R document Decision Tree in ML guide

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung closed SPARK-21294. > R document Decision Tree in ML guide > > >

[jira] [Resolved] (SPARK-21294) R document Decision Tree in ML guide

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21294. -- Resolution: Cannot Reproduce it's in master > R document Decision Tree in

[jira] [Updated] (SPARK-21290) R document Programmatically Specifying the Schema in SQL guide

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21290: - Issue Type: Documentation (was: Bug) > R document Programmatically Specifying the Schema in

[jira] [Updated] (SPARK-21291) R bucketBy partitionBy API

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21291: - Issue Type: Improvement (was: Bug) > R bucketBy partitionBy

[jira] [Updated] (SPARK-21292) R document Catalog function metadata refresh

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21292: - Issue Type: Documentation (was: Bug) > R document Catalog function metadata refr

[jira] [Updated] (SPARK-21293) R document update structured streaming

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21293: - Issue Type: Documentation (was: Bug) > R document update structured stream

[jira] [Created] (SPARK-21294) R document Decision Tree in ML guide

2017-07-03 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21294: Summary: R document Decision Tree in ML guide Key: SPARK-21294 URL: https://issues.apache.org/jira/browse/SPARK-21294 Project: Spark Issue Type

[jira] [Updated] (SPARK-21294) R document Decision Tree in ML guide

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21294: - Description: 2.3.0 release Decision tree was: 2.3.0 release Decision tree classifier >

[jira] [Created] (SPARK-21293) R document update structured streaming

2017-07-03 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21293: Summary: R document update structured streaming Key: SPARK-21293 URL: https://issues.apache.org/jira/browse/SPARK-21293 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-21292) R document Catalog function metadata refresh

2017-07-03 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21292: Summary: R document Catalog function metadata refresh Key: SPARK-21292 URL: https://issues.apache.org/jira/browse/SPARK-21292 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-21292) R document Catalog function metadata refresh

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-21292: Assignee: Felix Cheung > R document Catalog function metadata refr

[jira] [Commented] (SPARK-21291) R bucketBy partitionBy API

2017-07-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16072743#comment-16072743 ] Felix Cheung commented on SPARK-21291: -- and update the SQL programming guide

[jira] [Created] (SPARK-21291) R bucketBy partitionBy API

2017-07-03 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21291: Summary: R bucketBy partitionBy API Key: SPARK-21291 URL: https://issues.apache.org/jira/browse/SPARK-21291 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-21290) R document Programmatically Specifying the Schema in SQL guide

2017-07-03 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21290: Summary: R document Programmatically Specifying the Schema in SQL guide Key: SPARK-21290 URL: https://issues.apache.org/jira/browse/SPARK-21290 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-21208) Ability to "setLocalProperty" from sc, in sparkR

2017-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21208: - Comment: was deleted (was: User 'HyukjinKwon' has created a pull request for this is

[jira] [Comment Edited] (SPARK-21093) Multiple gapply execution occasionally failed in SparkR

2017-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16067637#comment-16067637 ] Felix Cheung edited comment on SPARK-21093 at 6/29/17 3:1

[jira] [Reopened] (SPARK-21093) Multiple gapply execution occasionally failed in SparkR

2017-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reopened SPARK-21093: -- this was reverted. > Multiple gapply execution occasionally failed in Spa

[jira] [Assigned] (SPARK-21224) Support a DDL-formatted string as schema in reading for R

2017-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-21224: Assignee: Hyukjin Kwon > Support a DDL-formatted string as schema in reading fo

[jira] [Commented] (SPARK-21224) Support a DDL-formatted string as schema in reading for R

2017-06-28 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16067608#comment-16067608 ] Felix Cheung commented on SPARK-21224: -- let's add this to from_jso

[jira] [Commented] (SPARK-21232) New built-in SQL function - Data_Type

2017-06-27 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16065972#comment-16065972 ] Felix Cheung commented on SPARK-21232: -- I don't see this in Scala

[jira] [Commented] (SPARK-21093) Multiple gapply execution occasionally failed in SparkR

2017-06-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062399#comment-16062399 ] Felix Cheung commented on SPARK-21093: -- since this is a very core change to Sp

[jira] [Resolved] (SPARK-21093) Multiple gapply execution occasionally failed in SparkR

2017-06-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21093. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-21208) Ability to "setLocalProperty" from sc, in sparkR

2017-06-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062396#comment-16062396 ] Felix Cheung commented on SPARK-21208: -- +1 > Ability to "setLocalPrope

Re: Zeppelin can let users write Java code?

2017-06-24 Thread Felix Cheung
There has been discussions on leveraging a Java REPL project to create such Java interpreter. Also Java 9 has JShell which seems to target a release in the next few months. From: Yi Lyu Sent: Saturday, June 24, 2017 9:17:32 AM To: users Subject: Zeppelin can let

[jira] [Resolved] (SPARK-21149) Add job description API for R

2017-06-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21149. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

2017-06-23 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061159#comment-16061159 ] Felix Cheung commented on SPARK-20307: -- Not much update as far as I know. Would

Re: New committer: Park Hoon

2017-06-22 Thread Felix Cheung
Congrats! From: astros...@gmail.com on behalf of Hyung Sung Shim Sent: Thursday, June 22, 2017 9:10:12 AM To: dev Subject: Re: New committer: Park Hoon Congratulations!!! 2017-06-22 20:56 GMT+09:00 Jeff Zhang : > Congratulations > > > CHALLA 于2017年6月22日周四 下午

[jira] [Resolved] (SPARK-20906) Constrained Logistic Regression for SparkR

2017-06-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20906. -- Resolution: Fixed Assignee: Miao Wang Fix Version/s: 2.3.0 Target

[jira] [Resolved] (SPARK-20917) SparkR supports string encoding consistent with R

2017-06-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20917. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.3.0

Re: Contributing to Apache Zeppelin

2017-06-21 Thread Felix Cheung
Hi welcome! Please feel free to open JIRA and add a comment that you are working on it - there is no need to wait to have the JIRA assigned to you to start. _ From: Marco Tagliabue mailto:marco.taglia...@radicalbit.io>> Sent: Wednesday, June 21, 2017 9:36 AM Subjec

Re: [build system] rolling back R to working version

2017-06-20 Thread Felix Cheung
Thanks Shane! From: shane knapp Sent: Tuesday, June 20, 2017 9:23:57 PM To: dev Subject: Re: [build system] rolling back R to working version this is done... i backported R to 3.1.1 and reinstalled all the R packages so we're starting w/a clean slate. the worke

Re: How save streaming aggregations on 'Structured Streams' in parquet format ?

2017-06-19 Thread Felix Cheung
And perhaps the error message can be improved here? From: Tathagata Das Sent: Monday, June 19, 2017 8:24:01 PM To: kaniska Mandal Cc: Burak Yavuz; user Subject: Re: How save streaming aggregations on 'Structured Streams' in parquet format ? That is not the write

[jira] [Created] (SPARK-21149) Add job description API for R

2017-06-19 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21149: Summary: Add job description API for R Key: SPARK-21149 URL: https://issues.apache.org/jira/browse/SPARK-21149 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-20889) SparkR grouped documentation for Column methods

2017-06-19 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20889. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-20892) Add SQL trunc function to SparkR

2017-06-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20892. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.3.0

[jira] [Resolved] (SPARK-20520) R streaming tests failed on Windows

2017-06-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20520. -- Resolution: Cannot Reproduce Fix Version/s: 2.2.0 tested no longer repo on windows with

[jira] [Resolved] (SPARK-21128) Running R tests multiple times failed due to pre-exiting "spark-warehouse" / "metastore_db"

2017-06-18 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-21128. -- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.3.0

Re: [VOTE] Apache Spark 2.2.0 (RC4)

2017-06-15 Thread Felix Cheung
Sounds good. Think we checked and should be good to go. Appreciated. From: Michael Armbrust Sent: Wednesday, June 14, 2017 4:51:48 PM To: Hyukjin Kwon Cc: Felix Cheung; Nick Pentreath; dev; Sean Owen Subject: Re: [VOTE] Apache Spark 2.2.0 (RC4) So, it looks

[jira] [Updated] (SPARK-21093) Multiple gapply execution occasionally failed in SparkR

2017-06-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-21093: - Shepherd: Felix Cheung > Multiple gapply execution occasionally failed in Spa

[jira] [Commented] (SPARK-21076) R dapply doesn't return array or raw columns when array have different length

2017-06-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16050052#comment-16050052 ] Felix Cheung commented on SPARK-21076: -- this looks to happen when mapping the S

Re: [VOTE] Apache Spark 2.2.0 (RC4)

2017-06-14 Thread Felix Cheung
Thanks! Will try to setup RHEL/CentOS to test it out _ From: Nick Pentreath mailto:nick.pentre...@gmail.com>> Sent: Tuesday, June 13, 2017 11:38 PM Subject: Re: [VOTE] Apache Spark 2.2.0 (RC4) To: Felix Cheung mailto:felixcheun...@hotmail.com>>,

Re: [VOTE] Apache Spark 2.2.0 (RC4)

2017-06-13 Thread Felix Cheung
eath mailto:nick.pentre...@gmail.com>>, Felix Cheung mailto:felixcheun...@hotmail.com>> For the test failure on R, I checked: Per https://github.com/apache/spark/tree/v2.2.0-rc4, 1. Windows Server 2012 R2 / R 3.3.1 - passed (https://ci.appveyor.com/project/spark-test/spark/build/755-r-test

[jira] [Commented] (SPARK-21068) SparkR error message when passed an R object rather than Java object could be more informative

2017-06-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16047338#comment-16047338 ] Felix Cheung commented on SPARK-21068: -- surely. what brings you to R

Re: SBT / PR builder builds failing on "include an external JAR in SparkR"

2017-06-12 Thread Felix Cheung
Facepalm I broken them - I was making changes to test files and of course Jenkins was only running only R tests since I was only changing R files, and everything passed there. Fix is Seq(sparkHome, "R", "pkg", "inst", "tests", To Seq(sparkHome, "R", "pkg", "tests", "fulltests", And 2 instance

Re: [VOTE] Release Apache Zeppelin 0.7.2 (RC1)

2017-06-12 Thread Felix Cheung
+1 netinst Check sig, basic tests _ From: Jongyoul Lee mailto:jongy...@gmail.com>> Sent: Saturday, June 10, 2017 2:13 AM Subject: Re: [VOTE] Release Apache Zeppelin 0.7.2 (RC1) To: dev mailto:dev@zeppelin.apache.org>> Verified - Build from source - Tested per-user/sc

[jira] [Commented] (SPARK-20520) R streaming tests failed on Windows

2017-06-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16045883#comment-16045883 ] Felix Cheung commented on SPARK-20520: -- these tests are no longer run as a par

[jira] [Updated] (SPARK-20520) R streaming tests failed on Windows

2017-06-11 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20520: - Priority: Major (was: Critical) > R streaming tests failed on Wind

Re: problem initiating spark context with pyspark

2017-06-10 Thread Felix Cheung
Curtis, assuming you are running a somewhat recent windows version you would not have access to c:\tmp, in your command example winutils.exe ls -F C:\tmp\hive Try changing the path to under your user directory. Running Spark on Windows should work :) From: Curt

[jira] [Updated] (SPARK-20877) Shorten test sets to run on CRAN

2017-06-10 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20877: - Summary: Shorten test sets to run on CRAN (was: Investigate if tests will time out on CRAN

Re: [VOTE] Apache Spark 2.2.0 (RC4)

2017-06-09 Thread Felix Cheung
Hmm, that's odd. This test would be in Jenkins too - let me double check _ From: Nick Pentreath mailto:nick.pentre...@gmail.com>> Sent: Friday, June 9, 2017 1:12 AM Subject: Re: [VOTE] Apache Spark 2.2.0 (RC4) To: dev mailto:dev@spark.apache.org>> All Scala, Python te

[jira] [Created] (SPARK-21030) extend hint syntax to support any expression for Python and R

2017-06-08 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21030: Summary: extend hint syntax to support any expression for Python and R Key: SPARK-21030 URL: https://issues.apache.org/jira/browse/SPARK-21030 Project: Spark

[jira] [Created] (SPARK-21029) All StreamingQuery should be stopped when the SparkSession is stopped

2017-06-08 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-21029: Summary: All StreamingQuery should be stopped when the SparkSession is stopped Key: SPARK-21029 URL: https://issues.apache.org/jira/browse/SPARK-21029 Project: Spark

[jira] [Commented] (SPARK-20510) SparkR 2.2 QA: Update user guide for new features & APIs

2017-06-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16043895#comment-16043895 ] Felix Cheung commented on SPARK-20510: -- credit to SPARK-20208 SPARK-20849 S

[jira] [Commented] (SPARK-20511) SparkR 2.2 QA: Check for new R APIs requiring example code

2017-06-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16043894#comment-16043894 ] Felix Cheung commented on SPARK-20511: -- credit to SPARK-20208 SPARK-20849 S

[jira] [Commented] (SPARK-20513) Update SparkR website for 2.2

2017-06-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16043892#comment-16043892 ] Felix Cheung commented on SPARK-20513: -- right, I don't think there'

Re: [VOTE] Apache Spark 2.2.0 (RC4)

2017-06-06 Thread Felix Cheung
All tasks on the R QA umbrella are completed SPARK-20512 We can close this. _ From: Sean Owen mailto:so...@cloudera.com>> Sent: Tuesday, June 6, 2017 1:16 AM Subject: Re: [VOTE] Apache Spark 2.2.0 (RC4) To: Michael Armbrust mailto:mich...@databricks.com>> Cc: mailto:

Re: [DISCUSS] Reducing default interpreters while building and releasing Zeppelin

2017-06-04 Thread Felix Cheung
e wants to install specific interpreter not included in default release package, they can use that script to install specific one. On Sun, Jun 4, 2017 at 9:11 AM, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: > Are we proposing some interpreters to be built and released separate

Re: [DISCUSS] Reducing default interpreters while building and releasing Zeppelin

2017-06-04 Thread Felix Cheung
e wants to install specific interpreter not included in default release package, they can use that script to install specific one. On Sun, Jun 4, 2017 at 9:11 AM, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: > Are we proposing some interpreters to be built and released separate

Re: [DISCUSS] Release 0.7.2

2017-06-03 Thread Felix Cheung
+1 From: moon soo Lee Sent: Saturday, June 3, 2017 10:47:39 AM To: dev Subject: [DISCUSS] Release 0.7.2 Hi, Since 0.7.1 release, we have resolved 38 issues and that includes most of critical issues in 0.7.2 umbrella issue [1]. Since 0.7.1 has major problems like

Re: [DISCUSS] Reducing default interpreters while building and releasing Zeppelin

2017-06-03 Thread Felix Cheung
Are we proposing some interpreters to be built and released separately? Is this going to be separate packaging? Or separate release pipeline? _ From: Jongyoul Lee mailto:jongy...@gmail.com>> Sent: Friday, June 2, 2017 11:04 PM Subject: [DISCUSS] Reducing default inter

Re: [DISCUSS] Reducing default interpreters while building and releasing Zeppelin

2017-06-03 Thread Felix Cheung
Are we proposing some interpreters to be built and released separately? Is this going to be separate packaging? Or separate release pipeline? _ From: Jongyoul Lee mailto:jongy...@gmail.com>> Sent: Friday, June 2, 2017 11:04 PM Subject: [DISCUSS] Reducing default inter

Re: [VOTE] Livy to enter Apache Incubator

2017-06-02 Thread Felix Cheung
+1 On Thu, Jun 1, 2017 at 11:14 AM Hitesh Shah wrote: > +1 > > -- Hitesh > > On Wed, May 31, 2017 at 6:03 AM, Sean Busbey wrote: > > > Hi folks! > > > > I'm calling a vote to accept "Livy" into the Apache Incubator. > > > > The full proposal is available below, and is also available in the wiki

[jira] [Commented] (SPARK-20854) extend hint syntax to support any expression, not just identifiers or strings

2017-06-01 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16034115#comment-16034115 ] Felix Cheung commented on SPARK-20854: -- seems like would be good to add support

Re: Livy - add external libraries from additional maven repo

2017-05-31 Thread Felix Cheung
l repo. --Ben On Tue, May 30, 2017 at 12:36 PM, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: To add, this might be an issue with Livy. I'm seeing something similar as well. If you can get a repo with calling the Livy REST API directly it will be worthwhi

Re: Livy - add external libraries from additional maven repo

2017-05-30 Thread Felix Cheung
To add, this might be an issue with Livy. I'm seeing something similar as well. If you can get a repo with calling the Livy REST API directly it will be worthwhile to follow up with the Livy community separately. From: Felix Cheung Sent: Tuesday, May 30,

Re: Livy - add external libraries from additional maven repo

2017-05-30 Thread Felix Cheung
if I recall, %dep only works with the built in Spark interpreter and not the Livy interpreter. To manage dependency win Livy you will need to set Spark conf with Livy. From: Theofilos Kakantousis Sent: Tuesday, May 30, 2017 9:05:15 AM To: users@zeppelin.apache.o

Re: Permission denied: user=zeppelin while using %spark.pyspark interpreter in AWS EMR cluster

2017-05-29 Thread Felix Cheung
Seems to be with hdfs ACL - does the service user Zeppelin have access to your storage? From: BigData Consultant Sent: Friday, May 26, 2017 10:56:31 PM To: dev@zeppelin.apache.org; us...@zeppelin.apache.org Subject: Permission denied: user=zeppelin while using %s

Re: Permission denied: user=zeppelin while using %spark.pyspark interpreter in AWS EMR cluster

2017-05-29 Thread Felix Cheung
Seems to be with hdfs ACL - does the service user Zeppelin have access to your storage? From: BigData Consultant Sent: Friday, May 26, 2017 10:56:31 PM To: d...@zeppelin.apache.org; users@zeppelin.apache.org Subject: Permission denied: user=zeppelin while using %

[jira] [Commented] (SPARK-20877) Investigate if tests will time out on CRAN

2017-05-27 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16027720#comment-16027720 ] Felix Cheung commented on SPARK-20877: -- Have a run on AppVeyor h

[jira] [Commented] (SPARK-20877) Investigate if tests will time out on CRAN

2017-05-26 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16026760#comment-16026760 ] Felix Cheung commented on SPARK-20877: -- ok, I will track down the test run tim

[jira] [Comment Edited] (SPARK-20877) Investigate if tests will time out on CRAN

2017-05-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16025861#comment-16025861 ] Felix Cheung edited comment on SPARK-20877 at 5/26/17 6:1

[jira] [Commented] (SPARK-20877) Investigate if tests will time out on CRAN

2017-05-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16025861#comment-16025861 ] Felix Cheung commented on SPARK-20877: -- One run with skip_on_cran was 27min &

[jira] [Resolved] (SPARK-20849) Document R DecisionTree

2017-05-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20849. -- Resolution: Fixed Assignee: zhengruifeng Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-20877) Investigate if tests will time out on CRAN

2017-05-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16025800#comment-16025800 ] Felix Cheung commented on SPARK-20877: -- According to one run, in Jenkins, the b

[jira] [Updated] (SPARK-20889) SparkR grouped documentation for Column methods

2017-05-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20889: - Labels: documentation (was: ) > SparkR grouped documentation for Column meth

[jira] [Updated] (SPARK-20889) SparkR grouped documentation for Column methods

2017-05-25 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20889: - Issue Type: Documentation (was: Improvement) > SparkR grouped documentation for Column meth

[jira] [Created] (SPARK-20877) Investigate if tests will time out on CRAN

2017-05-24 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-20877: Summary: Investigate if tests will time out on CRAN Key: SPARK-20877 URL: https://issues.apache.org/jira/browse/SPARK-20877 Project: Spark Issue Type: Sub

[jira] [Commented] (SPARK-20815) NullPointerException in RPackageUtils#checkManifestForR

2017-05-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16023343#comment-16023343 ] Felix Cheung commented on SPARK-20815: -- Thanks Sean > NullPointerExcep

[jira] [Assigned] (SPARK-20815) NullPointerException in RPackageUtils#checkManifestForR

2017-05-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-20815: Assignee: James Shuster > NullPointerException in RPackageUtils#checkManifestF

[jira] [Resolved] (SPARK-20727) Skip SparkR tests when missing Hadoop winutils on CRAN windows machines

2017-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20727. -- Resolution: Fixed Assignee: Shivaram Venkataraman Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

2017-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16020673#comment-16020673 ] Felix Cheung commented on SPARK-20307: -- Thanks Miao! + [~actuaryzhang]who has

[jira] [Comment Edited] (SPARK-20815) NullPointerException in RPackageUtils#checkManifestForR

2017-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16020656#comment-16020656 ] Felix Cheung edited comment on SPARK-20815 at 5/23/17 4:4

[jira] [Commented] (SPARK-20815) NullPointerException in RPackageUtils#checkManifestForR

2017-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16020656#comment-16020656 ] Felix Cheung commented on SPARK-20815: -- [~srowen] could you help add jrshus

[jira] [Resolved] (SPARK-20815) NullPointerException in RPackageUtils#checkManifestForR

2017-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20815. -- Resolution: Fixed Fix Version/s: 2.3.0 2.2.0 Target

[jira] [Resolved] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2017-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-15767. -- Resolution: Fixed Fix Version/s: 2.3.0 > Decision Tree Regression wrapper in Spa

[jira] [Assigned] (SPARK-15767) Decision Tree Regression wrapper in SparkR

2017-05-22 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung reassigned SPARK-15767: Assignee: zhengruifeng (was: Kai Jiang) > Decision Tree Regression wrapper in Spa

[jira] [Resolved] (SPARK-20736) PySpark StringIndexer supports StringOrderType

2017-05-21 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-20736. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.3.0

<    9   10   11   12   13   14   15   16   17   18   >