+1 on mesos - what Sean says
From: Andrew Melo
Sent: Friday, March 1, 2019 9:19 AM
To: Xingbo Jiang
Cc: Sean Owen; Xiangrui Meng; dev
Subject: Re: SPIP: Accelerator-aware Scheduling
Hi,
On Fri, Mar 1, 2019 at 9:48 AM Xingbo Jiang wrote:
>
> Hi Sean,
>
> To supp
+1 (binding)
Carrying my vote from dev@
checked license headers
compiled from source, ran tests, demo
checked name includes incubating
checked DISCLAIMER, LICENSE and NOTICE
checked signature and hashes
checked no unexpected binary files
On Thu, Feb 28, 2019 at 10:45 AM Seunghyun Lee wrote:
>
I saw the other comment and the INFRA JIRA.
My understanding would be that you would need to ensure the user has
permission in the “space” first.
On Fri, Mar 1, 2019 at 2:48 PM Felix Cheung wrote:
> I missed the part about design doc
>
> My suggestion for that is to open JIRA an
I missed the part about design doc
My suggestion for that is to open JIRA and link to pdf or google doc on
that.
On Fri, Mar 1, 2019 at 2:44 PM Felix Cheung wrote:
> I’ve mentioned this on the pinot site PR. My suggestion is not to use wiki
> for this.
>
> Use the site and a
I’ve mentioned this on the pinot site PR. My suggestion is not to use wiki
for this.
Use the site and anyone in the community can create new PR to update.
On Fri, Mar 1, 2019 at 1:58 PM Subbu Subramaniam
wrote:
> Hi Felix,
>
> In the Pinot project we decided to use cwiki for design documents.
Ok but was the point about appveyer as CI. It’s not hard to setup.
From: Jongyoul Lee
Sent: Tuesday, February 26, 2019 11:12 PM
To: users
Subject: Re: Windows Supports
@Felix
What I meant was the case that running Zeppelin in the Windows environment
natively wi
+1 (binding)
On Wed, Feb 27, 2019 at 10:17 PM kellen sunderland <
kellen.sunderl...@gmail.com> wrote:
> +1 (non-binding)
>
> On Wed, Feb 27, 2019, 10:15 PM Furkan KAMACI
> wrote:
>
> > +1 (binding)
> >
> > 28 Şub 2019 Per, saat 08:40 tarihinde Henry Saputra <
> > henry.sapu...@gmail.com>
> > şun
LG. Thx for putting this together.
About “updated LICENSE/NOTICE” - wasn’t that in the last month ie the timeframe
for the last report?
From: Seunghyun Lee
Sent: Monday, February 25, 2019 9:09 PM
To: dev@pinot.apache.org
Subject: Pinot Incubator PMC report for M
Testing on windows can also be done as CI on appveyer.
I don’t completely get your comment on .cmd file though. Are you suggesting we
don’t support windows and users can “run on windows” by basically running Linux
in a virtual environment? Docker is one and there is Linux on Windows
https://doc
Testing on windows can also be done as CI on appveyer.
I don’t completely get your comment on .cmd file though. Are you suggesting we
don’t support windows and users can “run on windows” by basically running Linux
in a virtual environment? Docker is one and there is Linux on Windows
https://doc
I hear three topics in this thread
1. I don’t think we should remove string. Column and string can both be “type
safe”. And I would agree we don’t *need* to break API compatibility here.
2. Gaps in python API. Extending on #1, definitely we should be consistent and
add string as param where it
+1
On Sat, Feb 23, 2019 at 11:39 PM Vinayakumar B
wrote:
> +1
>
> -Vinay
>
>
>
> On Fri, 22 Feb 2019, 7:22 am Huxing Zhang, wrote:
>
> > +1 (non-binding)
> >
> > On Thu, Feb 21, 2019 at 3:50 AM Antoine Toulme
> > wrote:
> > >
> > > Hi everyone,
> > >
> > > we've discussed the proposal for the
Building with Dockerfile is probably the best way for now.
When there is an Apache Release, Infra can setup publishing docker image (of
said release) to DockerHub under the Apache group.
From: Xiangdong Huang
Sent: Saturday, February 23, 2019 4:41 AM
To: dev@io
[
https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776080#comment-16776080
]
Felix Cheung edited comment on SPARK-26918 at 2/24/19 12:3
[
https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776080#comment-16776080
]
Felix Cheung commented on SPARK-26918:
--
actually, it does - it's a comme
EYS file while validating a release?
>
> Best,
> Seunghyun
>
> On Fri, Feb 15, 2019 at 10:44 PM Felix Cheung
> wrote:
>
>> +1
>>
>> All checked out - please see note on key and wiki.
>> Thanks for putting this together.
>>
>> Note - ideally, sig
You should check with HDInsight support
From: Jay Singh
Sent: Wednesday, February 20, 2019 11:43:23 PM
To: User
Subject: Spark-hive integration on HDInsight
I am trying to integrate spark with hive on HDInsight spark cluster .
I copied hive-site.xml in spark/co
Can you point to where you see these branches? Is it on asf Jenkins?
From: yi xu
Sent: Thursday, February 21, 2019 12:52 AM
To: dev@iotdb.apache.org
Subject: Questions about deleting branches on Apache Jenkins
Hi,
I’m curious about the branch detection of our J
I merged the fix to 2.4.
From: Felix Cheung
Sent: Wednesday, February 20, 2019 9:34 PM
To: DB Tsai; Spark dev list
Cc: Cesar Delgado
Subject: Re: [VOTE] Release Apache Spark 2.4.1 (RC2)
Could you hold for a bit - I have one more fix to get in
Could you hold for a bit - I have one more fix to get in
From: d_t...@apple.com on behalf of DB Tsai
Sent: Wednesday, February 20, 2019 12:25 PM
To: Spark dev list
Cc: Cesar Delgado
Subject: Re: [VOTE] Release Apache Spark 2.4.1 (RC2)
Okay. Let's fail rc2, and I
+1
From: Ryan Blue
Sent: Tuesday, February 19, 2019 9:34 AM
To: Jamison Bennett
Cc: dev
Subject: Re: [VOTE] SPIP: Identifiers for multi-catalog Spark
+1
On Tue, Feb 19, 2019 at 8:41 AM Jamison Bennett
wrote:
+1 (non-binding)
Jamison Bennett
Cloudera Softwa
:
From: Thijs Haarhuis
Sent: Tuesday, February 19, 2019 5:28 AM
To: Felix Cheung; user@spark.apache.org
Subject: Re: SparkR + binary type + how to get value
Hi Felix,
Thanks. I got it working now by using the unlist function.
I have another question, maybe you can help me with, since I did
, Jan 25, 2019 at 1:41 AM Felix Cheung
mailto:felixche...@apache.org>> wrote:
Yes it was discussed on dev@. We are waiting for 2.3.3 to release to resubmit.
On Thu, Jan 24, 2019 at 5:33 AM Hyukjin Kwon
mailto:gurwls...@gmail.com>> wrote:
Hi all,
I happened to find SparkR is missing
Felix Cheung created SPARK-26918:
Summary: All .md should have ASF license header
Key: SPARK-26918
URL: https://issues.apache.org/jira/browse/SPARK-26918
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-26918:
-
Description:
per policy, all md files should have the header, like eg.
[https
[
https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-26918:
-
Description:
per policy, all md files should have the header, like eg.
[https
[
https://issues.apache.org/jira/browse/SPARK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16771496#comment-16771496
]
Felix Cheung commented on SPARK-26910:
--
2.3.3 has been submitted to CRAN. we
[
https://issues.apache.org/jira/browse/SPARK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16771498#comment-16771498
]
Felix Cheung commented on SPARK-26910:
--
once that works we should look into 2
[
https://issues.apache.org/jira/browse/SPARK-26910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung reassigned SPARK-26910:
Assignee: Felix Cheung
> Re-release SparkR to C
[
https://issues.apache.org/jira/browse/SPARK-26858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16771494#comment-16771494
]
Felix Cheung commented on SPARK-26858:
--
If I understand, this is the case w
: Thijs Haarhuis
Sent: Thursday, February 14, 2019 4:01 AM
To: Felix Cheung; user@spark.apache.org
Subject: Re: SparkR + binary type + how to get value
Hi Felix,
Sure..
I have the following code:
printSchema(results)
cat("\n\n\n")
firstRow <- first(results
+1
From: Jeff Zhang
Sent: Thursday, February 14, 2019 10:28 PM
To: users
Subject: [DISCUSS] Deprecate support for Spark 2.2.x and earlier version
Hi Folks,
Spark 2.2.x will be EOL[1] from January of 2019. So I am considering to
deprecate support for spark 2.2.
+1
All checked out - please see note on key and wiki.
Thanks for putting this together.
Note - ideally, signing key should be 4096 bits
https://www.apache.org/dev/release-signing.html#note
checked license headers
compiled from source, ran tests, demo
checked name includes incubating
checked DISCL
[
https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16767935#comment-16767935
]
Felix Cheung commented on SPARK-26855:
--
possibly. sounds like there are more c
Please share your code
From: Thijs Haarhuis
Sent: Wednesday, February 13, 2019 6:09 AM
To: user@spark.apache.org
Subject: SparkR + binary type + how to get value
Hi all,
Does anybody have any experience in accessing the data from a column which has
a binary ty
+1
On Wed, Feb 13, 2019 at 7:23 AM Matt Sicker wrote:
> +1
>
> Would be interesting if this project includes training for developing
> Apache projects in any way, or would that make more sense under ComDev
> or some other project?
>
> On Wed, 13 Feb 2019 at 09:09, Dmitriy Pavlov wrote:
> >
> >
Also are you able to login to nexus yourself?
http://repository.apache.org/
I found easier as the place to find more info of the upload.
And setup steps are documented here
http://www.apache.org/dev/publishing-maven-artifacts.html
From: Felix Cheung
Sent
Ah good. Is this documented as a step somewhere? (Just want to see if this
needs to be clarified)
From: Seunghyun Lee
Sent: Tuesday, February 12, 2019 7:14 PM
To: dev@pinot.apache.org
Subject: Re: Failing on deploying artifacts
This was because I haven't set up
[
https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16765759#comment-16765759
]
Felix Cheung commented on SPARK-26855:
--
IMO we have two options:
# document t
And it might not work completely. Spark only officially supports JDK 8.
I’m not sure if JDK 9 and + support is complete?
From: Jungtaek Lim
Sent: Thursday, February 7, 2019 5:22 AM
To: Gabor Somogyi
Cc: Hande, Ranjit Dilip (Ranjit); user@spark.apache.org
Subject
This is super awesome!
From: Shivaram Venkataraman
Sent: Saturday, February 9, 2019 8:33 AM
To: Hyukjin Kwon
Cc: dev; Felix Cheung; Bryan Cutler; Liang-Chi Hsieh; Shivaram Venkataraman
Subject: Re: Vectorized R gapply[Collect]() implementation
Those speedups
... so I think we need to provide an option here.
No question that any unauthorized release is not allowed. But what about
while voting for a release?
It sounds like httpd has the same problem since some of these listed
“releases” are failed vote attempts (and so not official releases)
>From a c
Zhuge
Sent: Saturday, February 9, 2019 6:25 PM
To: Felix Cheung
Cc: Takeshi Yamamuro; Spark dev list
Subject: Re: [VOTE] Release Apache Spark 2.3.3 (RC2)
Not me. I am running zulu8, maven, and hadoop-2.7.
On Sat, Feb 9, 2019 at 5:42 PM Felix Cheung
mailto:felixcheun...@hotmail.com>> wrote:
On
[
https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-26855:
-
Description:
SparkSubmitSuite
"include an external JAR in SparkR"
fails consistent
Felix Cheung created SPARK-26855:
Summary: SparkSubmitSuite fails on a clean build
Key: SPARK-26855
URL: https://issues.apache.org/jira/browse/SPARK-26855
Project: Spark
Issue Type: Bug
-integration-tests` for the JDBC
integration tests.
I run these tests, and then I checked if they are passed.
On Sat, Feb 9, 2019 at 5:26 PM Herman van Hovell
mailto:her...@databricks.com>> wrote:
I count 2 binding votes :)...
Op vr 8 feb. 2019 om 22:36 schreef Felix Cheung
mailto:feli
[
https://issues.apache.org/jira/browse/SPARK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16764092#comment-16764092
]
Felix Cheung commented on SPARK-26762:
--
does this include head, take etc?
>
[
https://issues.apache.org/jira/browse/SPARK-26762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16764092#comment-16764092
]
Felix Cheung edited comment on SPARK-26762 at 2/9/19 7:3
I’d agree- it’s a “feature” of GitHub and I didn’t see a way to turn off
“turning a git tag into a release”
I see that there is a API to edit a release to say it is “pre-release”
https://developer.github.com/v3/repos/releases/#edit-a-release
IMO either way it should be ok because
a) the tag is cl
For this case I’d agree with Ryan. I haven’t followed this thread and the
details of the change since it’s way too much for me to consume “in my free
time” (which is 0 nowadays) but I’m pretty sure the existing behavior works for
us and very likely we don’t want it to change because of some prox
Nope, still only 1 binding vote ;)
From: Mark Hamstra
Sent: Friday, February 8, 2019 7:30 PM
To: Marcelo Vanzin
Cc: Takeshi Yamamuro; Spark dev list
Subject: Re: [VOTE] Release Apache Spark 2.3.3 (RC2)
There are 2. C'mon Marcelo, you can make it 3!
On Fri, Feb
I think this happens automatically by GitHub when a git tag is pushed?
From: kishore g
Sent: Friday, February 8, 2019 3:34 PM
To: dev@pinot.apache.org
Subject: Re: [MENTORS] Unapproved releases
Thanks Justin. I will take a look at it. Olivier, we might need your
Done as well. Also updated the note about committer.
From: Olivier Lamy
Sent: Wednesday, February 6, 2019 5:22 PM
To: dev@pinot.apache.org
Subject: Re: Mentor sign-off due next Tuesday (February 12th)
done!
On Thu, 7 Feb 2019 at 08:52, Seunghyun Lee wrote:
>
Sharing doc Chris has on the ASF release process
http://plc4x.apache.org/developers/release.html
Thanks Chris!
Very cool. I am going to share this with another incubator project, I hope you
don’t mind!
From: Christofer Dutz
Sent: Tuesday, February 5, 2019 5:02 AM
To: dev@iotdb.apache.org
Subject: Interest in release documentation?
Hi all,
I know this is early, but you
For #1 LG generally. What happened to the whole chunk of Apache ones
like Apache
Commons Net?
#2 LGTM
On Tue, Feb 5, 2019 at 9:59 PM Seunghyun Lee wrote:
> Hi Felix,
>
> Before we cut the release candidate, I have some remaining checks from you.
>
> 1. Can you double check on the update for LIC
Please email dev-subscr...@iotdb.apache.org
From: Jack Liu
Sent: Monday, February 4, 2019 12:23 PM
To: dev@iotdb.apache.org
Subject: Request to join iotdb mailing list
I Huaqing Liu, work in Microsoft and JinRui is my college, just start to
play IoTDB. Hope to
Likely need a shim (which we should have anyway) because of namespace/import
changes.
I’m huge +1 on this.
From: Hyukjin Kwon
Sent: Monday, February 4, 2019 12:27 PM
To: Xiao Li
Cc: Sean Owen; Felix Cheung; Ryan Blue; Marcelo Vanzin; Yuming Wang; dev
Subject
[
https://issues.apache.org/jira/browse/SPARK-26603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung reassigned SPARK-26603:
Assignee: Stavros Kontopoulos
> Update minikube backend in K8s integration te
[
https://issues.apache.org/jira/browse/SPARK-26603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung resolved SPARK-26603.
--
Resolution: Fixed
Fix Version/s: 3.0.0
> Update minikube backend in K8s integrat
This hasn’t changed, I think.
Seunghyun, you can open a JIRA on INFRA to request that.
From: Seunghyun Lee
Sent: Wednesday, January 30, 2019 10:25 PM
To: Daniel Gruno
Cc: us...@infra.apache.org; dev@pinot.apache.org
Subject: Re: Can we blacklist the mails from G
What’s the update and next step on this?
We have real users getting blocked by this issue.
From: Xiao Li
Sent: Wednesday, January 16, 2019 9:37 AM
To: Ryan Blue
Cc: Marcelo Vanzin; Hyukjin Kwon; Sean Owen; Felix Cheung; Yuming Wang; dev
Subject: Re: [DISCUSS
Thanks Justin!
On Thu, Jan 31, 2019 at 8:23 PM Justin Mclean wrote:
> Hi,
>
> > Could someone please add user *sbeeram*
>
> Done.
>
> Thanks,
> Justin
>
> -
> To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
> Fo
Could someone please add user *sbeeram*
On Thu, Jan 31, 2019 at 8:06 AM Felix Cheung wrote:
> (A little strange as I didn’t see this thread before, so I’m trying to
> send it)
>
>
> On Thu, Jan 31, 2019 at 8:02 AM Sunitha Beeram
> wrote:
>
>> +Felix
>>
+1
(Checked IP clearance)
On Thu, Jan 31, 2019 at 12:57 PM Wes McKinney wrote:
> Apache Arrow is receiving a donation of "DataFusion" a Rust library
> that computes analytical queries on Arrow columnar memory. It is
> intended to work together with the Arrow Rust library [1].
>
> Please vote to
(A little strange as I didn’t see this thread before, so I’m trying to send
it)
On Thu, Jan 31, 2019 at 8:02 AM Sunitha Beeram wrote:
> +Felix
>
>
>
> *From: *Sunitha Beeram
> *Date: *Wednesday, January 30, 2019 at 2:37 PM
> *To: *"general@incubator.apache.org"
> *Cc: *"priv...@pinot.apache.o
> *Sent:* Wednesday, January 30, 2019 9:55:50 AM
>
> *To:* dev@pinot.apache.org
> *Cc:* kisho...@apache.org; Felix Cheung; Subbu Subramaniam
> *Subject:* Re: Unapproved releases
>
> We will be deleting all old releases/tags using the "git push --delete
> origin ". Wi
age. Would it be
> possible to get an exception only for the latest one until we make our
> first release (expected end of this quarter)?
>
> Yes, we do plan to go to branch-based releases, much easier to manage
> without stopping checkin to the trunk.
>
> -Subbu
>
Hi Subbu
How are these releases made and what are they useful for?
Generally, it’s not good to have unofficial unvoted releases, and having
these visible links on GitHub can be confusing. To me the biggest concern
is github doesn’t give you a way to note these are unofficial and
unsupported relea
Using that during build or test should be ok.
But is com.sun.management available on openjdk?
From: Xiangdong Huang
Sent: Tuesday, January 22, 2019 6:03 PM
To: dev@iotdb.apache.org
Subject: Re: Could someone please address the last two failing tests?
Hi,
I not
Very cool, Jonas!
From: Patrick Stuedi
Sent: Friday, January 25, 2019 11:05 AM
To: dev@crail.apache.org
Subject: Re: New blog post: Call overhead Python -> C/C++
Done. Just posted a tweet.
On Fri, Jan 25, 2019 at 7:59 PM Julian Hyde wrote:
> May I suggest yo
Yes it was discussed on dev@. We are waiting for 2.3.3 to release to
resubmit.
On Thu, Jan 24, 2019 at 5:33 AM Hyukjin Kwon wrote:
> Hi all,
>
> I happened to find SparkR is missing in CRAN. See
> https://cran.r-project.org/web/packages/SparkR/index.html
>
> I remember I saw some threads about
Actually I’m going to retract the whole thing I said.
Seems like it should carry it under license for:
https://github.com/apache/spark/commit/bf4199e261c3c8dd2970e2a154c97b46fb339f02
From: Felix Cheung
Sent: Wednesday, January 23, 2019 9:20 PM
To: dev
[
https://issues.apache.org/jira/browse/SPARK-24615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16750751#comment-16750751
]
Felix Cheung commented on SPARK-24615:
--
We are interested to know as
MIT, BSD related libaries.
>
> Best,
> Seunghyun
>
> On Fri, Jan 18, 2019 at 9:53 PM Felix Cheung
> wrote:
>
> > Thanks for doing that and sending this note.
> >
> > I will help check today.
> >
> >
> >
> > ___
Please comment in the JIRA/SPIP if you are interested! We can see the community
support for a proposal like this.
From: Pola Yao
Sent: Wednesday, January 23, 2019 8:01 AM
To: Riccardo Ferrari
Cc: Felix Cheung; User
Subject: Re: I have trained a ML model, now
[
https://issues.apache.org/jira/browse/SPARK-26679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16750696#comment-16750696
]
Felix Cheung commented on SPARK-26679:
--
I find the fraction configs very confu
Thanks Jeff. I just tried to reach the rc1 tarball and realized its gone ;)
From: Jeff Zhang
Sent: Tuesday, January 22, 2019 6:17 PM
To: users; dev
Subject: Re: [VOTE] Release Apache Zeppelin 0.8.1 (RC1)
The vote is passed with 10 +1 ( 4 binding +1), Thanks ever
0;33"
> CPE_NAME="cpe:2.3:o:amazon:amazon_linux:2"
> HOME_URL="https://amazonlinux.com/";
> $ java -version
> openjdk version "1.8.0_191"
> OpenJDK Runtime Environment (build 1.8.0_191-b12)
> OpenJDK 64-Bit Server VM (build 25.191-b12, mixed mode)
>
About deployment/serving
SPIP
https://issues.apache.org/jira/browse/SPARK-26247
From: Riccardo Ferrari
Sent: Tuesday, January 22, 2019 8:07 AM
To: User
Subject: I have trained a ML model, now what?
Hi list!
I am writing here to here about your experience on pu
Agreed on the pros / cons, esp driver could be the data science notebook.
Is it worthwhile making it configurable?
From: Sean Owen
Sent: Monday, January 21, 2019 10:42 AM
To: Reynold Xin
Cc: dev
Subject: Re: Make proactive check for closure serializability option
+1
My focus is on R (sorry couldn’t cross validate what’s Sean is seeing)
tested:
reviewed doc
R package test
win-builder, r-hub
Tarball/package signature
From: Takeshi Yamamuro
Sent: Thursday, January 17, 2019 6:49 PM
To: Spark dev list
Subject: [VOTE] Releas
+1 I like Ryan last mail. Thank you for putting it clearly (should be a
spec/SPIP!)
I agree and understand the need for 3 part id. However I don’t think we should
make assumption that it must be or can only be as long as 3 parts. Once the
catalog is identified (ie. The first part), the catalog
[
https://issues.apache.org/jira/browse/SPARK-26642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung reassigned SPARK-26642:
Assignee: Luca Canali
> Add --num-executors option to spark-submit for Spark on
[
https://issues.apache.org/jira/browse/SPARK-26642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung resolved SPARK-26642.
--
Resolution: Fixed
Fix Version/s: 3.0.0
> Add --num-executors option to spark-sub
You can call coalesce to combine partitions..
From: Shivam Sharma <28shivamsha...@gmail.com>
Sent: Saturday, January 19, 2019 7:43 AM
To: user@spark.apache.org
Subject: Persist Dataframe to HDFS considering HDFS Block Size.
Hi All,
I wanted to persist dataframe
From: Li Gao
Sent: Saturday, January 19, 2019 8:43 AM
To: Felix Cheung
Cc: Serega Sheypak; user
Subject: Re: Spark on Yarn, is it possible to manually blacklist nodes before
running spark job?
on yarn it is impossible afaik. on kubernetes you can use taints to
Thanks for doing that and sending this note.
I will help check today.
From: Seunghyun Lee
Sent: Friday, January 18, 2019 3:42 PM
To: dev@pinot.apache.org
Subject: Requesting a review for updating license & notice information
Hi Mentors,
I have recently tracke
https://www.marvin-ai.org/
Does not load for me...
From: Daniel Takabayashi
Sent: Friday, January 18, 2019 6:29 PM
To: dev@marvin.apache.org
Subject: Re: Original Marvin-AI Website Redirection
Problem solved, cold you check if is working?
thanks,
Taka
Em sex,
Not as far as I recall...
From: Serega Sheypak
Sent: Friday, January 18, 2019 3:21 PM
To: user
Subject: Spark on Yarn, is it possible to manually blacklist nodes before
running spark job?
Hi, is there any possibility to tell Scheduler to blacklist specific node
+1 thanks!
From: Jeff Zhang
Sent: Tuesday, January 15, 2019 5:39 PM
To: users
Subject: Re: [Discuss] 0.8.1 Release
Hi Folks,
I will start the 0.8.1 release since there's no concerns on this.
Jeff Zhang mailto:zjf...@gmail.com>> 于2019年1月14日周一 下午8:50写道：
Hi Every
) from the spark core project..
From: Xiao Li
Sent: Tuesday, January 15, 2019 10:03 AM
To: Felix Cheung
Cc: rb...@netflix.com; Yuming Wang; dev
Subject: Re: [DISCUSS] Upgrade built-in Hive to 2.3.4
Let me take my words back. To read/write a table, Spark users do not
And we are super 100% dependent on Hive...
From: Ryan Blue
Sent: Tuesday, January 15, 2019 9:53 AM
To: Xiao Li
Cc: Yuming Wang; dev
Subject: Re: [DISCUSS] Upgrade built-in Hive to 2.3.4
How do we know that most Spark users are not using Hive? I wouldn't be
surp
Resolving https://issues.apache.org/jira/browse/HIVE-16391 means to keep Spark
on Hive 1.2?
I’m not sure that is reducing dependency on Hive - Hive is still there and it’s
a very old Hive. IMO it is increasing the risk the longer we keep on this. (And
it’s been years)
Looking at the two PR. Th
[
https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16742845#comment-16742845
]
Felix Cheung commented on SPARK-26565:
--
ok AFAIK
the first `cannot stat` is
+1
On Mon, Jan 14, 2019 at 3:20 AM Suneel Marthi
wrote:
> +1
>
> Sent from my iPhone
>
> > On Jan 13, 2019, at 5:34 PM, Thomas Weise wrote:
> >
> > Hi all,
> >
> > Following the discussion of the Hudi proposal in [1], this is a vote
> > on accepting Hudi into the Apache Incubator,
> > per the
13, 2019 5:45 AM
To: Felix Cheung
Cc: Dongjoon Hyun; dev
Subject: Re: Clean out https://dist.apache.org/repos/dist/dev/spark/ ?
Will do. Er, maybe add Shane here too -- should we disable this docs
job? are these docs used, and is there much value in nightly snapshots
of the whole site?
On Sat, Jan
[
https://issues.apache.org/jira/browse/SPARK-26120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-26120:
-
Fix Version/s: 2.3.3
> Fix a streaming query leak in Structured Streaming R te
[
https://issues.apache.org/jira/browse/SPARK-26565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16741453#comment-16741453
]
Felix Cheung commented on SPARK-26565:
--
Yeah, my point wasn’t to allow acces
These get “published” by doc nightly build from riselab Jenkins...
From: Dongjoon Hyun
Sent: Saturday, January 12, 2019 4:32 PM
To: Sean Owen
Cc: dev
Subject: Re: Clean out https://dist.apache.org/repos/dist/dev/spark/ ?
+1 for removing old docs there.
It seems
401 - 500 of 2571 matches
Mail list logo
