Re: Please add an unsubscribe link to the footer of user list email

If people want this to happen, please go comment on the INFRA ticket: https://issues.apache.org/jira/browse/INFRA-12185 Otherwise it will probably be dropped. On Mon, Jun 27, 2016 at 7:04 PM, Reynold Xin wrote: > Filed infra ticket:

Re: Please add an unsubscribe link to the footer of user list email

Filed infra ticket: https://issues.apache.org/jira/browse/INFRA-12185 On Mon, Jun 27, 2016 at 10:02 AM, Reynold Xin wrote: > Let me look into this... > > > On Monday, June 27, 2016, Nicholas Chammas > wrote: > >> Howdy, >> >> It seems like

[ANNOUNCE] Announcing Spark 1.6.2

We are happy to announce the availability of Spark 1.6.2! This maintenance release includes fixes across several areas of Spark. You can find the list of changes here: https://s.apache.org/spark-1.6.2 And download the release here: http://spark.apache.org/downloads.html

Re: SPARK-15982 breaks external DataSources

Yup this is bad. Can you create a JIRA ticket too? On Mon, Jun 27, 2016 at 12:22 PM, Koert Kuipers wrote: > hey, > > since SPARK-15982 was fixed (https://github.com/apache/spark/pull/13727) > i believe all external DataSources that rely on using .load(path) without > being a

Spark streaming connectors available for testing

The Apache Bahir project is voting a release based on Spark 2.0.0-preview. https://www.mail-archive.com/dev@bahir.apache.org/msg00085.html It currently provides the following Apache Spark Streaming connectors: streaming-akka streaming-mqtt streaming-twitter streaming-zeromq

SPARK-15982 breaks external DataSources

hey, since SPARK-15982 was fixed (https://github.com/apache/spark/pull/13727) i believe all external DataSources that rely on using .load(path) without being a FileFormat themselves are broken. i noticed this because our unit tests for the elasticsearch datasource broke. i commented on the

Re: [VOTE] Release Apache Spark 2.0.0 (RC1)

-1 : SPARK-16228 [SQL] - "Percentile" needs explicit cast to double, otherwise it throws an error. I can not move my existing 100500 quires to 2.0 transparently. 2016-06-24 11:52 GMT-07:00 Matt Cheah : > -1 because of SPARK-16181 which is a correctness regression from 1.6.

Re: Using SHUFFLE_SERVICE_ENABLED for MesosCoarseGrainedSchedulerBackend, BlockManager, and Utils?

Thanks Sean. I'm going to create a JIRA for it and start the work under it. Pozdrawiam, Jacek Laskowski https://medium.com/@jaceklaskowski/ Mastering Apache Spark http://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski On Mon, Jun 27, 2016 at 9:19 AM, Sean Owen

Re: Please add an unsubscribe link to the footer of user list email

Let me look into this... On Monday, June 27, 2016, Nicholas Chammas wrote: > Howdy, > > It seems like every week we have at least a couple of people emailing the > user list in vain with "Unsubscribe" in the subject, the body, or both. > > I remember a while back

run spark sql with script transformation faild

Hi, all: Recently, we are trying to compare with spark sql and hive on MR, and I have tried to run spark (spark1.6 rc2) sql with script transformation, the spark job faild and get an error message like: 16/06/26 11:01:28 INFO codegen.GenerateUnsafeProjection: Code generated in 19.054534 ms

Please add an unsubscribe link to the footer of user list email

Howdy, It seems like every week we have at least a couple of people emailing the user list in vain with "Unsubscribe" in the subject, the body, or both. I remember a while back that every email on the user list used to include a footer with a quick link to unsubscribe. It was removed, I believe,

Re: Using SHUFFLE_SERVICE_ENABLED for MesosCoarseGrainedSchedulerBackend, BlockManager, and Utils?

That seems OK. If it introduces another module dependency we'd have to think about it. I assume these constants should really be used consistently everywhere if possible, just because it otherwise means duplicating the defaults and possibly incorrectly. I think you could have a look at that more

RE: Associating user objects with SparkContext/SparkStreamingContext

“move the functions you are passing” yes this is what I had already done – and what I hope to avoid Thank you however for the reminder about @transient – with that I am able to create a function value that includes the non-serializable state as a @transient val. Which at least packages the

Re: Spark Thrift Server Concurrency

Spark Thrift Server is started with ./sbin/start-thriftserver.sh --master yarn-client --hiveconf hive.server2.thrift.port=10001 --num-executors 4 --executor-cores 2 --executor-memory 4G --conf spark.scheduler.mode=FAIR 20 parallel below queries are executed select distinct val2 from philips1