Re: Handling questions in the mailing lists

2016-11-06 Thread Matei Zaharia
Even for the mailing list, I'd love to have a short set of instructions on how to submit your questions (maybe on http://spark.apache.org/community.html or maybe in the welcome email when you subscribe). It would be great if someone added that. After all, we have such instructions for

Re: Handling questions in the mailing lists

2016-11-06 Thread Reynold Xin
This is an excellent point. If we do go ahead and feature SO as a way for users to ask questions more prominently, as someone who knows SO very well, would you be willing to help write a short guideline (ideally the shorter the better, which makes it hard) to direct what goes to user@ and what

Re: Handling questions in the mailing lists

2016-11-06 Thread Maciej Szymkiewicz
Damn, I always thought that mailing list is only for nice and welcoming people and there is nothing to do for me here >:) To be serious though, there are many questions on the users list which would fit just fine on SO but it is not true in general. There are dozens of questions which are to

Re: Handling questions in the mailing lists

2016-11-06 Thread Maciej Szymkiewicz
You have to remember that Stack Overflow crowd (like me) is highly opinionated, so many questions, which could be just fine on the mailing list, will be quickly downvoted and / or closed as off-topic. Just saying... -- Best, Maciej On 11/07/2016 04:03 AM, Reynold Xin wrote: > OK I've checked

Re: Handling questions in the mailing lists

2016-11-06 Thread Reynold Xin
OK I've checked on the ASF member list (which is private so there is no public archive). It is not against any ASF rule to recommend StackOverflow as a place for users to ask questions. I don't think we can or should delete the existing user@spark list either, but we can certainly make SO more

Re: Using mention-bot to automatically ping potential reviewers

2016-11-06 Thread Holden Karau
So according the documentation it mostly uses blame lines which _might_ not be the best fit for Spark (since many of the people in the blame lines aren't going to have permission to commit the code). (Although it's possible that the algorithm that is actually used does more than the one described

Re: Structured Streaming with Kafka Source, does it work??

2016-11-06 Thread Matei Zaharia
The Kafka source will only appear in 2.0.2 -- see this thread for the current release candidate: https://lists.apache.org/thread.html/597d630135e9eb3ede54bb0cc0b61a2b57b189588f269a64b58c9243@%3Cdev.spark.apache.org%3E . You can try that right now if you want from the staging Maven repo shown

Using mention-bot to automatically ping potential reviewers

2016-11-06 Thread Nicholas Chammas
Howdy folks, I wonder if anybody has ever used Facebook's mention-bot in a project: https://github.com/facebook/mention-bot Seems like a useful tool to help address the problem of figuring out who to ping for review. If you've used it, what was your experience? Do you think it would be helpful

Re: Structured Streaming with Kafka Source, does it work??

2016-11-06 Thread Jayaradha Natarajan
Shyla! Check https://databricks.com/blog/2016/07/28/structured-streaming-in-apache-spark.html Thanks, Jayaradha On Sun, Nov 6, 2016 at 5:13 PM, shyla wrote: > I am trying to do Structured Streaming with Kafka Source. Please let me > know > where I can find some

Structured Streaming with Kafka Source, does it work??

2016-11-06 Thread shyla
I am trying to do Structured Streaming with Kafka Source. Please let me know where I can find some sample code for this. Thanks -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Structured-Streaming-with-Kafka-Source-does-it-work-tp19748.html Sent from