…my 0.00001 cent ☺ As a Spark and SO user, I would not find a separate SE a good thing.
*Part of the SO beauty is that you can filter easily and track different topics from one dashboard. *Being part of SO also gets good exposure as it raises awareness of Spark across a wider audience. *High reputation users, even if they are say “python centric”, add value by moderating/commenting. *I don’t think Spark-specific is a good thing either. Spark is typically combined with a huge range of other technologies (Avro, Parquet, Hadoop, Python, R, Scala, Akka, Java, HBase to name a few). Users that are specialists in these topics can provide value and help build quality in Spark tag. By getting a new SE you kind of exclude them. *It will take time to build enough reputable users to share the moderation burden *A high-rep Java user is likely to ask a good question. Forcing people to join an SE with rep being reset you will lose the ability to track your user (and may I say potential Evangelists) quality. By observation(no idea if true), questions by high-rep users attract much better attention than any user with 100 or less. *Last but not least, high-rep users usually know, follow and impose SO rules and best practices quite well where a Spark centric SE might not be as rule-focused. Even though rules can sometimes be annoying, overall they build quality questions so more users get involved. From: Sean Owen [mailto:so...@cloudera.com] Sent: 24 November 2016 10:53 To: assaf.mendelson; dev@spark.apache.org Subject: Re: Handling questions in the mailing lists Here's a view into the requirements, for example: http://area51.stackexchange.com/proposals/76571/emacs<https://urldefense.proofpoint.com/v2/url?u=http-3A__area51.stackexchange.com_proposals_76571_emacs&d=DgMFaQ&c=dCBwIlVXJsYZrY6gpNt0LA&r=B8E4n9FrSS85mPCi6Mfs7cyEPQnVrpcQ1zeB-JKws6A&m=MpViTGYJ6D4gvTaxzibcvkTcjzAglGjcAiOkSkJqHZA&s=JbblqRhi6skf8IQckq_B0uUmi-vtEU4-eByD_-XzH_0&e=> You're right there is a lot of activity on SO, easily 30-40 questions per day. One thing I noticed about, for example, the Data Science SE is that most questions relevant to it were still posted on SO or Cross Validated. It struggles as an SE even though there is, out there, more than enough activity that _should_ be on the specific SE. There are more niche things that end up working as an SE, so I'm not dead set against it, though it would remain unofficial and my gut is that it might just split the conversation yet further. I'd leave it, however, to anyone active on SO already to decide that it's worth a dedicated SE and just do it. On Thu, Nov 24, 2016 at 10:45 AM assaf.mendelson <assaf.mendel...@rsa.com<mailto:assaf.mendel...@rsa.com>> wrote: I am not sure what is enough traffic. Some of the SE groups already existing do not have that much traffic. Specifically the user mailing list has ~50 emails per day. It wouldn’t be much of a stretch to extract 1-2 questions per day from that. In the regular stackoverflow the apache-spark had more than 50 new questions in the last 24 hours alone (http://stackoverflow.com/questions/tagged/apache-spark?sort=newest&pageSize=50<https://urldefense.proofpoint.com/v2/url?u=http-3A__stackoverflow.com_questions_tagged_apache-2Dspark-3Fsort-3Dnewest-26pageSize-3D50&d=DgMFaQ&c=dCBwIlVXJsYZrY6gpNt0LA&r=B8E4n9FrSS85mPCi6Mfs7cyEPQnVrpcQ1zeB-JKws6A&m=MpViTGYJ6D4gvTaxzibcvkTcjzAglGjcAiOkSkJqHZA&s=PIWKkzz2E50ALvSppI-egkjBJr0ZJO7MFrLw48XUIqk&e=>). I believe this should be enough traffic (and the traffic would rise once quality answers begin to appear). From: Sean Owen [via Apache Spark Developers List] [mailto:ml-node+<mailto:ml-node%2B>[hidden email]<https://urldefense.proofpoint.com/v2/url?u=http-3A___user_SendEmail.jtp-3Ftype-3Dnode-26node-3D20008-26i-3D0&d=DgMFaQ&c=dCBwIlVXJsYZrY6gpNt0LA&r=B8E4n9FrSS85mPCi6Mfs7cyEPQnVrpcQ1zeB-JKws6A&m=MpViTGYJ6D4gvTaxzibcvkTcjzAglGjcAiOkSkJqHZA&s=CmvGVA6SmAfyMrgYe09vDeLguHlYysDT9MQjmpxqZsg&e=>] Sent: Thursday, November 24, 2016 12:32 PM To: Mendelson, Assaf Subject: Re: Handling questions in the mailing lists I don't think there's nearly enough traffic to sustain a stand-alone SE. I helped mod the Data Science SE and it's still not technically critical mass after 2 years. It would just fracture the discussion to yet another place. On Thu, Nov 24, 2016 at 6:52 AM assaf.mendelson <[hidden email]<https://urldefense.proofpoint.com/v2/url?u=http-3A___user_SendEmail.jtp-3Ftype-3Dnode-26node-3D20007-26i-3D0&d=DgMFaQ&c=dCBwIlVXJsYZrY6gpNt0LA&r=B8E4n9FrSS85mPCi6Mfs7cyEPQnVrpcQ1zeB-JKws6A&m=MpViTGYJ6D4gvTaxzibcvkTcjzAglGjcAiOkSkJqHZA&s=t_Eyig5OkwFVjh1bJTau690DaZUMy3chrAYd8qfOcJ4&e=>> wrote: Sorry to reawaken this, but I just noticed it is possible to propose new topic specific sites (http://area51.stackexchange.com/faq<https://urldefense.proofpoint.com/v2/url?u=http-3A__area51.stackexchange.com_faq&d=DgMFaQ&c=dCBwIlVXJsYZrY6gpNt0LA&r=B8E4n9FrSS85mPCi6Mfs7cyEPQnVrpcQ1zeB-JKws6A&m=MpViTGYJ6D4gvTaxzibcvkTcjzAglGjcAiOkSkJqHZA&s=77_HseiyPB7dPbk_5dTD1pSUdETnfCXO-lFSj260eBo&e=>) for stack overflow. So for example we might have a spark.stackexchange.com<https://urldefense.proofpoint.com/v2/url?u=http-3A__spark.stackexchange.com&d=DgMFaQ&c=dCBwIlVXJsYZrY6gpNt0LA&r=B8E4n9FrSS85mPCi6Mfs7cyEPQnVrpcQ1zeB-JKws6A&m=MpViTGYJ6D4gvTaxzibcvkTcjzAglGjcAiOkSkJqHZA&s=_SSyTzp_nNyqJ-4JbSyuX79ARA-ZaR7GITWFnCvsm6M&e=> spark specific site. The advantage of such a site are many. First of all it is spark specific. Secondly the reputation of people would be on spark and not on general questions and lastly (and most importantly in my opinion) it would have spark based moderators (which are all spark moderator as opposed to general technology). The process of creating such a site is not complicated. Basically someone creates a proposal (I have no problem doing so). Then creating 5 example questions (something we want on the site) and get 5 people need to ‘follow’ it within 3 days. This creates a “definition” phase. The goal is to get at least 40 questions that embody the goal of the site and have at least 10 net votes and enough people follow it. When enough traction has been made (enough questions and enough followers) then the site moves to commitment phase. In this phase users “commit” to being on the site (basically this is aimed to see the community of experts is big enough). Once all this happens the site moves into beta. This means the site becomes active and it will become a full site if it sees enough traction. I would suggest trying to set this up. Thanks, Assaf If you reply to this email, your message will be added to the discussion below: http://apache-spark-developers-list.1001551.n3.nabble.com/Handling-questions-in-the-mailing-lists-tp19690p20007.html<https://urldefense.proofpoint.com/v2/url?u=http-3A__apache-2Dspark-2Ddevelopers-2Dlist.1001551.n3.nabble.com_Handling-2Dquestions-2Din-2Dthe-2Dmailing-2Dlists-2Dtp19690p20007.html&d=DgMFaQ&c=dCBwIlVXJsYZrY6gpNt0LA&r=B8E4n9FrSS85mPCi6Mfs7cyEPQnVrpcQ1zeB-JKws6A&m=MpViTGYJ6D4gvTaxzibcvkTcjzAglGjcAiOkSkJqHZA&s=eegtwNTGbMVSJeNJ3YRsT6kfojNzsY3-yy7vbdLXfhY&e=> To start a new topic under Apache Spark Developers List, email [hidden email]<https://urldefense.proofpoint.com/v2/url?u=http-3A___user_SendEmail.jtp-3Ftype-3Dnode-26node-3D20008-26i-3D1&d=DgMFaQ&c=dCBwIlVXJsYZrY6gpNt0LA&r=B8E4n9FrSS85mPCi6Mfs7cyEPQnVrpcQ1zeB-JKws6A&m=MpViTGYJ6D4gvTaxzibcvkTcjzAglGjcAiOkSkJqHZA&s=ZqXu1PBOL6cUGNIGWfZAGV6UQadiGFNAypvPh8j85fU&e=> To unsubscribe from Apache Spark Developers List, click here. NAML<https://urldefense.proofpoint.com/v2/url?u=http-3A__apache-2Dspark-2Ddevelopers-2Dlist.1001551.n3.nabble.com_template_NamlServlet.jtp-3Fmacro-3Dmacro-5Fviewer-26id-3Dinstant-5Fhtml-2521nabble-253Aemail.naml-26base-3Dnabble.naml.namespaces.BasicNamespace-2Dnabble.view.web.template.NabbleNamespace-2Dnabble.naml.namespaces.BasicNamespace-2Dnabble.view.web.template.NabbleNamespace-2Dnabble.naml.namespaces.BasicNamespace-2Dnabble.view.web.template.NabbleNamespace-2Dnabble.view.web.template.NodeNamespace-26breadcrumbs-3Dnotify-5Fsubscribers-2521nabble-253Aemail.naml-2Dinstant-5Femails-2521nabble-253Aemail.naml-2Dsend-5Finstant-5Femail-2521nabble-253Aemail.naml&d=DgMFaQ&c=dCBwIlVXJsYZrY6gpNt0LA&r=B8E4n9FrSS85mPCi6Mfs7cyEPQnVrpcQ1zeB-JKws6A&m=MpViTGYJ6D4gvTaxzibcvkTcjzAglGjcAiOkSkJqHZA&s=D62ut_PNCSYmyBNZaPNQfBfoLHshgf48g51EQGMImgo&e=> ________________________________ View this message in context: RE: Handling questions in the mailing lists<https://urldefense.proofpoint.com/v2/url?u=http-3A__apache-2Dspark-2Ddevelopers-2Dlist.1001551.n3.nabble.com_Handling-2Dquestions-2Din-2Dthe-2Dmailing-2Dlists-2Dtp19690p20008.html&d=DgMFaQ&c=dCBwIlVXJsYZrY6gpNt0LA&r=B8E4n9FrSS85mPCi6Mfs7cyEPQnVrpcQ1zeB-JKws6A&m=MpViTGYJ6D4gvTaxzibcvkTcjzAglGjcAiOkSkJqHZA&s=Wviow8ZKdlo1L45W-fNJw0YuXtIY46HX1FJ883Vsvr0&e=> Sent from the Apache Spark Developers List mailing list archive<https://urldefense.proofpoint.com/v2/url?u=http-3A__apache-2Dspark-2Ddevelopers-2Dlist.1001551.n3.nabble.com_&d=DgMFaQ&c=dCBwIlVXJsYZrY6gpNt0LA&r=B8E4n9FrSS85mPCi6Mfs7cyEPQnVrpcQ1zeB-JKws6A&m=MpViTGYJ6D4gvTaxzibcvkTcjzAglGjcAiOkSkJqHZA&s=nC-nitRX9xPQIidJbx-rnkS7XyVcQ3JIPi85RvcqTec&e=> at Nabble.com. This e-mail (including any attachments) is private and confidential, may contain proprietary or privileged information and is intended for the named recipient(s) only. Unintended recipients are strictly prohibited from taking action on the basis of information in this e-mail and must contact the sender immediately, delete this e-mail (and all attachments) and destroy any hard copies. Nomura will not accept responsibility or liability for the accuracy or completeness of, or the presence of any virus or disabling code in, this e-mail. If verification is sought please request a hard copy. Any reference to the terms of executed transactions should be treated as preliminary only and subject to formal written confirmation by Nomura. Nomura reserves the right to retain, monitor and intercept e-mail communications through its networks (subject to and in accordance with applicable laws). No confidentiality or privilege is waived or lost by Nomura by any mistransmission of this e-mail. Any reference to "Nomura" is a reference to any entity in the Nomura Holdings, Inc. group. Please read our Electronic Communications Legal Notice which forms part of this e-mail: http://www.Nomura.com/email_disclaimer.htm