Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it)
the docs and publishing builds need some attention... i was planning on looking in to this after the 2.4 cut and ubuntu port is a little further along. see: https://amplab.cs.berkeley.edu/jenkins/label/spark-docs/ https://amplab.cs.berkeley.edu/jenkins/label/spark-packaging/ https://amplab.cs.berkeley.edu/jenkins/label/spark-release/ these are all tied to amp-jenkins-worker-01, and use some ruby packages that i haven't recreated yet on the ubuntu worker(s). the build configs are... scary. and fragile. and not set up by myself. shane On Fri, Aug 31, 2018 at 1:37 PM, Marcelo Vanzin wrote: > I think there still might be an active job publishing stuff. Here's a > pretty recent build from master: > > https://dist.apache.org/repos/dist/dev/spark/2.4.0-SNAPSHOT- > 2018_08_31_12_02-32da87d-docs/_site/index.html > > But it seems only docs are being published, which makes me think it's > those builds that Shane mentioned in a recent e-mail. > > On Fri, Aug 31, 2018 at 1:29 PM Sean Owen wrote: > > > > There are some builds there, but they're not recent: > > > > https://people.apache.org/~pwendell/spark-nightly/ > > > > We can either get the jobs running again, or just knock this on the head > and remove it. > > > > Anyone know how to get it running again and want to? I have a feeling > Shane knows if anyone. Or does anyone know if we even need these at this > point? if nobody has complained in about a year, unlikely. > > > > On Fri, Aug 31, 2018 at 3:15 PM Cody Koeninger > wrote: > >> > >> Just got a question about this on the user list as well. > >> > >> Worth removing that link to pwendell's directory from the docs? > >> > >> On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski > wrote: > >> > Hi, > >> > > >> > http://spark.apache.org/developer-tools.html#nightly-builds reads: > >> > > >> >> Spark nightly packages are available at: > >> >> Latest master build: > >> >> https://people.apache.org/~pwendell/spark-nightly/spark- > master-bin/latest > >> > > >> > but the URL gives 404. Is this intended? > >> > > >> > Pozdrawiam, > >> > Jacek Laskowski > >> > > >> > https://about.me/JacekLaskowski > >> > Mastering Spark SQL https://bit.ly/mastering-spark-sql > >> > Spark Structured Streaming https://bit.ly/spark-structured-streaming > >> > Mastering Kafka Streams https://bit.ly/mastering-kafka-streams > >> > Follow me at https://twitter.com/jaceklaskowski > >> > >> - > >> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > >> > > > -- > Marcelo > > - > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > > -- Shane Knapp UC Berkeley EECS Research / RISELab Staff Technical Lead https://rise.cs.berkeley.edu
Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it)
I think there still might be an active job publishing stuff. Here's a pretty recent build from master: https://dist.apache.org/repos/dist/dev/spark/2.4.0-SNAPSHOT-2018_08_31_12_02-32da87d-docs/_site/index.html But it seems only docs are being published, which makes me think it's those builds that Shane mentioned in a recent e-mail. On Fri, Aug 31, 2018 at 1:29 PM Sean Owen wrote: > > There are some builds there, but they're not recent: > > https://people.apache.org/~pwendell/spark-nightly/ > > We can either get the jobs running again, or just knock this on the head and > remove it. > > Anyone know how to get it running again and want to? I have a feeling Shane > knows if anyone. Or does anyone know if we even need these at this point? if > nobody has complained in about a year, unlikely. > > On Fri, Aug 31, 2018 at 3:15 PM Cody Koeninger wrote: >> >> Just got a question about this on the user list as well. >> >> Worth removing that link to pwendell's directory from the docs? >> >> On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski wrote: >> > Hi, >> > >> > http://spark.apache.org/developer-tools.html#nightly-builds reads: >> > >> >> Spark nightly packages are available at: >> >> Latest master build: >> >> https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest >> > >> > but the URL gives 404. Is this intended? >> > >> > Pozdrawiam, >> > Jacek Laskowski >> > >> > https://about.me/JacekLaskowski >> > Mastering Spark SQL https://bit.ly/mastering-spark-sql >> > Spark Structured Streaming https://bit.ly/spark-structured-streaming >> > Mastering Kafka Streams https://bit.ly/mastering-kafka-streams >> > Follow me at https://twitter.com/jaceklaskowski >> >> - >> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >> -- Marcelo - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it)
If we actually build stuff nightly in Jenkins, it wouldn’t hurt to publish them IMO. It helps more people try master and test it. > On Aug 31, 2018, at 1:28 PM, Sean Owen wrote: > > There are some builds there, but they're not recent: > > https://people.apache.org/~pwendell/spark-nightly/ > > We can either get the jobs running again, or just knock this on the head and > remove it. > > Anyone know how to get it running again and want to? I have a feeling Shane > knows if anyone. Or does anyone know if we even need these at this point? if > nobody has complained in about a year, unlikely. > > On Fri, Aug 31, 2018 at 3:15 PM Cody Koeninger wrote: > Just got a question about this on the user list as well. > > Worth removing that link to pwendell's directory from the docs? > > On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski wrote: > > Hi, > > > > http://spark.apache.org/developer-tools.html#nightly-builds reads: > > > >> Spark nightly packages are available at: > >> Latest master build: > >> https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest > > > > but the URL gives 404. Is this intended? > > > > Pozdrawiam, > > Jacek Laskowski > > > > https://about.me/JacekLaskowski > > Mastering Spark SQL https://bit.ly/mastering-spark-sql > > Spark Structured Streaming https://bit.ly/spark-structured-streaming > > Mastering Kafka Streams https://bit.ly/mastering-kafka-streams > > Follow me at https://twitter.com/jaceklaskowski > > - > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it)
There are some builds there, but they're not recent: https://people.apache.org/~pwendell/spark-nightly/ We can either get the jobs running again, or just knock this on the head and remove it. Anyone know how to get it running again and want to? I have a feeling Shane knows if anyone. Or does anyone know if we even need these at this point? if nobody has complained in about a year, unlikely. On Fri, Aug 31, 2018 at 3:15 PM Cody Koeninger wrote: > Just got a question about this on the user list as well. > > Worth removing that link to pwendell's directory from the docs? > > On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski wrote: > > Hi, > > > > http://spark.apache.org/developer-tools.html#nightly-builds reads: > > > >> Spark nightly packages are available at: > >> Latest master build: > >> > https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest > > > > but the URL gives 404. Is this intended? > > > > Pozdrawiam, > > Jacek Laskowski > > > > https://about.me/JacekLaskowski > > Mastering Spark SQL https://bit.ly/mastering-spark-sql > > Spark Structured Streaming https://bit.ly/spark-structured-streaming > > Mastering Kafka Streams https://bit.ly/mastering-kafka-streams > > Follow me at https://twitter.com/jaceklaskowski > > - > To unsubscribe e-mail: dev-unsubscr...@spark.apache.org > >
Re: Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it)
Just got a question about this on the user list as well. Worth removing that link to pwendell's directory from the docs? On Sun, Jan 21, 2018 at 12:13 PM, Jacek Laskowski wrote: > Hi, > > http://spark.apache.org/developer-tools.html#nightly-builds reads: > >> Spark nightly packages are available at: >> Latest master build: >> https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest > > but the URL gives 404. Is this intended? > > Pozdrawiam, > Jacek Laskowski > > https://about.me/JacekLaskowski > Mastering Spark SQL https://bit.ly/mastering-spark-sql > Spark Structured Streaming https://bit.ly/spark-structured-streaming > Mastering Kafka Streams https://bit.ly/mastering-kafka-streams > Follow me at https://twitter.com/jaceklaskowski - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
Nightly Builds in the docs (in spark-nightly/spark-master-bin/latest? Can't seem to find it)
Hi, http://spark.apache.org/developer-tools.html#nightly-builds reads: > Spark nightly packages are available at: > Latest master build: https://people.apache.org/~pwendell/spark-nightly/spark-master-bin/latest but the URL gives 404. Is this intended? Pozdrawiam, Jacek Laskowski https://about.me/JacekLaskowski Mastering Spark SQL https://bit.ly/mastering-spark-sql Spark Structured Streaming https://bit.ly/spark-structured-streaming Mastering Kafka Streams https://bit.ly/mastering-kafka-streams Follow me at https://twitter.com/jaceklaskowski
