Re: KinesisStreamSuite failing in master branch
TD: Thanks for getting the builds back to green. On Sun, Jul 19, 2015 at 7:21 PM, Tathagata Das wrote: > The PR to fix this is out. > https://github.com/apache/spark/pull/7519 > > > On Sun, Jul 19, 2015 at 6:41 PM, Tathagata Das > wrote: > >> I am taking care of this right now. >> >> On Sun, Jul 19, 2015 at 6:08 PM, Patrick Wendell >> wrote: >> >>> I think we should just revert this patch on all affected branches. No >>> reason to leave the builds broken until a fix is in place. >>> >>> - Patrick >>> >>> On Sun, Jul 19, 2015 at 6:03 PM, Josh Rosen >>> wrote: >>> > Yep, I emailed TD about it; I think that we may need to make a change >>> to the >>> > pull request builder to fix this. Pending that, we could just revert >>> the >>> > commit that added this. >>> > >>> > On Sun, Jul 19, 2015 at 5:32 PM, Ted Yu wrote: >>> >> >>> >> Hi, >>> >> I noticed that KinesisStreamSuite fails for both hadoop profiles in >>> master >>> >> Jenkins builds. >>> >> >>> >> From >>> >> >>> https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=centos/3011/console >>> >> : >>> >> >>> >> KinesisStreamSuite: >>> >> *** RUN ABORTED *** >>> >> java.lang.AssertionError: assertion failed: Kinesis test not >>> enabled, >>> >> should not attempt to get AWS credentials >>> >> at scala.Predef$.assert(Predef.scala:179) >>> >> at >>> >> >>> org.apache.spark.streaming.kinesis.KinesisTestUtils$.getAWSCredentials(KinesisTestUtils.scala:189) >>> >> at >>> >> org.apache.spark.streaming.kinesis.KinesisTestUtils.org >>> $apache$spark$streaming$kinesis$KinesisTestUtils$$kinesisClient$lzycompute(KinesisTestUtils.scala:59) >>> >> at >>> >> org.apache.spark.streaming.kinesis.KinesisTestUtils.org >>> $apache$spark$streaming$kinesis$KinesisTestUtils$$kinesisClient(KinesisTestUtils.scala:58) >>> >> at >>> >> >>> org.apache.spark.streaming.kinesis.KinesisTestUtils.describeStream(KinesisTestUtils.scala:121) >>> >> at >>> >> >>> org.apache.spark.streaming.kinesis.KinesisTestUtils.findNonExistentStreamName(KinesisTestUtils.scala:157) >>> >> at >>> >> >>> org.apache.spark.streaming.kinesis.KinesisTestUtils.createStream(KinesisTestUtils.scala:78) >>> >> at >>> >> >>> org.apache.spark.streaming.kinesis.KinesisStreamSuite.beforeAll(KinesisStreamSuite.scala:45) >>> >> at >>> >> >>> org.scalatest.BeforeAndAfterAll$class.beforeAll(BeforeAndAfterAll.scala:187) >>> >> at >>> >> >>> org.apache.spark.streaming.kinesis.KinesisStreamSuite.beforeAll(KinesisStreamSuite.scala:33) >>> >> >>> >> >>> >> FYI >>> > >>> > >>> >>> - >>> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >>> For additional commands, e-mail: dev-h...@spark.apache.org >>> >>> >> >
Re: KinesisStreamSuite failing in master branch
The PR to fix this is out. https://github.com/apache/spark/pull/7519 On Sun, Jul 19, 2015 at 6:41 PM, Tathagata Das wrote: > I am taking care of this right now. > > On Sun, Jul 19, 2015 at 6:08 PM, Patrick Wendell > wrote: > >> I think we should just revert this patch on all affected branches. No >> reason to leave the builds broken until a fix is in place. >> >> - Patrick >> >> On Sun, Jul 19, 2015 at 6:03 PM, Josh Rosen wrote: >> > Yep, I emailed TD about it; I think that we may need to make a change >> to the >> > pull request builder to fix this. Pending that, we could just revert >> the >> > commit that added this. >> > >> > On Sun, Jul 19, 2015 at 5:32 PM, Ted Yu wrote: >> >> >> >> Hi, >> >> I noticed that KinesisStreamSuite fails for both hadoop profiles in >> master >> >> Jenkins builds. >> >> >> >> From >> >> >> https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=centos/3011/console >> >> : >> >> >> >> KinesisStreamSuite: >> >> *** RUN ABORTED *** >> >> java.lang.AssertionError: assertion failed: Kinesis test not enabled, >> >> should not attempt to get AWS credentials >> >> at scala.Predef$.assert(Predef.scala:179) >> >> at >> >> >> org.apache.spark.streaming.kinesis.KinesisTestUtils$.getAWSCredentials(KinesisTestUtils.scala:189) >> >> at >> >> org.apache.spark.streaming.kinesis.KinesisTestUtils.org >> $apache$spark$streaming$kinesis$KinesisTestUtils$$kinesisClient$lzycompute(KinesisTestUtils.scala:59) >> >> at >> >> org.apache.spark.streaming.kinesis.KinesisTestUtils.org >> $apache$spark$streaming$kinesis$KinesisTestUtils$$kinesisClient(KinesisTestUtils.scala:58) >> >> at >> >> >> org.apache.spark.streaming.kinesis.KinesisTestUtils.describeStream(KinesisTestUtils.scala:121) >> >> at >> >> >> org.apache.spark.streaming.kinesis.KinesisTestUtils.findNonExistentStreamName(KinesisTestUtils.scala:157) >> >> at >> >> >> org.apache.spark.streaming.kinesis.KinesisTestUtils.createStream(KinesisTestUtils.scala:78) >> >> at >> >> >> org.apache.spark.streaming.kinesis.KinesisStreamSuite.beforeAll(KinesisStreamSuite.scala:45) >> >> at >> >> >> org.scalatest.BeforeAndAfterAll$class.beforeAll(BeforeAndAfterAll.scala:187) >> >> at >> >> >> org.apache.spark.streaming.kinesis.KinesisStreamSuite.beforeAll(KinesisStreamSuite.scala:33) >> >> >> >> >> >> FYI >> > >> > >> >> - >> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >> For additional commands, e-mail: dev-h...@spark.apache.org >> >> >
Re: KinesisStreamSuite failing in master branch
I am taking care of this right now. On Sun, Jul 19, 2015 at 6:08 PM, Patrick Wendell wrote: > I think we should just revert this patch on all affected branches. No > reason to leave the builds broken until a fix is in place. > > - Patrick > > On Sun, Jul 19, 2015 at 6:03 PM, Josh Rosen wrote: > > Yep, I emailed TD about it; I think that we may need to make a change to > the > > pull request builder to fix this. Pending that, we could just revert the > > commit that added this. > > > > On Sun, Jul 19, 2015 at 5:32 PM, Ted Yu wrote: > >> > >> Hi, > >> I noticed that KinesisStreamSuite fails for both hadoop profiles in > master > >> Jenkins builds. > >> > >> From > >> > https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=centos/3011/console > >> : > >> > >> KinesisStreamSuite: > >> *** RUN ABORTED *** > >> java.lang.AssertionError: assertion failed: Kinesis test not enabled, > >> should not attempt to get AWS credentials > >> at scala.Predef$.assert(Predef.scala:179) > >> at > >> > org.apache.spark.streaming.kinesis.KinesisTestUtils$.getAWSCredentials(KinesisTestUtils.scala:189) > >> at > >> org.apache.spark.streaming.kinesis.KinesisTestUtils.org > $apache$spark$streaming$kinesis$KinesisTestUtils$$kinesisClient$lzycompute(KinesisTestUtils.scala:59) > >> at > >> org.apache.spark.streaming.kinesis.KinesisTestUtils.org > $apache$spark$streaming$kinesis$KinesisTestUtils$$kinesisClient(KinesisTestUtils.scala:58) > >> at > >> > org.apache.spark.streaming.kinesis.KinesisTestUtils.describeStream(KinesisTestUtils.scala:121) > >> at > >> > org.apache.spark.streaming.kinesis.KinesisTestUtils.findNonExistentStreamName(KinesisTestUtils.scala:157) > >> at > >> > org.apache.spark.streaming.kinesis.KinesisTestUtils.createStream(KinesisTestUtils.scala:78) > >> at > >> > org.apache.spark.streaming.kinesis.KinesisStreamSuite.beforeAll(KinesisStreamSuite.scala:45) > >> at > >> > org.scalatest.BeforeAndAfterAll$class.beforeAll(BeforeAndAfterAll.scala:187) > >> at > >> > org.apache.spark.streaming.kinesis.KinesisStreamSuite.beforeAll(KinesisStreamSuite.scala:33) > >> > >> > >> FYI > > > > > > - > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > For additional commands, e-mail: dev-h...@spark.apache.org > >
Re: KinesisStreamSuite failing in master branch
I think we should just revert this patch on all affected branches. No reason to leave the builds broken until a fix is in place. - Patrick On Sun, Jul 19, 2015 at 6:03 PM, Josh Rosen wrote: > Yep, I emailed TD about it; I think that we may need to make a change to the > pull request builder to fix this. Pending that, we could just revert the > commit that added this. > > On Sun, Jul 19, 2015 at 5:32 PM, Ted Yu wrote: >> >> Hi, >> I noticed that KinesisStreamSuite fails for both hadoop profiles in master >> Jenkins builds. >> >> From >> https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=centos/3011/console >> : >> >> KinesisStreamSuite: >> *** RUN ABORTED *** >> java.lang.AssertionError: assertion failed: Kinesis test not enabled, >> should not attempt to get AWS credentials >> at scala.Predef$.assert(Predef.scala:179) >> at >> org.apache.spark.streaming.kinesis.KinesisTestUtils$.getAWSCredentials(KinesisTestUtils.scala:189) >> at >> org.apache.spark.streaming.kinesis.KinesisTestUtils.org$apache$spark$streaming$kinesis$KinesisTestUtils$$kinesisClient$lzycompute(KinesisTestUtils.scala:59) >> at >> org.apache.spark.streaming.kinesis.KinesisTestUtils.org$apache$spark$streaming$kinesis$KinesisTestUtils$$kinesisClient(KinesisTestUtils.scala:58) >> at >> org.apache.spark.streaming.kinesis.KinesisTestUtils.describeStream(KinesisTestUtils.scala:121) >> at >> org.apache.spark.streaming.kinesis.KinesisTestUtils.findNonExistentStreamName(KinesisTestUtils.scala:157) >> at >> org.apache.spark.streaming.kinesis.KinesisTestUtils.createStream(KinesisTestUtils.scala:78) >> at >> org.apache.spark.streaming.kinesis.KinesisStreamSuite.beforeAll(KinesisStreamSuite.scala:45) >> at >> org.scalatest.BeforeAndAfterAll$class.beforeAll(BeforeAndAfterAll.scala:187) >> at >> org.apache.spark.streaming.kinesis.KinesisStreamSuite.beforeAll(KinesisStreamSuite.scala:33) >> >> >> FYI > > - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
Re: KinesisStreamSuite failing in master branch
Yep, I emailed TD about it; I think that we may need to make a change to the pull request builder to fix this. Pending that, we could just revert the commit that added this. On Sun, Jul 19, 2015 at 5:32 PM, Ted Yu wrote: > Hi, > I noticed that KinesisStreamSuite fails for both hadoop profiles in master > Jenkins builds. > > From > https://amplab.cs.berkeley.edu/jenkins/job/Spark-Master-Maven-with-YARN/HADOOP_PROFILE=hadoop-2.4,label=centos/3011/console > : > > KinesisStreamSuite:*** RUN ABORTED *** java.lang.AssertionError: assertion > failed: Kinesis test not enabled, should not attempt to get AWS credentials > at scala.Predef$.assert(Predef.scala:179) at > org.apache.spark.streaming.kinesis.KinesisTestUtils$.getAWSCredentials(KinesisTestUtils.scala:189) > at > org.apache.spark.streaming.kinesis.KinesisTestUtils.org$apache$spark$streaming$kinesis$KinesisTestUtils$$kinesisClient$lzycompute(KinesisTestUtils.scala:59) > at > org.apache.spark.streaming.kinesis.KinesisTestUtils.org$apache$spark$streaming$kinesis$KinesisTestUtils$$kinesisClient(KinesisTestUtils.scala:58) > at > org.apache.spark.streaming.kinesis.KinesisTestUtils.describeStream(KinesisTestUtils.scala:121) > at > org.apache.spark.streaming.kinesis.KinesisTestUtils.findNonExistentStreamName(KinesisTestUtils.scala:157) > at > org.apache.spark.streaming.kinesis.KinesisTestUtils.createStream(KinesisTestUtils.scala:78) > at > org.apache.spark.streaming.kinesis.KinesisStreamSuite.beforeAll(KinesisStreamSuite.scala:45) > at > org.scalatest.BeforeAndAfterAll$class.beforeAll(BeforeAndAfterAll.scala:187) > at > org.apache.spark.streaming.kinesis.KinesisStreamSuite.beforeAll(KinesisStreamSuite.scala:33) > > > FYI > >
