[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959060#comment-15959060 ] ASF subversion and git services commented on BAHIR-97: -- Commit 889de659c33dd56bad7193a4b69e6d05d061a2fd in bahir's branch refs/heads/master from [~sbcd90] [ https://git-wip-us.apache.org/repos/asf?p=bahir.git;h=889de65 ] [BAHIR-97] Akka as SQL Streaming datasource. Closes #38. > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959061#comment-15959061 ] ASF GitHub Bot commented on BAHIR-97: - Github user asfgit closed the pull request at: https://github.com/apache/bahir/pull/38 > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957966#comment-15957966 ] ASF GitHub Bot commented on BAHIR-97: - Github user ckadner commented on the issue: https://github.com/apache/bahir/pull/38 Thanks @lresende and @sbcd90 - LGTM > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957909#comment-15957909 ] ASF GitHub Bot commented on BAHIR-97: - Github user sbcd90 commented on the issue: https://github.com/apache/bahir/pull/38 Hi @lresende , I have removed the usage of the deprecated api s & also opened a jira issue named [BAHIR-103](https://issues.apache.org/jira/browse/BAHIR-103) for refactoring the utils classes into bahir-common. > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957847#comment-15957847 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Build successful > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957848#comment-15957848 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Refer to this link for build results (access rights to CI server needed): http://169.45.79.58:8080/job/bahir_spark_pr_builder/53/ > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957842#comment-15957842 ] ASF GitHub Bot commented on BAHIR-97: - Github user sbcd90 commented on the issue: https://github.com/apache/bahir/pull/38 retest this please > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957677#comment-15957677 ] ASF GitHub Bot commented on BAHIR-97: - Github user lresende commented on the issue: https://github.com/apache/bahir/pull/38 Once we remove the deprecated api usages, we should be ready to merge unless someone has other comments. > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957650#comment-15957650 ] ASF GitHub Bot commented on BAHIR-97: - Github user lresende commented on a diff in the pull request: https://github.com/apache/bahir/pull/38#discussion_r110023018 --- Diff: sql-streaming-akka/src/main/scala/org/apache/bahir/utils/Logging.scala --- @@ -0,0 +1,24 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + *http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.bahir.utils + +import org.slf4j.LoggerFactory + +trait Logging { + final val log = LoggerFactory.getLogger(this.getClass.getName.stripSuffix("$")) +} --- End diff -- Similar comment as file above. > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957649#comment-15957649 ] ASF GitHub Bot commented on BAHIR-97: - Github user lresende commented on a diff in the pull request: https://github.com/apache/bahir/pull/38#discussion_r110021854 --- Diff: sql-streaming-akka/src/test/scala/org/apache/bahir/sql/streaming/akka/AkkaStreamSourceSuite.scala --- @@ -0,0 +1,188 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + *http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.bahir.sql.streaming.akka + +import java.io.File + +import scala.collection.JavaConverters._ +import scala.collection.mutable + +import org.scalatest.BeforeAndAfter + +import org.apache.spark.{SharedSparkContext, SparkFunSuite} +import org.apache.spark.sql.{DataFrame, SQLContext} +import org.apache.spark.sql.execution.streaming.FileStreamSource.Timestamp +import org.apache.spark.sql.execution.streaming.LongOffset + +import org.apache.bahir.utils.BahirUtils + +class AkkaStreamSourceSuite extends SparkFunSuite with SharedSparkContext with BeforeAndAfter { + + protected var akkaTestUtils: AkkaTestUtils = _ + protected val tempDir: File = +new File(System.getProperty("java.io.tmpdir") + "/spark-akka-persistence") + + akkaTestUtils = new AkkaTestUtils + akkaTestUtils.setup() + + before { +tempDir.mkdirs() + } + + after { +Persistence.close() +BahirUtils.recursiveDeleteDir(tempDir) + } + + protected val tmpDir: String = tempDir.getAbsolutePath + + protected def createStreamingDataframe(dir: String = tmpDir): (SQLContext, DataFrame) = { + +val sqlContext: SQLContext = new SQLContext(sc) + --- End diff -- Would you please change to use Sparksession instead of directly instantiating a SQLContext. > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957651#comment-15957651 ] ASF GitHub Bot commented on BAHIR-97: - Github user lresende commented on a diff in the pull request: https://github.com/apache/bahir/pull/38#discussion_r110021902 --- Diff: sql-streaming-akka/src/test/scala/org/apache/bahir/sql/streaming/akka/AkkaStreamSourceSuite.scala --- @@ -0,0 +1,188 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + *http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.bahir.sql.streaming.akka + +import java.io.File + +import scala.collection.JavaConverters._ +import scala.collection.mutable + +import org.scalatest.BeforeAndAfter + +import org.apache.spark.{SharedSparkContext, SparkFunSuite} +import org.apache.spark.sql.{DataFrame, SQLContext} +import org.apache.spark.sql.execution.streaming.FileStreamSource.Timestamp +import org.apache.spark.sql.execution.streaming.LongOffset + +import org.apache.bahir.utils.BahirUtils + +class AkkaStreamSourceSuite extends SparkFunSuite with SharedSparkContext with BeforeAndAfter { + + protected var akkaTestUtils: AkkaTestUtils = _ + protected val tempDir: File = +new File(System.getProperty("java.io.tmpdir") + "/spark-akka-persistence") + + akkaTestUtils = new AkkaTestUtils + akkaTestUtils.setup() + + before { +tempDir.mkdirs() + } + + after { +Persistence.close() +BahirUtils.recursiveDeleteDir(tempDir) + } + + protected val tmpDir: String = tempDir.getAbsolutePath + + protected def createStreamingDataframe(dir: String = tmpDir): (SQLContext, DataFrame) = { + +val sqlContext: SQLContext = new SQLContext(sc) + +sqlContext.setConf("spark.sql.streaming.checkpointLocation", dir + "/checkpoint") + +val dataFrame: DataFrame = + sqlContext.readStream.format("org.apache.bahir.sql.streaming.akka.AkkaStreamSourceProvider") +.option("urlOfPublisher", akkaTestUtils.getFeederActorUri()) +.option("persistenceDirPath", dir + "/persistence").load() +(sqlContext, dataFrame) + } +} + +class BasicAkkaSourceSuite extends AkkaStreamSourceSuite { + + private def writeStreamResults(sqlContext: SQLContext, dataFrame: DataFrame, + waitDuration: Long): Boolean = { +import sqlContext.implicits._ +dataFrame.as[(String, Timestamp)].writeStream.format("parquet") + .start(s"$tmpDir/parquet/t.parquet").awaitTermination(waitDuration) + } + + private def readBackSreamingResults(sqlContext: SQLContext): mutable.Buffer[String] = { +import sqlContext.implicits._ +val asList = + sqlContext.read.schema(AkkaStreamConstants.SCHEMA_DEFAULT) + .parquet(s"$tmpDir/parquet/t.parquet").as[(String, Timestamp)].map(_._1) + .collectAsList().asScala +asList + } + + test("basic usage") { +val message = "Akka is a reactive framework" + +akkaTestUtils.setMessage(message) +akkaTestUtils.setCountOfMessages(1) + +val (sqlContext: SQLContext, dataFrame: DataFrame) = createStreamingDataframe() + +writeStreamResults(sqlContext, dataFrame, 1) + +val resultBuffer: mutable.Buffer[String] = readBackSreamingResults(sqlContext) + +assert(resultBuffer.size === 1) +assert(resultBuffer.head === message) + } + + test("Send and receive 100 messages.") { +val message = "Akka is a reactive framework" + +akkaTestUtils.setMessage(message) +akkaTestUtils.setCountOfMessages(100) + +val (sqlContext: SQLContext, dataFrame: DataFrame) = createStreamingDataframe() + +writeStreamResults(sqlContext, dataFrame, 1) + +val resultBuffer: mutable.Buffer[String] = readBackSreamingResults(sqlContext) + +assert(resultBuffer.size === 100)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957648#comment-15957648 ] ASF GitHub Bot commented on BAHIR-97: - Github user lresende commented on a diff in the pull request: https://github.com/apache/bahir/pull/38#discussion_r110022955 --- Diff: sql-streaming-akka/src/main/scala/org/apache/bahir/utils/BahirUtils.scala --- @@ -0,0 +1,47 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contributor license agreements. See the NOTICE file distributed with + * this work for additional information regarding copyright ownership. + * The ASF licenses this file to You under the Apache License, Version 2.0 + * (the "License"); you may not use this file except in compliance with + * the License. You may obtain a copy of the License at + * + *http://www.apache.org/licenses/LICENSE-2.0 + * + * Unless required by applicable law or agreed to in writing, software + * distributed under the License is distributed on an "AS IS" BASIS, + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + * See the License for the specific language governing permissions and + * limitations under the License. + */ + +package org.apache.bahir.utils + +import java.io.{File, IOException} +import java.nio.file.{Files, FileVisitResult, Path, SimpleFileVisitor} +import java.nio.file.attribute.BasicFileAttributes + +object BahirUtils extends Logging { + --- End diff -- We should not duplicate these two classes on each extension. Could you create a jira for refactoring these into a bahir-common project that is shared with the other extensions. > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957311#comment-15957311 ] ASF GitHub Bot commented on BAHIR-97: - Github user sbcd90 commented on the issue: https://github.com/apache/bahir/pull/38 Hi @ckadner , I haven't seen any updates from you..plz let me know if anything else is required from my side... > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952571#comment-15952571 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Build successful > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952572#comment-15952572 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Refer to this link for build results (access rights to CI server needed): http://169.45.79.58:8080/job/bahir_spark_pr_builder/50/ > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952569#comment-15952569 ] ASF GitHub Bot commented on BAHIR-97: - Github user sbcd90 commented on the issue: https://github.com/apache/bahir/pull/38 retest this please > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951772#comment-15951772 ] ASF GitHub Bot commented on BAHIR-97: - Github user ckadner commented on the issue: https://github.com/apache/bahir/pull/38 @sbcd90 -- thanks for you continuous updates and sorry for the piecemeal review from my end ... I started with your test cases since we were still in the process of fixing our Jenkins build setup. But your test cases are great now :-) Perhaps more important, my first request to you should have been to add a README and examples so users can start using your connector without having to read through too much code ... i.e. please further follow the precedence set by `sql-streaming-mqtt`. **Thank you!** > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951751#comment-15951751 ] ASF GitHub Bot commented on BAHIR-97: - Github user ckadner commented on a diff in the pull request: https://github.com/apache/bahir/pull/38#discussion_r109263328 --- Diff: sql-streaming-akka/src/main/assembly/assembly.xml --- @@ -0,0 +1,44 @@ + + +test-jar-with-dependencies + +jar + +false + + + + ${project.build.directory}/scala-${scala.binary.version}/test-classes + + + + + + +true +test +true + +org.apache.hadoop:*:jar +org.apache.zookeeper:*:jar +org.apache.avro:*:jar + + + + + --- End diff -- add new line > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951753#comment-15951753 ] ASF GitHub Bot commented on BAHIR-97: - Github user ckadner commented on a diff in the pull request: https://github.com/apache/bahir/pull/38#discussion_r109263538 --- Diff: sql-streaming-akka/src/test/resources/feeder_actor.conf --- @@ -0,0 +1,34 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NOTICE file distributed with +# this work for additional information regarding copyright ownership. +# The ASF licenses this file to You under the Apache License, Version 2.0 +# (the "License"); you may not use this file except in compliance with +# the License. You may obtain a copy of the License at +# +#http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. +# + +akka { + loglevel = "INFO" + actor { +provider = "akka.remote.RemoteActorRefProvider" + } + remote { +enabled-transports = ["akka.remote.netty.tcp"] +netty.tcp { + hostname = "127.0.0.1" + port = 0 +} +log-sent-messages = on +log-received-messages = on + } + loggers.0 = "akka.event.slf4j.Slf4jLogger" + log-dead-letters-during-shutdown = "off" +} --- End diff -- add new line > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951752#comment-15951752 ] ASF GitHub Bot commented on BAHIR-97: - Github user ckadner commented on a diff in the pull request: https://github.com/apache/bahir/pull/38#discussion_r109263376 --- Diff: sql-streaming-akka/pom.xml --- @@ -0,0 +1,120 @@ + + + +http://maven.apache.org/POM/4.0.0; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd;> +4.0.0 + +org.apache.bahir +bahir-parent_2.11 +2.2.0-SNAPSHOT +../pom.xml + + +org.apache.bahir +spark-sql-streaming-akka_2.11 + +sql-streaming-akka + +jar +Apache Bahir - Spark SQL Streaming Akka +http://bahir.apache.org + + + +org.apache.spark +spark-tags_${scala.binary.version} + + +org.apache.spark +spark-sql_${scala.binary.version} +${spark.version} + + +org.apache.spark +spark-sql_${scala.binary.version} +${spark.version} +test-jar +test + + +org.apache.spark +spark-core_${scala.binary.version} +${spark.version} +test-jar +test + + +${akka.group} +akka-actor_${scala.binary.version} +${akka.version} + + +${akka.group} +akka-remote_${scala.binary.version} +${akka.version} + + +${akka.group} +akka-slf4j_${scala.binary.version} +${akka.version} + + +org.rocksdb +rocksdbjni +5.1.2 + + + + + target/scala-${scala.binary.version}/classes + target/scala-${scala.binary.version}/test-classes + + + +org.apache.maven.plugins +maven-source-plugin + + + + +org.apache.maven.plugins +maven-assembly-plugin + + +test-jar-with-dependencies +package + +single + + + + spark-streaming-akka-test-${project.version} + ${project.build.directory}/scala-${scala.binary.version} +false + +false + + src/main/assembly/assembly.xml + + + + + + + + --- End diff -- add new line > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951504#comment-15951504 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Build successful > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951505#comment-15951505 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Refer to this link for build results (access rights to CI server needed): http://169.45.79.58:8080/job/bahir_spark_pr_builder/48/ > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951503#comment-15951503 ] ASF GitHub Bot commented on BAHIR-97: - Github user sbcd90 commented on the issue: https://github.com/apache/bahir/pull/38 Hi @ckadner , I have made the changes you mentioned to remove the remaining verbose. Please have a look. > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951502#comment-15951502 ] ASF GitHub Bot commented on BAHIR-97: - Github user sbcd90 commented on the issue: https://github.com/apache/bahir/pull/38 retest this please > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950080#comment-15950080 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Build successful > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950081#comment-15950081 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Refer to this link for build results (access rights to CI server needed): http://169.45.79.58:8080/job/bahir_spark_pr_builder/42/ > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950075#comment-15950075 ] ASF GitHub Bot commented on BAHIR-97: - Github user sbcd90 commented on the issue: https://github.com/apache/bahir/pull/38 Hi @ckadner , Thanks for your reply. I have added `log4j.properties` in the test sources folder. > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950074#comment-15950074 ] ASF GitHub Bot commented on BAHIR-97: - Github user sbcd90 commented on the issue: https://github.com/apache/bahir/pull/38 retest this please > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949610#comment-15949610 ] ASF GitHub Bot commented on BAHIR-97: - Github user sbcd90 commented on the issue: https://github.com/apache/bahir/pull/38 Hi @ckadner , the test cases are skipped..any reason for that? > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944689#comment-15944689 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Refer to this link for build results (access rights to CI server needed): http://169.45.79.58:8080/job/bahir_spark_pr_builder/38/ > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944648#comment-15944648 ] ASF GitHub Bot commented on BAHIR-97: - Github user ckadner commented on the issue: https://github.com/apache/bahir/pull/38 @sbcd90 -- can you change your test suite to chose the `akka.remote.netty.tcp.port` dynamically? > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944580#comment-15944580 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Refer to this link for build results (access rights to CI server needed): http://169.45.79.58:8080/job/bahir_spark_pr_builder/37/ > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944579#comment-15944579 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Build failed, see build log for details > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944577#comment-15944577 ] ASF GitHub Bot commented on BAHIR-97: - Github user ckadner commented on the issue: https://github.com/apache/bahir/pull/38 retest this please > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944366#comment-15944366 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Refer to this link for build results (access rights to CI server needed): http://169.45.79.58:8080/job/Apache%20Bahir%20-%20Pull%20Request%20Builder/36/ > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944365#comment-15944365 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Build successful > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944363#comment-15944363 ] ASF GitHub Bot commented on BAHIR-97: - Github user lresende commented on the issue: https://github.com/apache/bahir/pull/38 retest this please > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944364#comment-15944364 ] ASF GitHub Bot commented on BAHIR-97: - Github user ckadner commented on the issue: https://github.com/apache/bahir/pull/38 @sbcd90 -- Scalatests should be sufficient. We need to fix our Jenkins integration test setup. Not an action item for you :-) > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944336#comment-15944336 ] ASF GitHub Bot commented on BAHIR-97: - Github user sbcd90 commented on the issue: https://github.com/apache/bahir/pull/38 Hello @ckadner , Are any actions need to be taken from my side? Like provide Java tests(Junits) instead of scala? > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944310#comment-15944310 ] ASF GitHub Bot commented on BAHIR-97: - Github user ckadner commented on the issue: https://github.com/apache/bahir/pull/38 Note, our Jenkins build server does not currently run Scalatests ... > 17:20:55 No tests were executed. ``` 17:20:54 [INFO] 17:20:54 [INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @ spark-sql-streaming-akka_2.11 --- 17:20:54 17:20:54 --- 17:20:54 T E S T S 17:20:54 --- 17:20:54 OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0 17:20:54 17:20:54 Results : 17:20:54 17:20:54 Tests run: 0, Failures: 0, Errors: 0, Skipped: 0 17:20:54 17:20:54 [INFO] 17:20:54 [INFO] --- maven-surefire-plugin:2.19.1:test (test) @ spark-sql-streaming-akka_2.11 --- 17:20:54 [INFO] Skipping execution of surefire because it has already been run for this configuration 17:20:54 [INFO] 17:20:54 [INFO] --- scalatest-maven-plugin:1.0:test (test) @ spark-sql-streaming-akka_2.11 --- 17:20:54 OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0 17:20:55 Discovery starting. 17:20:55 Discovery completed in 36 milliseconds. 17:20:55 Run starting. Expected test count is: 0 17:20:55 DiscoverySuite: 17:20:55 Run completed in 100 milliseconds. 17:20:55 Total number of tests run: 0 17:20:55 Suites: completed 1, aborted 0 17:20:55 Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0 17:20:55 No tests were executed. 17:20:55 [INFO] ``` > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944288#comment-15944288 ] ASF GitHub Bot commented on BAHIR-97: - Github user ckadner commented on the issue: https://github.com/apache/bahir/pull/38 http://169.45.79.58:8080/job/Apache%20Bahir%20-%20Pull%20Request%20Builder/35/console > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944291#comment-15944291 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Refer to this link for build results (access rights to CI server needed): http://169.45.79.58:8080/job/Apache%20Bahir%20-%20Pull%20Request%20Builder/35/ > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944290#comment-15944290 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Build successful > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944286#comment-15944286 ] ASF GitHub Bot commented on BAHIR-97: - Github user ckadner commented on the issue: https://github.com/apache/bahir/pull/38 retest this please > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944281#comment-15944281 ] ASF GitHub Bot commented on BAHIR-97: - Github user ckadner commented on the issue: https://github.com/apache/bahir/pull/38 ok to test > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944275#comment-15944275 ] ASF GitHub Bot commented on BAHIR-97: - Github user lresende commented on the issue: https://github.com/apache/bahir/pull/38 Please test this Jenkins > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)