[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-06 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959060#comment-15959060
 ] 

ASF subversion and git services commented on BAHIR-97:
--

Commit 889de659c33dd56bad7193a4b69e6d05d061a2fd in bahir's branch 
refs/heads/master from [~sbcd90]
[ https://git-wip-us.apache.org/repos/asf?p=bahir.git;h=889de65 ]

[BAHIR-97] Akka as SQL Streaming datasource.

Closes #38.


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-06 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959061#comment-15959061
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user asfgit closed the pull request at:

https://github.com/apache/bahir/pull/38


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957966#comment-15957966
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ckadner commented on the issue:

https://github.com/apache/bahir/pull/38
  
Thanks @lresende and @sbcd90 - LGTM


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957909#comment-15957909
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user sbcd90 commented on the issue:

https://github.com/apache/bahir/pull/38
  
Hi @lresende , I have removed the usage of the deprecated api s
& also opened a jira issue named 
[BAHIR-103](https://issues.apache.org/jira/browse/BAHIR-103)
for refactoring the utils classes into bahir-common.


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957847#comment-15957847
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  
Build successful
 



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957848#comment-15957848
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  

Refer to this link for build results (access rights to CI server needed): 
http://169.45.79.58:8080/job/bahir_spark_pr_builder/53/



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957842#comment-15957842
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user sbcd90 commented on the issue:

https://github.com/apache/bahir/pull/38
  
retest this please


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957677#comment-15957677
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user lresende commented on the issue:

https://github.com/apache/bahir/pull/38
  
Once we remove the deprecated api usages, we should be ready to merge 
unless someone has other comments.


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957650#comment-15957650
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user lresende commented on a diff in the pull request:

https://github.com/apache/bahir/pull/38#discussion_r110023018
  
--- Diff: 
sql-streaming-akka/src/main/scala/org/apache/bahir/utils/Logging.scala ---
@@ -0,0 +1,24 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ *http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.bahir.utils
+
+import org.slf4j.LoggerFactory
+
+trait Logging {
+  final val log = 
LoggerFactory.getLogger(this.getClass.getName.stripSuffix("$"))
+}
--- End diff --

Similar comment as file above.


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957649#comment-15957649
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user lresende commented on a diff in the pull request:

https://github.com/apache/bahir/pull/38#discussion_r110021854
  
--- Diff: 
sql-streaming-akka/src/test/scala/org/apache/bahir/sql/streaming/akka/AkkaStreamSourceSuite.scala
 ---
@@ -0,0 +1,188 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ *http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.bahir.sql.streaming.akka
+
+import java.io.File
+
+import scala.collection.JavaConverters._
+import scala.collection.mutable
+
+import org.scalatest.BeforeAndAfter
+
+import org.apache.spark.{SharedSparkContext, SparkFunSuite}
+import org.apache.spark.sql.{DataFrame, SQLContext}
+import org.apache.spark.sql.execution.streaming.FileStreamSource.Timestamp
+import org.apache.spark.sql.execution.streaming.LongOffset
+
+import org.apache.bahir.utils.BahirUtils
+
+class AkkaStreamSourceSuite extends SparkFunSuite with SharedSparkContext 
with BeforeAndAfter {
+
+  protected var akkaTestUtils: AkkaTestUtils = _
+  protected val tempDir: File =
+new File(System.getProperty("java.io.tmpdir") + 
"/spark-akka-persistence")
+
+  akkaTestUtils = new AkkaTestUtils
+  akkaTestUtils.setup()
+
+  before {
+tempDir.mkdirs()
+  }
+
+  after {
+Persistence.close()
+BahirUtils.recursiveDeleteDir(tempDir)
+  }
+
+  protected val tmpDir: String = tempDir.getAbsolutePath
+
+  protected def createStreamingDataframe(dir: String = tmpDir): 
(SQLContext, DataFrame) = {
+
+val sqlContext: SQLContext = new SQLContext(sc)
+
--- End diff --

Would you please change to use Sparksession instead of directly 
instantiating a SQLContext.


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957651#comment-15957651
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user lresende commented on a diff in the pull request:

https://github.com/apache/bahir/pull/38#discussion_r110021902
  
--- Diff: 
sql-streaming-akka/src/test/scala/org/apache/bahir/sql/streaming/akka/AkkaStreamSourceSuite.scala
 ---
@@ -0,0 +1,188 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ *http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.bahir.sql.streaming.akka
+
+import java.io.File
+
+import scala.collection.JavaConverters._
+import scala.collection.mutable
+
+import org.scalatest.BeforeAndAfter
+
+import org.apache.spark.{SharedSparkContext, SparkFunSuite}
+import org.apache.spark.sql.{DataFrame, SQLContext}
+import org.apache.spark.sql.execution.streaming.FileStreamSource.Timestamp
+import org.apache.spark.sql.execution.streaming.LongOffset
+
+import org.apache.bahir.utils.BahirUtils
+
+class AkkaStreamSourceSuite extends SparkFunSuite with SharedSparkContext 
with BeforeAndAfter {
+
+  protected var akkaTestUtils: AkkaTestUtils = _
+  protected val tempDir: File =
+new File(System.getProperty("java.io.tmpdir") + 
"/spark-akka-persistence")
+
+  akkaTestUtils = new AkkaTestUtils
+  akkaTestUtils.setup()
+
+  before {
+tempDir.mkdirs()
+  }
+
+  after {
+Persistence.close()
+BahirUtils.recursiveDeleteDir(tempDir)
+  }
+
+  protected val tmpDir: String = tempDir.getAbsolutePath
+
+  protected def createStreamingDataframe(dir: String = tmpDir): 
(SQLContext, DataFrame) = {
+
+val sqlContext: SQLContext = new SQLContext(sc)
+
+sqlContext.setConf("spark.sql.streaming.checkpointLocation", dir + 
"/checkpoint")
+
+val dataFrame: DataFrame =
+  
sqlContext.readStream.format("org.apache.bahir.sql.streaming.akka.AkkaStreamSourceProvider")
+.option("urlOfPublisher", akkaTestUtils.getFeederActorUri())
+.option("persistenceDirPath", dir + "/persistence").load()
+(sqlContext, dataFrame)
+  }
+}
+
+class BasicAkkaSourceSuite extends AkkaStreamSourceSuite {
+
+  private def writeStreamResults(sqlContext: SQLContext, dataFrame: 
DataFrame,
+ waitDuration: Long): Boolean = {
+import sqlContext.implicits._
+dataFrame.as[(String, Timestamp)].writeStream.format("parquet")
+  .start(s"$tmpDir/parquet/t.parquet").awaitTermination(waitDuration)
+  }
+
+  private def readBackSreamingResults(sqlContext: SQLContext): 
mutable.Buffer[String] = {
+import sqlContext.implicits._
+val asList =
+  sqlContext.read.schema(AkkaStreamConstants.SCHEMA_DEFAULT)
+  .parquet(s"$tmpDir/parquet/t.parquet").as[(String, 
Timestamp)].map(_._1)
+  .collectAsList().asScala
+asList
+  }
+
+  test("basic usage") {
+val message = "Akka is a reactive framework"
+
+akkaTestUtils.setMessage(message)
+akkaTestUtils.setCountOfMessages(1)
+
+val (sqlContext: SQLContext, dataFrame: DataFrame) = 
createStreamingDataframe()
+
+writeStreamResults(sqlContext, dataFrame, 1)
+
+val resultBuffer: mutable.Buffer[String] = 
readBackSreamingResults(sqlContext)
+
+assert(resultBuffer.size === 1)
+assert(resultBuffer.head === message)
+  }
+
+  test("Send and receive 100 messages.") {
+val message = "Akka is a reactive framework"
+
+akkaTestUtils.setMessage(message)
+akkaTestUtils.setCountOfMessages(100)
+
+val (sqlContext: SQLContext, dataFrame: DataFrame) = 
createStreamingDataframe()
+
+writeStreamResults(sqlContext, dataFrame, 1)
+
+val resultBuffer: mutable.Buffer[String] = 
readBackSreamingResults(sqlContext)
+
+assert(resultBuffer.size === 100)
  

[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957648#comment-15957648
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user lresende commented on a diff in the pull request:

https://github.com/apache/bahir/pull/38#discussion_r110022955
  
--- Diff: 
sql-streaming-akka/src/main/scala/org/apache/bahir/utils/BahirUtils.scala ---
@@ -0,0 +1,47 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ *http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.bahir.utils
+
+import java.io.{File, IOException}
+import java.nio.file.{Files, FileVisitResult, Path, SimpleFileVisitor}
+import java.nio.file.attribute.BasicFileAttributes
+
+object BahirUtils extends Logging {
+
--- End diff --

We should not duplicate these two classes on each extension. Could you 
create a jira for refactoring these into a bahir-common project that is shared 
with the other extensions. 


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-05 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957311#comment-15957311
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user sbcd90 commented on the issue:

https://github.com/apache/bahir/pull/38
  
Hi @ckadner , I haven't seen any updates from you..plz let me know if 
anything else is required from my side...


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-02 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952571#comment-15952571
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  
Build successful
 



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-02 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952572#comment-15952572
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  

Refer to this link for build results (access rights to CI server needed): 
http://169.45.79.58:8080/job/bahir_spark_pr_builder/50/



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-04-02 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952569#comment-15952569
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user sbcd90 commented on the issue:

https://github.com/apache/bahir/pull/38
  
retest this please


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-31 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951772#comment-15951772
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ckadner commented on the issue:

https://github.com/apache/bahir/pull/38
  
@sbcd90 -- thanks for you continuous updates and sorry for the piecemeal 
review from my end  ... I started with your test cases since we were still in 
the process of fixing our Jenkins build setup. But your test cases are great 
now :-)

Perhaps more important, my first request to you should have been to add a 
README and examples so users can start using your connector without having to 
read through too much code ... i.e. please further follow the precedence set by 
`sql-streaming-mqtt`.

**Thank you!**


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-31 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951751#comment-15951751
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ckadner commented on a diff in the pull request:

https://github.com/apache/bahir/pull/38#discussion_r109263328
  
--- Diff: sql-streaming-akka/src/main/assembly/assembly.xml ---
@@ -0,0 +1,44 @@
+
+
+test-jar-with-dependencies
+
+jar
+
+false
+
+
+
+
${project.build.directory}/scala-${scala.binary.version}/test-classes
+
+
+
+
+
+
+true
+test
+true
+
+org.apache.hadoop:*:jar
+org.apache.zookeeper:*:jar
+org.apache.avro:*:jar
+
+
+
+
+
--- End diff --

add new line


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-31 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951753#comment-15951753
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ckadner commented on a diff in the pull request:

https://github.com/apache/bahir/pull/38#discussion_r109263538
  
--- Diff: sql-streaming-akka/src/test/resources/feeder_actor.conf ---
@@ -0,0 +1,34 @@
+#
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements.  See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License.  You may obtain a copy of the License at
+#
+#http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+#
+
+akka {
+  loglevel = "INFO"
+  actor {
+provider = "akka.remote.RemoteActorRefProvider"
+  }
+  remote {
+enabled-transports = ["akka.remote.netty.tcp"]
+netty.tcp {
+  hostname = "127.0.0.1"
+  port = 0
+}
+log-sent-messages = on
+log-received-messages = on
+  }
+  loggers.0 = "akka.event.slf4j.Slf4jLogger"
+  log-dead-letters-during-shutdown = "off"
+}
--- End diff --

add new line


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-31 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951752#comment-15951752
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ckadner commented on a diff in the pull request:

https://github.com/apache/bahir/pull/38#discussion_r109263376
  
--- Diff: sql-streaming-akka/pom.xml ---
@@ -0,0 +1,120 @@
+
+
+
+http://maven.apache.org/POM/4.0.0; 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; 
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd;>
+4.0.0
+
+org.apache.bahir
+bahir-parent_2.11
+2.2.0-SNAPSHOT
+../pom.xml
+
+
+org.apache.bahir
+spark-sql-streaming-akka_2.11
+
+sql-streaming-akka
+
+jar
+Apache Bahir - Spark SQL Streaming Akka
+http://bahir.apache.org
+
+
+
+org.apache.spark
+spark-tags_${scala.binary.version}
+
+
+org.apache.spark
+spark-sql_${scala.binary.version}
+${spark.version}
+
+
+org.apache.spark
+spark-sql_${scala.binary.version}
+${spark.version}
+test-jar
+test
+
+
+org.apache.spark
+spark-core_${scala.binary.version}
+${spark.version}
+test-jar
+test
+
+
+${akka.group}
+akka-actor_${scala.binary.version}
+${akka.version}
+
+
+${akka.group}
+akka-remote_${scala.binary.version}
+${akka.version}
+
+
+${akka.group}
+akka-slf4j_${scala.binary.version}
+${akka.version}
+
+
+org.rocksdb
+rocksdbjni
+5.1.2
+
+
+
+
+
target/scala-${scala.binary.version}/classes
+
target/scala-${scala.binary.version}/test-classes
+
+
+
+org.apache.maven.plugins
+maven-source-plugin
+
+
+
+
+org.apache.maven.plugins
+maven-assembly-plugin
+
+
+test-jar-with-dependencies
+package
+
+single
+
+
+
+
spark-streaming-akka-test-${project.version}
+
${project.build.directory}/scala-${scala.binary.version}
+false
+
+false
+
+
src/main/assembly/assembly.xml
+
+
+
+
+
+
+
+
--- End diff --

add new line


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-31 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951504#comment-15951504
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  
Build successful
 



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-31 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951505#comment-15951505
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  

Refer to this link for build results (access rights to CI server needed): 
http://169.45.79.58:8080/job/bahir_spark_pr_builder/48/



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-31 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951503#comment-15951503
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user sbcd90 commented on the issue:

https://github.com/apache/bahir/pull/38
  
Hi @ckadner , I have made the changes you mentioned to remove the remaining 
verbose. Please have a look.


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-31 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951502#comment-15951502
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user sbcd90 commented on the issue:

https://github.com/apache/bahir/pull/38
  
retest this please


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-30 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950080#comment-15950080
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  
Build successful
 



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-30 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950081#comment-15950081
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  

Refer to this link for build results (access rights to CI server needed): 
http://169.45.79.58:8080/job/bahir_spark_pr_builder/42/



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-30 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950075#comment-15950075
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user sbcd90 commented on the issue:

https://github.com/apache/bahir/pull/38
  
Hi @ckadner , Thanks for your reply. I have added `log4j.properties` in the 
test sources folder.


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-30 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950074#comment-15950074
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user sbcd90 commented on the issue:

https://github.com/apache/bahir/pull/38
  
retest this please


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-30 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949610#comment-15949610
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user sbcd90 commented on the issue:

https://github.com/apache/bahir/pull/38
  
Hi @ckadner , the test cases are skipped..any reason for that?


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-28 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944689#comment-15944689
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  

Refer to this link for build results (access rights to CI server needed): 
http://169.45.79.58:8080/job/bahir_spark_pr_builder/38/



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-28 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944648#comment-15944648
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ckadner commented on the issue:

https://github.com/apache/bahir/pull/38
  
@sbcd90 -- can you change your test suite to chose the 
`akka.remote.netty.tcp.port` dynamically?


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944580#comment-15944580
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  

Refer to this link for build results (access rights to CI server needed): 
http://169.45.79.58:8080/job/bahir_spark_pr_builder/37/



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944579#comment-15944579
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  
Build failed, see build log for details
 



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944577#comment-15944577
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ckadner commented on the issue:

https://github.com/apache/bahir/pull/38
  
retest this please


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944366#comment-15944366
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  

Refer to this link for build results (access rights to CI server needed): 

http://169.45.79.58:8080/job/Apache%20Bahir%20-%20Pull%20Request%20Builder/36/



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944365#comment-15944365
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  
Build successful
 



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944363#comment-15944363
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user lresende commented on the issue:

https://github.com/apache/bahir/pull/38
  
retest this please


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944364#comment-15944364
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ckadner commented on the issue:

https://github.com/apache/bahir/pull/38
  
@sbcd90 -- Scalatests should be sufficient. We need to fix our Jenkins 
integration test setup. Not an action item for you :-)


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944336#comment-15944336
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user sbcd90 commented on the issue:

https://github.com/apache/bahir/pull/38
  
Hello @ckadner ,
Are any actions need to be taken from my side? Like provide Java 
tests(Junits) instead of scala?


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944310#comment-15944310
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ckadner commented on the issue:

https://github.com/apache/bahir/pull/38
  
Note, our Jenkins build server does not currently run Scalatests ...

> 17:20:55 No tests were executed.

```
17:20:54 [INFO] 
17:20:54 [INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @ 
spark-sql-streaming-akka_2.11 ---
17:20:54 
17:20:54 ---
17:20:54  T E S T S
17:20:54 ---
17:20:54 OpenJDK 64-Bit Server VM warning: ignoring option 
MaxPermSize=512m; support was removed in 8.0
17:20:54 
17:20:54 Results :
17:20:54 
17:20:54 Tests run: 0, Failures: 0, Errors: 0, Skipped: 0
17:20:54 
17:20:54 [INFO] 
17:20:54 [INFO] --- maven-surefire-plugin:2.19.1:test (test) @ 
spark-sql-streaming-akka_2.11 ---
17:20:54 [INFO] Skipping execution of surefire because it has already been 
run for this configuration
17:20:54 [INFO] 
17:20:54 [INFO] --- scalatest-maven-plugin:1.0:test (test) @ 
spark-sql-streaming-akka_2.11 ---
17:20:54 OpenJDK 64-Bit Server VM warning: ignoring option 
MaxPermSize=512m; support was removed in 8.0
17:20:55 Discovery starting.
17:20:55 Discovery completed in 36 milliseconds.
17:20:55 Run starting. Expected test count is: 0
17:20:55 DiscoverySuite:
17:20:55 Run completed in 100 milliseconds.
17:20:55 Total number of tests run: 0
17:20:55 Suites: completed 1, aborted 0
17:20:55 Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
17:20:55 No tests were executed.
17:20:55 [INFO]
```


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944288#comment-15944288
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ckadner commented on the issue:

https://github.com/apache/bahir/pull/38
  

http://169.45.79.58:8080/job/Apache%20Bahir%20-%20Pull%20Request%20Builder/35/console


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944291#comment-15944291
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  

Refer to this link for build results (access rights to CI server needed): 

http://169.45.79.58:8080/job/Apache%20Bahir%20-%20Pull%20Request%20Builder/35/



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944290#comment-15944290
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/38
  
Build successful
 



> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944286#comment-15944286
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ckadner commented on the issue:

https://github.com/apache/bahir/pull/38
  
retest this please


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944281#comment-15944281
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user ckadner commented on the issue:

https://github.com/apache/bahir/pull/38
  
ok to test


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.

2017-03-27 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944275#comment-15944275
 ] 

ASF GitHub Bot commented on BAHIR-97:
-

Github user lresende commented on the issue:

https://github.com/apache/bahir/pull/38
  
Please test this Jenkins


> Akka as a streaming source for SQL Streaming.
> -
>
> Key: BAHIR-97
> URL: https://issues.apache.org/jira/browse/BAHIR-97
> Project: Bahir
>  Issue Type: New Feature
>  Components: Spark SQL Data Sources
>Affects Versions: Spark-2.1.0
>Reporter: Subhobrata Dey
>
> Hello,
> This issue is created to propose the addition of Akka compatible streaming 
> source for Spark SQL Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)