[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944689#comment-15944689 ] ASF GitHub Bot commented on BAHIR-97: - Github user ApacheBahir commented on the issue: https://github.com/apache/bahir/pull/38 Refer to this link for build results (access rights to CI server needed): http://169.45.79.58:8080/job/bahir_spark_pr_builder/38/ > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (BAHIR-99) Kudu connector to read/write from/to Kudu
Rubén Casado created BAHIR-99: - Summary: Kudu connector to read/write from/to Kudu Key: BAHIR-99 URL: https://issues.apache.org/jira/browse/BAHIR-99 Project: Bahir Issue Type: New Feature Components: Flink Streaming Connectors Reporter: Rubén Casado -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (BAHIR-99) Kudu connector to read/write from/to Kudu
[ https://issues.apache.org/jira/browse/BAHIR-99?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rubén Casado updated BAHIR-99: -- Description: Java library to integrate Apache Kudu and Apache Flink. Main goal is to be able to read/write data from/to Kudu using the DataSet and DataStream Flink's APIs. Data flows patterns: Batch - Kudu -> DataSet -> Kudu - Kudu -> DataSet -> other source - Other source -> DataSet -> other source Stream - Other source -> DataStream -> Kudu Code is available in https://github.com/rubencasado/Flink-Kudu > Kudu connector to read/write from/to Kudu > - > > Key: BAHIR-99 > URL: https://issues.apache.org/jira/browse/BAHIR-99 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Reporter: Rubén Casado > > Java library to integrate Apache Kudu and Apache Flink. Main goal is to be > able to read/write data from/to Kudu using the DataSet and DataStream Flink's > APIs. > Data flows patterns: > Batch > - Kudu -> DataSet -> Kudu > - Kudu -> DataSet -> other source > - Other source -> DataSet -> other source > Stream > - Other source -> DataStream -> Kudu > Code is available in https://github.com/rubencasado/Flink-Kudu -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-98) Jenkins does not run Scalatests
[
https://issues.apache.org/jira/browse/BAHIR-98?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944656#comment-15944656
]
Christian Kadner commented on BAHIR-98:
---
[~akchin] I modified the configuration of the Bahir Pull Request Builder as
follows:
*Project name:* -"Apache Bahir - Pull Request Builder"- -->
"bahir_spark_pr_builder"
Advanced Project Options:
- *Display Name:* "" --> "Apache Bahir (Spark) - Pull Request Builder"
The build now runs all Scalatests.
> Jenkins does not run Scalatests
> ---
>
> Key: BAHIR-98
> URL: https://issues.apache.org/jira/browse/BAHIR-98
> Project: Bahir
> Issue Type: Bug
> Components: Build
>Reporter: Christian Kadner
> Fix For: Not Applicable
>
>
> Our Jenkins integration server currently only runs Java tests (JUnit) but no
> Scala tests.
> i.e. [build
> log|http://169.45.79.58:8080/job/Apache%20Bahir%20-%20Pull%20Request%20Builder/35/console]
> for PR #[38|https://github.com/apache/bahir/pull/38#issuecomment-289624943]
> ...for *JUnit tests*:
> {code}
> 17:20:37 [INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @
> spark-streaming-akka_2.11 ---
> 17:20:37
> 17:20:37 ---
> 17:20:37 T E S T S
> 17:20:37 ---
> 17:20:37 OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m;
> support was removed in 8.0
> 17:20:37 Running org.apache.spark.streaming.akka.JavaAkkaUtilsSuite
> 17:20:39 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> 1.483 sec - in org.apache.spark.streaming.akka.JavaAkkaUtilsSuite
> 17:20:39
> 17:20:39 Results :
> 17:20:39
> 17:20:39 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
> 17:20:39
> {code}
> ...for *Scala tests*:
> {code}
> 17:20:39 [INFO] --- maven-surefire-plugin:2.19.1:test (test) @
> spark-streaming-akka_2.11 ---
> 17:20:39 [INFO] Skipping execution of surefire because it has already been
> run for this configuration
> 17:20:39 [INFO]
> 17:20:39 [INFO] --- scalatest-maven-plugin:1.0:test (test) @
> spark-streaming-akka_2.11 ---
> 17:20:39 OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m;
> support was removed in 8.0
> 17:20:39 Discovery starting.
> 17:20:39 Discovery completed in 34 milliseconds.
> 17:20:39 Run starting. Expected test count is: 0
> 17:20:39 DiscoverySuite:
> 17:20:39 Run completed in 95 milliseconds.
> 17:20:39 Total number of tests run: 0
> 17:20:39 Suites: completed 1, aborted 0
> 17:20:39 Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
> 17:20:39 No tests were executed.
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Closed] (BAHIR-98) Jenkins does not run Scalatests
[
https://issues.apache.org/jira/browse/BAHIR-98?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christian Kadner closed BAHIR-98.
-
> Jenkins does not run Scalatests
> ---
>
> Key: BAHIR-98
> URL: https://issues.apache.org/jira/browse/BAHIR-98
> Project: Bahir
> Issue Type: Bug
> Components: Build
>Reporter: Christian Kadner
>Assignee: Christian Kadner
> Fix For: Not Applicable
>
>
> Our Jenkins integration server currently only runs Java tests (JUnit) but no
> Scala tests.
> i.e. [build
> log|http://169.45.79.58:8080/job/Apache%20Bahir%20-%20Pull%20Request%20Builder/35/console]
> for PR #[38|https://github.com/apache/bahir/pull/38#issuecomment-289624943]
> ...for *JUnit tests*:
> {code}
> 17:20:37 [INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @
> spark-streaming-akka_2.11 ---
> 17:20:37
> 17:20:37 ---
> 17:20:37 T E S T S
> 17:20:37 ---
> 17:20:37 OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m;
> support was removed in 8.0
> 17:20:37 Running org.apache.spark.streaming.akka.JavaAkkaUtilsSuite
> 17:20:39 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> 1.483 sec - in org.apache.spark.streaming.akka.JavaAkkaUtilsSuite
> 17:20:39
> 17:20:39 Results :
> 17:20:39
> 17:20:39 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
> 17:20:39
> {code}
> ...for *Scala tests*:
> {code}
> 17:20:39 [INFO] --- maven-surefire-plugin:2.19.1:test (test) @
> spark-streaming-akka_2.11 ---
> 17:20:39 [INFO] Skipping execution of surefire because it has already been
> run for this configuration
> 17:20:39 [INFO]
> 17:20:39 [INFO] --- scalatest-maven-plugin:1.0:test (test) @
> spark-streaming-akka_2.11 ---
> 17:20:39 OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m;
> support was removed in 8.0
> 17:20:39 Discovery starting.
> 17:20:39 Discovery completed in 34 milliseconds.
> 17:20:39 Run starting. Expected test count is: 0
> 17:20:39 DiscoverySuite:
> 17:20:39 Run completed in 95 milliseconds.
> 17:20:39 Total number of tests run: 0
> 17:20:39 Suites: completed 1, aborted 0
> 17:20:39 Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
> 17:20:39 No tests were executed.
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Resolved] (BAHIR-98) Jenkins does not run Scalatests
[
https://issues.apache.org/jira/browse/BAHIR-98?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christian Kadner resolved BAHIR-98.
---
Resolution: Fixed
Assignee: Christian Kadner
Fix Version/s: Not Applicable
> Jenkins does not run Scalatests
> ---
>
> Key: BAHIR-98
> URL: https://issues.apache.org/jira/browse/BAHIR-98
> Project: Bahir
> Issue Type: Bug
> Components: Build
>Reporter: Christian Kadner
>Assignee: Christian Kadner
> Fix For: Not Applicable
>
>
> Our Jenkins integration server currently only runs Java tests (JUnit) but no
> Scala tests.
> i.e. [build
> log|http://169.45.79.58:8080/job/Apache%20Bahir%20-%20Pull%20Request%20Builder/35/console]
> for PR #[38|https://github.com/apache/bahir/pull/38#issuecomment-289624943]
> ...for *JUnit tests*:
> {code}
> 17:20:37 [INFO] --- maven-surefire-plugin:2.19.1:test (default-test) @
> spark-streaming-akka_2.11 ---
> 17:20:37
> 17:20:37 ---
> 17:20:37 T E S T S
> 17:20:37 ---
> 17:20:37 OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m;
> support was removed in 8.0
> 17:20:37 Running org.apache.spark.streaming.akka.JavaAkkaUtilsSuite
> 17:20:39 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> 1.483 sec - in org.apache.spark.streaming.akka.JavaAkkaUtilsSuite
> 17:20:39
> 17:20:39 Results :
> 17:20:39
> 17:20:39 Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
> 17:20:39
> {code}
> ...for *Scala tests*:
> {code}
> 17:20:39 [INFO] --- maven-surefire-plugin:2.19.1:test (test) @
> spark-streaming-akka_2.11 ---
> 17:20:39 [INFO] Skipping execution of surefire because it has already been
> run for this configuration
> 17:20:39 [INFO]
> 17:20:39 [INFO] --- scalatest-maven-plugin:1.0:test (test) @
> spark-streaming-akka_2.11 ---
> 17:20:39 OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m;
> support was removed in 8.0
> 17:20:39 Discovery starting.
> 17:20:39 Discovery completed in 34 milliseconds.
> 17:20:39 Run starting. Expected test count is: 0
> 17:20:39 DiscoverySuite:
> 17:20:39 Run completed in 95 milliseconds.
> 17:20:39 Total number of tests run: 0
> 17:20:39 Suites: completed 1, aborted 0
> 17:20:39 Tests: succeeded 0, failed 0, canceled 0, ignored 0, pending 0
> 17:20:39 No tests were executed.
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (BAHIR-97) Akka as a streaming source for SQL Streaming.
[ https://issues.apache.org/jira/browse/BAHIR-97?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944648#comment-15944648 ] ASF GitHub Bot commented on BAHIR-97: - Github user ckadner commented on the issue: https://github.com/apache/bahir/pull/38 @sbcd90 -- can you change your test suite to chose the `akka.remote.netty.tcp.port` dynamically? > Akka as a streaming source for SQL Streaming. > - > > Key: BAHIR-97 > URL: https://issues.apache.org/jira/browse/BAHIR-97 > Project: Bahir > Issue Type: New Feature > Components: Spark SQL Data Sources >Affects Versions: Spark-2.1.0 >Reporter: Subhobrata Dey > > Hello, > This issue is created to propose the addition of Akka compatible streaming > source for Spark SQL Streaming. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
