[ 
https://issues.apache.org/jira/browse/SAMOA-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16073619#comment-16073619
 ] 

ASF GitHub Bot commented on SAMOA-65:
-------------------------------------

Github user gdfm commented on a diff in the pull request:

    https://github.com/apache/incubator-samoa/pull/59#discussion_r125465790
  
    --- Diff: samoa-api/pom.xml ---
    @@ -1,129 +1,154 @@
    -<?xml version="1.0" encoding="UTF-8"?>
    -<!--
    -  #%L
    -  SAMOA
    -  %%
    -  Copyright (C) 2014 - 2015 Apache Software Foundation
    -  %%
    -  Licensed under the Apache License, Version 2.0 (the "License");
    -  you may not use this file except in compliance with the License.
    -  You may obtain a copy of the License at
    -  
    -       http://www.apache.org/licenses/LICENSE-2.0
    -  
    -  Unless required by applicable law or agreed to in writing, software
    -  distributed under the License is distributed on an "AS IS" BASIS,
    -  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    -  See the License for the specific language governing permissions and
    -  limitations under the License.
    -  #L%
    -  -->
    -
    -<project xmlns="http://maven.apache.org/POM/4.0.0"; 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; 
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd";>
    -  <modelVersion>4.0.0</modelVersion>
    -  <properties>
    -    <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
    -  </properties>
    -
    -  <name>samoa-api</name>
    -  <description>API and algorithms for SAMOA</description>
    -
    -  <artifactId>samoa-api</artifactId>
    -  <parent>
    -    <groupId>org.apache.samoa</groupId>
    -    <artifactId>samoa</artifactId>
    -    <version>0.5.0-incubating-SNAPSHOT</version>
    -  </parent>
    -
    -  <dependencies>
    -    <dependency>
    -      <groupId>com.yammer.metrics</groupId>
    -      <artifactId>metrics-core</artifactId>
    -      <version>${metrics-core.version}</version>
    -    </dependency>
    -
    -    <dependency>
    -      <groupId>net.jcip</groupId>
    -      <artifactId>jcip-annotations</artifactId>
    -      <version>${jcip-annotations.version}</version>
    -    </dependency>
    -
    -    <dependency>
    -      <groupId>org.apache.commons</groupId>
    -      <artifactId>commons-lang3</artifactId>
    -      <version>${commons-lang3.version}</version>
    -    </dependency>
    -
    -    <dependency>
    -      <groupId>com.github.javacliparser</groupId>
    -      <artifactId>javacliparser</artifactId>
    -      <version>${javacliparser.version}</version>
    -    </dependency>
    -
    -    <dependency>
    -      <groupId>org.apache.samoa</groupId>
    -      <artifactId>samoa-instances</artifactId>
    -      <version>${project.version}</version>
    -    </dependency>
    -
    -    <dependency>
    -      <groupId>com.google.guava</groupId>
    -      <artifactId>guava</artifactId>
    -      <version>${guava.version}</version>
    -    </dependency>
    -
    -    <dependency>
    -      <groupId>com.esotericsoftware.kryo</groupId>
    -      <artifactId>kryo</artifactId>
    -      <version>${kryo.version}</version>
    -    </dependency>
    -
    -    <dependency>
    -      <groupId>com.dreizak</groupId>
    -      <artifactId>miniball</artifactId>
    -      <version>${miniball.version}</version>
    -    </dependency>
    -
    -    <dependency>
    -      <groupId>org.apache.hadoop</groupId>
    -      <artifactId>hadoop-common</artifactId>
    -      <version>${hadoop.version}</version>
    -    </dependency>
    -    <dependency>
    -      <groupId>org.apache.hadoop</groupId>
    -      <artifactId>hadoop-hdfs</artifactId>
    -      <version>${hadoop.version}</version>
    -    </dependency>
    -    <dependency>
    -      <groupId>org.apache.hadoop</groupId>
    -      <artifactId>hadoop-minicluster</artifactId>
    -      <version>${hadoop.version}</version>
    -      <scope>test</scope>
    -    </dependency>
    -  </dependencies>
    -
    -  <build>
    -    <plugins>
    -      <plugin>
    -        <groupId>org.apache.maven.plugins</groupId>
    -        <artifactId>maven-dependency-plugin</artifactId>
    -        <version>${maven-dependency-plugin.version}</version>
    -        <executions>
    -          <execution>
    -            <id>copy-dependencies</id>
    -            <phase>package</phase>
    -            <goals>
    -              <goal>copy-dependencies</goal>
    -            </goals>
    -            <configuration>
    -              
<outputDirectory>${project.build.directory}/lib</outputDirectory>
    -              <overWriteReleases>false</overWriteReleases>
    -              <overWriteSnapshots>false</overWriteSnapshots>
    -              <overWriteIfNewer>true</overWriteIfNewer>
    -            </configuration>
    -          </execution>
    -        </executions>
    -      </plugin>
    -    </plugins>
    -  </build>
    -</project>
    +<?xml version="1.0" encoding="UTF-8"?>
    --- End diff --
    
    There are a number of changes in the line endings, it seems to be a 
Linux/Windows problem.
    Can you please revert them?


> Apache Kafka integration components for SAMOA
> ---------------------------------------------
>
>                 Key: SAMOA-65
>                 URL: https://issues.apache.org/jira/browse/SAMOA-65
>             Project: SAMOA
>          Issue Type: New Feature
>          Components: SAMOA-API, SAMOA-Instances
>            Reporter: Piotr Wawrzyniak
>              Labels: kafka, sink, source, streaming
>   Original Estimate: 672h
>  Remaining Estimate: 672h
>
> As of now Apache SAMOA includes no integration components for Apache Kafka, 
> meaning in particular no possibility to read data coming from Kafka and write 
> data with prediction results back to Kafka.
> The key assumptions for the development of Kafka-related components are as 
> follows:
> 1)    develop support for input data stream arriving to Apache Samoa via 
> Apache Kafka
> 2)    develop support for output data stream produced by Apache Samoa, 
> including the results of stream mining and forwarded to Apache Kafka to be 
> provided in this way to other modules consuming the stream.
> This makes the goal of this issue is to create the following components:
> 1)    KafkaEntranceProcessor in samoa-api. This entrance processor will be 
> able to accept incoming Kafka stream. It will require KafkaDeserializer 
> interface implementation to be delivered. The role of Deserializer would be 
> to translate incoming Apache Kafka messages into implementation of Instance 
> interface of SAMOA.
> 2)    KafkaDestinationProcessor in samoa-api. Similarly to the 
> KafkaEntranceProcessor, this processor would require KafkaSerializer 
> interface implementation to be delivered. The role of Serializer would be to 
> create a Kafka message from the underlying Instance class.
> 3)    KafkaStream, as the extension to existing streams (e.g. 
> InstanceStream), would take similar role to other streams, and will provide 
> the control over Instances flows in the entire topology.
> Moreover, the following assumptions are considered:
> 1)    Components would be implemented with the use of most up-to-date version 
> of Apache Kafka, i.e. 0.10
> 2)    Samples of aforementioned Serializer and Deserializer would be 
> delivered, both supporting AVRO and JSON serialization of Instance objects.
> 3)    Sample testing classes providing reference use of Kafka source and 
> destination would be included in the project as well.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to