[jira] [Updated] (SAMZA-2095) Fix flaky timeout error in TestZKUtils
[
https://issues.apache.org/jira/browse/SAMZA-2095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Chen updated SAMZA-2095:
Description:
We observed recurring build failures in LinkedIn build machines(not in local
dev-setup, travis) due to the following exception:
{{java.lang.AssertionError: Client connection setup failed. Aborting tests..
"java.lang.AssertionError: Client connection setup failed. Aborting tests.. at
org.junit.Assert.fail(Assert.java:88) at
org.apache.samza.zk.TestZkUtils.testSetup(TestZkUtils.java:80) at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498) at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at
org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:239)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
at
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
java.lang.Thread.run(Thread.java:745) }}
was:
- Increase the timeout
- Stop swallowing errors
> Fix flaky timeout error in TestZKUtils
> --
>
> Key: SAMZA-2095
> URL: https://issues.apache.org/jira/browse/SAMZA-2095
> Project: Samza
> Issue Type: Bug
> Components: test
>Affects Versions: 1.0
>Reporter: Daniel Chen
>Assignee: Daniel Chen
>Priority: Major
>
> We observed recurring build failures in LinkedIn build machines(not in local
> dev-setup, travis) due to the following exception:
> {{java.lang.AssertionError: Client connection setup failed. Aborting tests..
> "java.lang.AssertionError: Client connection setup failed. Aborting tests..
> at org.junit.Assert.fail(Assert.java:88) at
> org.apache.samza.zk.TestZkUtils.testSetup(TestZkUtils.java:80) at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498) at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
> at
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> at
> org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:239)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:298)
> at
> org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:292)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at
> java.lang.Thread.run(Thread.java:745) }}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[samza] branch master updated: Update timeout for flaky test ZK connection test
This is an automated email from the ASF dual-hosted git repository.
shanthoosh pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/samza.git
The following commit(s) were added to refs/heads/master by this push:
new e4f9731 Update timeout for flaky test ZK connection test
new 93e6192 Merge pull request #902 from dxichen/master
e4f9731 is described below
commit e4f9731f0fac18938014ed2f3356866700f258c9
Author: Daniel Chen
AuthorDate: Fri Feb 1 16:01:50 2019 -0800
Update timeout for flaky test ZK connection test
---
samza-core/src/test/java/org/apache/samza/zk/TestZkUtils.java | 5 +++--
1 file changed, 3 insertions(+), 2 deletions(-)
diff --git a/samza-core/src/test/java/org/apache/samza/zk/TestZkUtils.java
b/samza-core/src/test/java/org/apache/samza/zk/TestZkUtils.java
index 29e861b..d98392d 100644
--- a/samza-core/src/test/java/org/apache/samza/zk/TestZkUtils.java
+++ b/samza-core/src/test/java/org/apache/samza/zk/TestZkUtils.java
@@ -57,8 +57,8 @@ public class TestZkUtils {
private static EmbeddedZookeeper zkServer = null;
private static final ZkKeyBuilder KEY_BUILDER = new ZkKeyBuilder("test");
private ZkClient zkClient = null;
- private static final int SESSION_TIMEOUT_MS = 500;
- private static final int CONNECTION_TIMEOUT_MS = 1000;
+ private static final int SESSION_TIMEOUT_MS = 5000;
+ private static final int CONNECTION_TIMEOUT_MS = 1;
private ZkUtils zkUtils;
@Rule
@@ -77,6 +77,7 @@ public class TestZkUtils {
new ZkConnection("127.0.0.1:" + zkServer.getPort(),
SESSION_TIMEOUT_MS),
CONNECTION_TIMEOUT_MS);
} catch (Exception e) {
+ e.printStackTrace();
Assert.fail("Client connection setup failed. Aborting tests..");
}
try {
[jira] [Created] (SAMZA-2095) Fix flaky timeout error in TestZKUtils
Daniel Chen created SAMZA-2095: --- Summary: Fix flaky timeout error in TestZKUtils Key: SAMZA-2095 URL: https://issues.apache.org/jira/browse/SAMZA-2095 Project: Samza Issue Type: Bug Components: test Affects Versions: 1.0 Reporter: Daniel Chen Assignee: Daniel Chen - Increase the timeout - Stop swallowing errors -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (SAMZA-2094) Implement the StartpointVisitor for KafkaSystemConsumer.
[ https://issues.apache.org/jira/browse/SAMZA-2094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shanthoosh Venkataraman updated SAMZA-2094: --- Summary: Implement the StartpointVisitor for KafkaSystemConsumer. (was: Startpoints - Implement the StartpointVisitor for KafkaSystemConsumer.) > Implement the StartpointVisitor for KafkaSystemConsumer. > > > Key: SAMZA-2094 > URL: https://issues.apache.org/jira/browse/SAMZA-2094 > Project: Samza > Issue Type: New Feature >Reporter: Shanthoosh Venkataraman >Assignee: Shanthoosh Venkataraman >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (SAMZA-2094) Startpoints - Implement the StartpointVisitor for KafkaSystemConsumer.
Shanthoosh Venkataraman created SAMZA-2094: -- Summary: Startpoints - Implement the StartpointVisitor for KafkaSystemConsumer. Key: SAMZA-2094 URL: https://issues.apache.org/jira/browse/SAMZA-2094 Project: Samza Issue Type: New Feature Reporter: Shanthoosh Venkataraman Assignee: Shanthoosh Venkataraman -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[samza] branch master updated: SAMZA-2086: Documentation fixes: change .md to .html
This is an automated email from the ASF dual-hosted git repository.
jagadish pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/samza.git
The following commit(s) were added to refs/heads/master by this push:
new 057a90a SAMZA-2086: Documentation fixes: change .md to .html
057a90a is described below
commit 057a90a544a03c3494d22cb43eff7b95a6450acd
Author: pchhokra
AuthorDate: Fri Feb 1 13:10:28 2019 -0800
SAMZA-2086: Documentation fixes: change .md to .html
Author: pchhokra
Reviewers: Jagadish
Closes #894 from PawasChhokra/documentation
---
docs/learn/documentation/versioned/api/low-level-api.md | 2 +-
docs/learn/documentation/versioned/api/programming-model.md | 6 +++---
docs/learn/documentation/versioned/connectors/eventhubs.md | 2 +-
docs/learn/documentation/versioned/rest/monitors.md | 2 +-
4 files changed, 6 insertions(+), 6 deletions(-)
diff --git a/docs/learn/documentation/versioned/api/low-level-api.md
b/docs/learn/documentation/versioned/api/low-level-api.md
index 34d2b06..e3466af 100644
--- a/docs/learn/documentation/versioned/api/low-level-api.md
+++ b/docs/learn/documentation/versioned/api/low-level-api.md
@@ -276,7 +276,7 @@ For example:
### Legacy Applications
-For legacy Low Level API applications, you can continue specifying your
system, stream and store properties along with your task.class in
configuration. An incomplete example of configuration for legacy task
application looks like this (see the [configuration](../jobs/configuration.md)
documentation for more detail):
+For legacy Low Level API applications, you can continue specifying your
system, stream and store properties along with your task.class in
configuration. An incomplete example of configuration for legacy task
application looks like this (see the
[configuration](../jobs/configuration.html) documentation for more detail):
{% highlight jproperties %}
diff --git a/docs/learn/documentation/versioned/api/programming-model.md
b/docs/learn/documentation/versioned/api/programming-model.md
index efdcfa3..943c573 100644
--- a/docs/learn/documentation/versioned/api/programming-model.md
+++ b/docs/learn/documentation/versioned/api/programming-model.md
@@ -22,9 +22,9 @@ title: Programming Model
Samza provides multiple programming APIs to fit your use case:
1. Java APIs: Samza's provides two Java programming APIs that are ideal for
building advanced Stream Processing applications.
-1. [High Level Streams API](high-level-api.md): Samza's flexible High
Level Streams API lets you describe your complex stream processing pipeline in
the form of a Directional Acyclic Graph (DAG) of operations on message streams.
It provides a rich set of built-in operators that simplify common stream
processing operations such as filtering, projection, repartitioning, joins, and
windows.
-2. [Low Level Task API](low-level-api.md): Samza's powerful Low Level Task
API lets you write your application in terms of processing logic for each
incoming message.
-2. [Samza SQL](samza-sql.md): Samza SQL provides a declarative query language
for describing your stream processing logic. It lets you manipulate streams
using SQL predicates and UDFs instead of working with the physical
implementation details.
+1. [High Level Streams API](high-level-api.html): Samza's flexible High
Level Streams API lets you describe your complex stream processing pipeline in
the form of a Directional Acyclic Graph (DAG) of operations on message streams.
It provides a rich set of built-in operators that simplify common stream
processing operations such as filtering, projection, repartitioning, joins, and
windows.
+2. [Low Level Task API](low-level-api.html): Samza's powerful Low Level
Task API lets you write your application in terms of processing logic for each
incoming message.
+2. [Samza SQL](samza-sql.html): Samza SQL provides a declarative query
language for describing your stream processing logic. It lets you manipulate
streams using SQL predicates and UDFs instead of working with the physical
implementation details.
3. Apache Beam API: Samza also provides a [Apache Beam
runner](https://beam.apache.org/documentation/runners/capability-matrix/) to
run applications written using the Apache Beam API. This is considered as an
extension to the operators supported by the High Level Streams API in Samza.
diff --git a/docs/learn/documentation/versioned/connectors/eventhubs.md
b/docs/learn/documentation/versioned/connectors/eventhubs.md
index 11de3ff..a7c7a70 100644
--- a/docs/learn/documentation/versioned/connectors/eventhubs.md
+++ b/docs/learn/documentation/versioned/connectors/eventhubs.md
@@ -23,7 +23,7 @@ title: Event Hubs Connector
The Samza EventHubs connector provides access to [Azure
EventHubs](https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-features),
Microsoft’s data streaming service on Azure. An
svn commit: r1852770 [2/14] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/1.0.0/ learn/documentation/1.0.0/api/ learn/documentation/1.0.0/api/javadocs/ l
Modified: samza/site/case-studies/netflix.html URL: http://svn.apache.org/viewvc/samza/site/case-studies/netflix.html?rev=1852770=1852769=1852770=diff == --- samza/site/case-studies/netflix.html (original) +++ samza/site/case-studies/netflix.html Fri Feb 1 19:41:48 2019 @@ -81,7 +81,7 @@ Home - Docs + Docs Powered By Downloads Blog @@ -152,10 +152,10 @@ - QuickStart + QuickStart - Code Examples + Code Examples @@ -187,7 +187,7 @@ Documentation - + @@ -655,7 +655,7 @@ Meetups Blog - About + About Modified: samza/site/case-studies/optimizely.html URL: http://svn.apache.org/viewvc/samza/site/case-studies/optimizely.html?rev=1852770=1852769=1852770=diff == --- samza/site/case-studies/optimizely.html (original) +++ samza/site/case-studies/optimizely.html Fri Feb 1 19:41:48 2019 @@ -81,7 +81,7 @@ Home - Docs + Docs Powered By Downloads Blog @@ -152,10 +152,10 @@ - QuickStart + QuickStart - Code Examples + Code Examples @@ -187,7 +187,7 @@ Documentation - + @@ -694,7 +694,7 @@ data-enrichment, re-partitioning of even Meetups Blog - About + About Modified: samza/site/case-studies/redfin.html URL: http://svn.apache.org/viewvc/samza/site/case-studies/redfin.html?rev=1852770=1852769=1852770=diff == --- samza/site/case-studies/redfin.html (original) +++ samza/site/case-studies/redfin.html Fri Feb 1 19:41:48 2019 @@ -81,7 +81,7 @@ Home - Docs + Docs Powered By Downloads Blog @@ -152,10 +152,10 @@ - QuickStart + QuickStart - Code Examples + Code Examples @@ -187,7 +187,7 @@ Documentation - + @@ -693,7 +693,7 @@ calculating business metrics, document p Meetups Blog - About + About Modified: samza/site/case-studies/slack.html URL: http://svn.apache.org/viewvc/samza/site/case-studies/slack.html?rev=1852770=1852769=1852770=diff == --- samza/site/case-studies/slack.html (original) +++ samza/site/case-studies/slack.html Fri Feb 1 19:41:48 2019 @@ -81,7 +81,7 @@ Home - Docs + Docs Powered By Downloads Blog @@ -152,10 +152,10 @@ - QuickStart + QuickStart - Code Examples + Code Examples @@ -187,7 +187,7 @@ Documentation - + @@ -527,7 +527,7 @@ Ease of extensibility to other use cases like experimentation - + The engineering team at Slack built their data platform using Apache Samza. It has three types of Samza jobs - Routers, Processors and Converters. @@ -673,7 +673,7 @@ incoming log events, decorate them and a Meetups Blog - About + About Modified: samza/site/case-studies/state.html URL: http://svn.apache.org/viewvc/samza/site/case-studies/state.html?rev=1852770=1852769=1852770=diff == --- samza/site/case-studies/state.html (original) +++ samza/site/case-studies/state.html Fri Feb 1 19:41:48 2019 @@ -81,7 +81,7 @@ Home - Docs + Docs Powered By Downloads Blog @@ -152,10 +152,10 @@ - QuickStart + QuickStart - Code Examples + Code Examples @@ -187,7 +187,7 @@ Documentation - + @@ -655,7 +655,7 @@ Meetups Blog - About + About Modified: samza/site/case-studies/tripadvisor.html URL: http://svn.apache.org/viewvc/samza/site/case-studies/tripadvisor.html?rev=1852770=1852769=1852770=diff == --- samza/site/case-studies/tripadvisor.html (original) +++ samza/site/case-studies/tripadvisor.html Fri Feb 1 19:41:48 2019 @@ -81,7 +81,7 @@ Home - Docs + Docs Powered By
svn commit: r1852770 [6/14] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/1.0.0/ learn/documentation/1.0.0/api/ learn/documentation/1.0.0/api/javadocs/ l
Added:
samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/schema/SqlFieldSchema.html
URL:
http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/schema/SqlFieldSchema.html?rev=1852770=auto
==
---
samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/schema/SqlFieldSchema.html
(added)
+++
samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/schema/SqlFieldSchema.html
Fri Feb 1 19:41:48 2019
@@ -0,0 +1,367 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+SqlFieldSchema (samza-api 1.0.1-SNAPSHOT API)
+
+
+
+
+
+
+var methods =
{"i0":9,"i1":9,"i2":9,"i3":9,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10};
+var tabs = {65535:["t0","All Methods"],1:["t1","Static
Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.samza.sql.schema
+Class SqlFieldSchema
+
+
+
+java.lang.Object
+
+
+org.apache.samza.sql.schema.SqlFieldSchema
+
+
+
+
+
+
+
+
+public class SqlFieldSchema
+extends java.lang.Object
+Schema for the Samza SQL Field.
+
+
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsStatic MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+static SqlFieldSchema
+createArraySchema(SqlFieldSchemaelementType)
+
+
+static SqlFieldSchema
+createMapSchema(SqlFieldSchemavalueType)
+
+
+static SqlFieldSchema
+createPrimitiveSchema(SamzaSqlFieldTypetypeName)
+Create a primitive fi
+
+
+
+static SqlFieldSchema
+createRowFieldSchema(SqlSchemarowSchema)
+
+
+SqlFieldSchema
+getElementSchema()
+Get the element schema if the field type is SamzaSqlFieldType.ARRAY
+
+
+
+SamzaSqlFieldType
+getFieldType()
+Get teh Type of the Samza SQL Field.
+
+
+
+SqlSchema
+getRowSchema()
+Get the row schema if the field type is SamzaSqlFieldType.ROW
+
+
+
+SqlFieldSchema
+getValueScehma()
+Get the schema of the value if the field type is SamzaSqlFieldType.MAP
+
+
+
+boolean
+isPrimitiveField()
+
+
+
+
+
+
+Methods inherited from classjava.lang.Object
+clone, equals, finalize, getClass, hashCode, notify, notifyAll,
toString, wait, wait, wait
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Method Detail
+
+
+
+
+
+createPrimitiveSchema
+public staticSqlFieldSchemacreatePrimitiveSchema(SamzaSqlFieldTypetypeName)
+Create a primitive fi
+
+Parameters:
+typeName -
+Returns:
+
+
+
+
+
+
+
+
+createArraySchema
+public staticSqlFieldSchemacreateArraySchema(SqlFieldSchemaelementType)
+
+
+
+
+
+
+
+createMapSchema
+public staticSqlFieldSchemacreateMapSchema(SqlFieldSchemavalueType)
+
+
+
+
+
+
+
+createRowFieldSchema
+public staticSqlFieldSchemacreateRowFieldSchema(SqlSchemarowSchema)
+
+
+
+
+
+
+
+isPrimitiveField
+publicbooleanisPrimitiveField()
+
+Returns:
+whether the field is a primitive field type or not.
+
+
+
+
+
+
+
+
+getFieldType
+publicSamzaSqlFieldTypegetFieldType()
+Get teh Type of the Samza SQL Field.
+
+Returns:
+
+
+
+
+
+
+
+
+getElementSchema
+publicSqlFieldSchemagetElementSchema()
+Get the element schema if the field type is SamzaSqlFieldType.ARRAY
+
+
+
+
+
+
+
+getValueScehma
+publicSqlFieldSchemagetValueScehma()
+Get the schema of the value if the field type is SamzaSqlFieldType.MAP
+
+
+
+
+
+
+
+getRowSchema
+publicSqlSchemagetRowSchema()
+Get the row schema if the field type is SamzaSqlFieldType.ROW
+
+
+
+
+
+
+
+
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
Added:
samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/schema/SqlSchema.SqlField.html
URL:
svn commit: r1852770 [9/14] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/1.0.0/ learn/documentation/1.0.0/api/ learn/documentation/1.0.0/api/javadocs/ l
Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/EndOfStreamMessage.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/EndOfStreamMessage.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/EndOfStreamMessage.html (original) +++ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/EndOfStreamMessage.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + EndOfStreamMessage (samza-api 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/ExtendedSystemAdmin.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/ExtendedSystemAdmin.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/ExtendedSystemAdmin.html (original) +++ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/ExtendedSystemAdmin.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + ExtendedSystemAdmin (samza-api 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/IncomingMessageEnvelope.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/IncomingMessageEnvelope.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/IncomingMessageEnvelope.html (original) +++ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/IncomingMessageEnvelope.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + IncomingMessageEnvelope (samza-api 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/MessageType.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/MessageType.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/MessageType.html (original) +++ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/MessageType.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + MessageType (samza-api 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/OutgoingMessageEnvelope.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/OutgoingMessageEnvelope.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/OutgoingMessageEnvelope.html (original) +++ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/OutgoingMessageEnvelope.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + OutgoingMessageEnvelope (samza-api 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/StreamSpec.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/StreamSpec.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/StreamSpec.html (original) +++ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/StreamSpec.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + StreamSpec (samza-api 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/StreamValidationException.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/StreamValidationException.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/StreamValidationException.html (original) +++ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/StreamValidationException.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + StreamValidationException (samza-api 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/system/SystemAdmin.html URL:
svn commit: r1852770 [13/14] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/1.0.0/ learn/documentation/1.0.0/api/ learn/documentation/1.0.0/api/javadocs/
Modified: samza/site/releases/1.0.0.html
URL:
http://svn.apache.org/viewvc/samza/site/releases/1.0.0.html?rev=1852770=1852769=1852770=diff
==
--- samza/site/releases/1.0.0.html (original)
+++ samza/site/releases/1.0.0.html Fri Feb 1 19:41:48 2019
@@ -81,7 +81,7 @@
Home
- Docs
+ Docs
Powered By
Downloads
Blog
@@ -152,10 +152,10 @@
- QuickStart
+ QuickStart
- Code Examples
+ Code Examples
@@ -187,7 +187,7 @@
Documentation
-
+
@@ -958,7 +958,7 @@ make a change, since it now only has a s
Meetups
Blog
- About
+ About
Modified: samza/site/releases/older.html
URL:
http://svn.apache.org/viewvc/samza/site/releases/older.html?rev=1852770=1852769=1852770=diff
==
--- samza/site/releases/older.html (original)
+++ samza/site/releases/older.html Fri Feb 1 19:41:48 2019
@@ -81,7 +81,7 @@
Home
- Docs
+ Docs
Powered By
Downloads
Blog
@@ -152,10 +152,10 @@
- QuickStart
+ QuickStart
- Code Examples
+ Code Examples
@@ -187,7 +187,7 @@
Documentation
-
+
@@ -561,7 +561,7 @@
Meetups
Blog
- About
+ About
Modified: samza/site/startup/code-examples/1.0.0/index.html
URL:
http://svn.apache.org/viewvc/samza/site/startup/code-examples/1.0.0/index.html?rev=1852770=1852769=1852770=diff
==
--- samza/site/startup/code-examples/1.0.0/index.html (original)
+++ samza/site/startup/code-examples/1.0.0/index.html Fri Feb 1 19:41:48 2019
@@ -546,6 +546,72 @@ These include:
https://github.com/apache/samza-hello-samza/tree/master/src/main/java/samza/examples/kinesis;>Amazon
Kinesis and https://github.com/apache/samza-hello-samza/tree/latest/src/main/java/samza/examples/azure;>Azure
Eventhubs examples that cover how to consume input data from the
respective systems.
+Low-level API examples
+
+The https://github.com/apache/samza-hello-samza/tree/latest/src/main/java/samza/examples/wikipedia/task/application;>Wikipedia
Parser (low-level API):
+Same example that builds a streaming pipeline consuming a live-feed of
+wikipedia edits, parsing each message and generating statistics from them, but
+using low-level APIs.
+
+Samza SQL API examples
+
+You can easily create a Samza job declaratively using
+https://samza.apache.org/learn/tutorials/0.14/samza-sql.html;>Samza
SQL.
+
+Apache Beam API examples
+
+The easiest way to get a copy of the WordCount examples in Beam API is to
use http://maven.apache.org/download.cgi;>Apache Maven. After
installing Maven, please run the following command:
+
+ mvn archetype:generate \
+ -DarchetypeGroupId=org.apache.beam \
+ -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples \
+ -DarchetypeVersion=2.9.0
\
+ -DgroupId=org.example \
+ -DartifactId=word-count-beam \
+ -Dversion=0.1
\
+ -Dpackage=org.apache.beam.examples \
+ -DinteractiveMode=false
+
+This command creates a maven project word-count-beam which
contains a series of example pipelines that count words in text files:
+
+ cd word-count-beam/
+
+ ls src/main/java/org/apache/beam/examples/
+DebuggingWordCount.java WindowedWordCount.java common
+MinimalWordCount.java WordCount.java
+
+To use SamzaRunner, please add the following samza-runner
profile to pom.xml under the profiles section, same
as in https://github.com/apache/beam/blob/master/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/pom.xml;>here.
+
+...
+profile
+ idsamza-runner/id
+ dependencies
+dependency
+ groupIdorg.apache.beam/groupId
+ artifactIdbeam-runners-samza/artifactId
+ version${beam.version}/version
+ scoperuntime/scope
+/dependency
+ /dependencies
+/profile
+
+
+Now we can run the wordcount example with Samza using the following
command:
+
+mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \
+ -Dexec.args=--inputFile=pom.xml --output=/tmp/counts
--runner=SamzaRunner -Psamza-runner
+
+After the pipeline finishes, you can check out the output counts files in
/tmp folder. Note Beam generates multiple output files for parallel processing.
If you prefer a single output, please update the code to use
TextIO.write().withoutSharding().
+
+more /tmp/counts*
+AS: 1
+IO: 2
+IS: 1
+OF: 1
+...
+
+A walkthrough of the example code can be found
svn commit: r1852770 [8/14] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/1.0.0/ learn/documentation/1.0.0/api/ learn/documentation/1.0.0/api/javadocs/ l
Added:
samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/StartpointUpcoming.html
URL:
http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/StartpointUpcoming.html?rev=1852770=auto
==
---
samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/StartpointUpcoming.html
(added)
+++
samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/StartpointUpcoming.html
Fri Feb 1 19:41:48 2019
@@ -0,0 +1,317 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+StartpointUpcoming (samza-api 1.0.1-SNAPSHOT API)
+
+
+
+
+
+
+var methods = {"i0":10,"i1":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.samza.startpoint
+Class
StartpointUpcoming
+
+
+
+java.lang.Object
+
+
+org.apache.samza.startpoint.Startpoint
+
+
+org.apache.samza.startpoint.StartpointUpcoming
+
+
+
+
+
+
+
+
+
+
+public final class StartpointUpcoming
+extends Startpoint
+A Startpoint that represents the
latest offset in a stream partition.
+
+
+
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+StartpointUpcoming()
+Constructs a Startpoint that represents the
latest offset in a stream partition.
+
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+void
+apply(SystemStreamPartitionsystemStreamPartition,
+ StartpointVisitorstartpointVisitor)
+Apply the visitor StartpointVisitor's register
methods to the instance of this Startpoint
+ class.
+
+
+
+java.lang.String
+toString()
+
+
+
+
+
+
+Methods inherited from classorg.apache.samza.startpoint.Startpoint
+equals,
getCreationTimestamp,
hashCode
+
+
+
+
+
+Methods inherited from classjava.lang.Object
+clone, finalize, getClass, notify, notifyAll, wait, wait,
wait
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Constructor Detail
+
+
+
+
+
+StartpointUpcoming
+publicStartpointUpcoming()
+Constructs a Startpoint that represents the
latest offset in a stream partition.
+
+
+
+
+
+
+
+
+
+Method Detail
+
+
+
+
+
+apply
+publicvoidapply(SystemStreamPartitionsystemStreamPartition,
+ StartpointVisitorstartpointVisitor)
+Description copied from
class:Startpoint
+Apply the visitor StartpointVisitor's register
methods to the instance of this Startpoint
+ class.
+
+Specified by:
+applyin
classStartpoint
+Parameters:
+systemStreamPartition - The SystemStreamPartition
needed to register with the StartpointVisitor
+startpointVisitor - The visitor to register with.
+
+
+
+
+
+
+
+
+toString
+publicjava.lang.StringtoString()
+
+Overrides:
+toStringin
classStartpoint
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
Added:
samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/StartpointVisitor.html
URL:
http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/StartpointVisitor.html?rev=1852770=auto
==
---
samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/StartpointVisitor.html
(added)
+++
samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/StartpointVisitor.html
Fri Feb 1 19:41:48 2019
@@ -0,0 +1,322 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+StartpointVisitor (samza-api 1.0.1-SNAPSHOT API)
+
+
+
+
+
+
+var methods = {"i0":6,"i1":10,"i2":10,"i3":10,"i4":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],4:["t3","Abstract Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.samza.startpoint
+Class Startpoint
+
+
+
+java.lang.Object
+
+
+org.apache.samza.startpoint.Startpoint
+
+
+
+
+
+
+
+Direct Known Subclasses:
+StartpointCustom, StartpointOldest, StartpointSpecific, StartpointTimestamp, StartpointUpcoming
+
+
+
+@InterfaceStability.Unstable
+public abstract class Startpoint
+extends java.lang.Object
+Startpoint represents a position in a stream
partition.
+
+
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsAbstract MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+abstract void
svn commit: r1852770 [12/14] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/1.0.0/ learn/documentation/1.0.0/api/ learn/documentation/1.0.0/api/javadocs/
Modified: samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/JobStatus.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/JobStatus.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/JobStatus.html (original) +++ samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/JobStatus.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + JobStatus (samza-rest 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/Partition.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/Partition.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/Partition.html (original) +++ samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/Partition.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + Partition (samza-rest 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/Task.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/Task.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/Task.html (original) +++ samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/Task.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + Task (samza-rest 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/package-frame.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/package-frame.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/package-frame.html (original) +++ samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/package-frame.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + org.apache.samza.rest.model (samza-rest 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/package-summary.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/package-summary.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/package-summary.html (original) +++ samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/package-summary.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + org.apache.samza.rest.model (samza-rest 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/package-tree.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/package-tree.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/package-tree.html (original) +++ samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/package-tree.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + org.apache.samza.rest.model Class Hierarchy (samza-rest 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/yarn/YarnApplicationInfo.YarnApplication.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/yarn/YarnApplicationInfo.YarnApplication.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/yarn/YarnApplicationInfo.YarnApplication.html (original) +++ samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/yarn/YarnApplicationInfo.YarnApplication.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + YarnApplicationInfo.YarnApplication (samza-rest 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/rest/javadocs/org/apache/samza/rest/model/yarn/YarnApplicationInfo.html URL:
svn commit: r1852770 [1/14] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/1.0.0/ learn/documentation/1.0.0/api/ learn/documentation/1.0.0/api/javadocs/ l
Author: jagadish Date: Fri Feb 1 19:41:48 2019 New Revision: 1852770 URL: http://svn.apache.org/viewvc?rev=1852770=rev Log: publishing website for 1.0.0 Added: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/job/model/TaskMode.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/metadatastore/InMemoryMetadataStore.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/metadatastore/InMemoryMetadataStoreFactory.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/schema/ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/schema/SamzaSqlFieldType.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/schema/SqlFieldSchema.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/schema/SqlSchema.SqlField.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/schema/SqlSchema.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/schema/SqlSchemaBuilder.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/schema/package-frame.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/schema/package-summary.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/schema/package-tree.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/udfs/SamzaSqlUdf.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/sql/udfs/SamzaSqlUdfMethod.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/Startpoint.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/StartpointCustom.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/StartpointOldest.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/StartpointSpecific.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/StartpointTimestamp.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/StartpointUpcoming.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/StartpointVisitor.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/package-frame.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/package-summary.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/startpoint/package-tree.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/storage/StorageEngineFactory.StoreMode.html samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/table/AsyncReadWriteTable.html samza/site/learn/documentation/1.0.0/api/test-framework.html samza/site/startup/quick-start/1.0.0/samza-sql.html samza/site/startup/quick-start/1.0.0/samza.html Modified: samza/site/archive/index.html samza/site/blog/2017-08-27-announcing-the-release-of-apache-samza--0.13.1.html samza/site/blog/2018-01-31-announcing-the-release-of-apache-samza--0.14.0.html samza/site/blog/2018-05-31-announcing-the-release-of-apache-samza--0.14.1.html samza/site/blog/2018-07-19-stream_processing-meetup-summary.html samza/site/blog/2018-09-26-stangeloop-recap.html samza/site/blog/TEMPLATE.html samza/site/blog/index.html samza/site/case-studies/TEMPLATE.html samza/site/case-studies/digitalsmiths.html samza/site/case-studies/ebay.html samza/site/case-studies/fortscale.html samza/site/case-studies/index.html samza/site/case-studies/intuit.html samza/site/case-studies/linkedin.html samza/site/case-studies/netflix.html samza/site/case-studies/optimizely.html samza/site/case-studies/redfin.html samza/site/case-studies/slack.html samza/site/case-studies/state.html samza/site/case-studies/tripadvisor.html samza/site/case-studies/uber.html samza/site/community/committers-old.html samza/site/community/committers.html samza/site/community/contact-us.html samza/site/community/irc.html samza/site/contribute/code.html samza/site/contribute/coding-guide.html samza/site/contribute/contributors-corner.html samza/site/contribute/enhancement-proposal.html samza/site/contribute/tests.html samza/site/index.html samza/site/index.md.bak samza/site/learn/documentation/1.0.0/api/javadocs/allclasses-frame.html samza/site/learn/documentation/1.0.0/api/javadocs/allclasses-noframe.html samza/site/learn/documentation/1.0.0/api/javadocs/constant-values.html samza/site/learn/documentation/1.0.0/api/javadocs/deprecated-list.html samza/site/learn/documentation/1.0.0/api/javadocs/help-doc.html
svn commit: r1852770 [3/14] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/1.0.0/ learn/documentation/1.0.0/api/ learn/documentation/1.0.0/api/javadocs/ l
Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/JavaTableConfig.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/JavaTableConfig.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/JavaTableConfig.html (original) +++ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/JavaTableConfig.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + JavaTableConfig (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/MapConfig.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/MapConfig.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/MapConfig.html (original) +++ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/MapConfig.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + MapConfig (samza-api 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/package-frame.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/package-frame.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/package-frame.html (original) +++ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/package-frame.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + org.apache.samza.config (samza-api 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/package-summary.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/package-summary.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/package-summary.html (original) +++ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/package-summary.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + org.apache.samza.config (samza-api 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/package-tree.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/package-tree.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/package-tree.html (original) +++ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/config/package-tree.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + org.apache.samza.config Class Hierarchy (samza-api 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/container/TaskName.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/container/TaskName.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/container/TaskName.html (original) +++ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/container/TaskName.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + TaskName (samza-api 1.0.0 API) - + Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/container/grouper/stream/GrouperContext.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/container/grouper/stream/GrouperContext.html?rev=1852770=1852769=1852770=diff == --- samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/container/grouper/stream/GrouperContext.html (original) +++ samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/container/grouper/stream/GrouperContext.html Fri Feb 1 19:41:48 2019 @@ -2,9 +2,9 @@ - + GrouperContext (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/1.0.0/api/javadocs/org/apache/samza/container/grouper/stream/SystemStreamPartitionGrouper.html URL:
svn commit: r1852770 [14/14] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/1.0.0/ learn/documentation/1.0.0/api/ learn/documentation/1.0.0/api/javadocs/
Added: samza/site/startup/quick-start/1.0.0/samza-sql.html URL: http://svn.apache.org/viewvc/samza/site/startup/quick-start/1.0.0/samza-sql.html?rev=1852770=auto == --- samza/site/startup/quick-start/1.0.0/samza-sql.html (added) +++ samza/site/startup/quick-start/1.0.0/samza-sql.html Fri Feb 1 19:41:48 2019 @@ -0,0 +1,703 @@ + + + + + + + + + Samza - Samza SQL Quick Start + + + + + + + + + + + + + + https://samza.apache.org; /> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + Home + Docs + Powered By + Downloads + Blog + + + Community + + + + Contact Us + Contributor's Corner + PMC Members and committers + Talks and Meetups + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Getting Started + + + + + + + + + QuickStart + + + Code Examples + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Documentation + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Releases + + + + + + + + + 1.0.0 + + + 0.14 + + + 0.13 + + + 0.12 + + + 0.11 + + + 0.10 + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Blog + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Community + + + + + + + + + Contact Us + + + Contributor's Corner + + + Enhancement Proposal + + + PMC members & Committers + + + Talks and Meetups + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Case Studies + + + + + + + + + View All + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + eBay + + + + + + + + + + + + + + + + + + + + TripAdvisor + + + + + + + + + + + + + + + + Slack + + + + + + + + + + + + + + Optimizely + + + + + + + + + + + + + + Redfin + + + + + + + + + + + + + + LinkedIn + + + + + + + + + + + + + + + + + + + + + + + + + + + + Samza SQL Quick Start + + + + + + +Overview + +Samza SQL allows you to define your stream processing logic declaratively as a a SQL query. +This allows you to create streaming pipelines without Java code or configuration unless you +require user-defined functions (UDF). + +You can run Samza SQL locally on your machine or on a YARN cluster. + +Running Samza SQL on your local machine + +The https://samza.apache.org/learn/tutorials/0.14/samza-tools.html;>Samza SQL console allows you to experiment with Samza SQL locally on your machine. + +Setup Kafka + +Follow the instructions from the http://kafka.apache.org/quickstart;>Kafka quickstart to start the zookeeper and Kafka server. + +Let us create a Kafka topic named âProfileChangeStreamâ for this demo. +./deploy/kafka/bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic ProfileChangeStream + +Download the Samza tools package from https://samza.apache.org/learn/tutorials/0.14/samza-tools.html;>here and use the generate-kafka-events script populate the stream with sample data. +cd samza-tools-version +./scripts/generate-kafka-events.sh -t ProfileChangeStream -e ProfileChange + +Using the Samza SQL Console + +The simplest SQL query is to read all events
svn commit: r1852769 [10/18] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/latest/ learn/documentation/latest/api/ learn/documentation/latest/api/javadoc
Added:
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/startpoint/StartpointUpcoming.html
URL:
http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/startpoint/StartpointUpcoming.html?rev=1852769=auto
==
---
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/startpoint/StartpointUpcoming.html
(added)
+++
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/startpoint/StartpointUpcoming.html
Fri Feb 1 19:39:34 2019
@@ -0,0 +1,317 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+StartpointUpcoming (samza-api 1.0.1-SNAPSHOT API)
+
+
+
+
+
+
+var methods = {"i0":10,"i1":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.samza.startpoint
+Class
StartpointUpcoming
+
+
+
+java.lang.Object
+
+
+org.apache.samza.startpoint.Startpoint
+
+
+org.apache.samza.startpoint.StartpointUpcoming
+
+
+
+
+
+
+
+
+
+
+public final class StartpointUpcoming
+extends Startpoint
+A Startpoint that represents the
latest offset in a stream partition.
+
+
+
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+StartpointUpcoming()
+Constructs a Startpoint that represents the
latest offset in a stream partition.
+
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+void
+apply(SystemStreamPartitionsystemStreamPartition,
+ StartpointVisitorstartpointVisitor)
+Apply the visitor StartpointVisitor's register
methods to the instance of this Startpoint
+ class.
+
+
+
+java.lang.String
+toString()
+
+
+
+
+
+
+Methods inherited from classorg.apache.samza.startpoint.Startpoint
+equals,
getCreationTimestamp,
hashCode
+
+
+
+
+
+Methods inherited from classjava.lang.Object
+clone, finalize, getClass, notify, notifyAll, wait, wait,
wait
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Constructor Detail
+
+
+
+
+
+StartpointUpcoming
+publicStartpointUpcoming()
+Constructs a Startpoint that represents the
latest offset in a stream partition.
+
+
+
+
+
+
+
+
+
+Method Detail
+
+
+
+
+
+apply
+publicvoidapply(SystemStreamPartitionsystemStreamPartition,
+ StartpointVisitorstartpointVisitor)
+Description copied from
class:Startpoint
+Apply the visitor StartpointVisitor's register
methods to the instance of this Startpoint
+ class.
+
+Specified by:
+applyin
classStartpoint
+Parameters:
+systemStreamPartition - The SystemStreamPartition
needed to register with the StartpointVisitor
+startpointVisitor - The visitor to register with.
+
+
+
+
+
+
+
+
+toString
+publicjava.lang.StringtoString()
+
+Overrides:
+toStringin
classStartpoint
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
Added:
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/startpoint/StartpointVisitor.html
URL:
http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/startpoint/StartpointVisitor.html?rev=1852769=auto
==
---
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/startpoint/StartpointVisitor.html
(added)
+++
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/startpoint/StartpointVisitor.html
Fri Feb 1 19:39:34 2019
@@ -0,0 +1,322 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+StartpointVisitor (samza-api 1.0.1-SNAPSHOT API)
+
+
+
+
+
+
+var methods = {"i0":10,"i1":9,"i2":9};
+var tabs = {65535:["t0","All Methods"],1:["t1","Static
Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Enum Constants|
+Field|
+Method
+
+
+Detail:
+Enum Constants|
+Field|
+Method
+
+
+
+
+
+
+
+
+org.apache.samza.job.model
+Enum TaskMode
+
+
+
+java.lang.Object
+
+
+java.lang.EnumTaskMode
+
+
+org.apache.samza.job.model.TaskMode
+
+
+
+
+
+
+
+
+
+All Implemented Interfaces:
+java.io.Serializable, java.lang.ComparableTaskMode
+
+
+
+public enum TaskMode
+extends java.lang.EnumTaskMode
+This defines the logical mode of a taskInstance.
+ Active is the defacto mode for a task, i.e., tasks processing input,
reading/writing state, producing output, etc.
+ Standby is the mode for tasks, that maintain warmed-up KV state by reading
from its changelog.
+
+
+
+
+
+
+
+
+
+
+
+Enum Constant Summary
+
+Enum Constants
+
+Enum Constant and Description
+
+
+Active
+
+
+Standby
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsStatic MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+java.lang.String
+toString()
+
+
+static TaskMode
+valueOf(java.lang.Stringname)
+Returns the enum constant of this type with the specified
name.
+
+
+
+static TaskMode[]
+values()
+Returns an array containing the constants of this enum
type, in
+the order they are declared.
+
+
+
+
+
+
+
+Methods inherited from classjava.lang.Enum
+clone, compareTo, equals, finalize, getDeclaringClass, hashCode, name,
ordinal, valueOf
+
+
+
+
+
+Methods inherited from classjava.lang.Object
+getClass, notify, notifyAll, wait, wait, wait
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Enum Constant Detail
+
+
+
+
+
+Active
+public static finalTaskMode Active
+
+
+
+
+
+
+
+Standby
+public static finalTaskMode Standby
+
+
+
+
+
+
+
+
+
+Method Detail
+
+
+
+
+
+values
+public staticTaskMode[]values()
+Returns an array containing the constants of this enum
type, in
+the order they are declared. This method may be used to iterate
+over the constants as follows:
+
+for (TaskMode c : TaskMode.values())
+ System.out.println(c);
+
+
+Returns:
+an array containing the constants of this enum type, in the order they are
declared
+
+
+
+
+
+
+
+
+valueOf
+public staticTaskModevalueOf(java.lang.Stringname)
+Returns the enum constant of this type with the specified
name.
+The string must match exactly an identifier used to declare an
+enum constant in this type. (Extraneous whitespace characters are
+not permitted.)
+
+Parameters:
+name - the name of the enum constant to be returned.
+Returns:
+the enum constant with the specified name
+Throws:
+java.lang.IllegalArgumentException - if this enum type has no
constant with the specified name
+java.lang.NullPointerException - if the argument is null
+
+
+
+
+
+
+
+
+toString
+publicjava.lang.StringtoString()
+
+Overrides:
+toStringin classjava.lang.EnumTaskMode
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Enum Constants|
+Field|
+Method
+
+
+Detail:
+Enum Constants|
+Field|
+Method
+
+
+
+
+
+
+
+
Modified:
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/job/model/TaskModel.html
URL:
svn commit: r1852769 [3/18] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/latest/ learn/documentation/latest/api/ learn/documentation/latest/api/javadocs
Modified: samza/site/learn/documentation/latest/api/javadocs/index-all.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/index-all.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/index-all.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/index-all.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + Index (samza-api 1.0.1-SNAPSHOT API) - + @@ -101,6 +101,8 @@ Add a value to the list. +addField(String, SqlFieldSchema) - Method in class org.apache.samza.sql.schema.SqlSchemaBuilder + addStoreConfig(String, String, MapString, String) - Method in class org.apache.samza.table.descriptors.LocalTableDescriptor Helper method to add a store level config item to table configuration @@ -109,6 +111,10 @@ Helper method to add a config item to table configuration +afterCheckpoint(MapSystemStreamPartition, String) - Method in interface org.apache.samza.checkpoint.CheckpointListener + +Called after writing the checkpoint for each Task in the Container processing SSPs on this system. + afterFailure(Throwable) - Method in interface org.apache.samza.runtime.ProcessorLifecycleListener User defined callback after a StreamProcessor is stopped with failure @@ -121,6 +127,8 @@ User defined callback after a StreamProcessor is stopped successfully +all() - Method in class org.apache.samza.metadatastore.InMemoryMetadataStore + all() - Method in interface org.apache.samza.metadatastore.MetadataStore Returns all the entries in this metadata store. @@ -205,6 +213,21 @@ Joins the provided messages and table record, returns the joined message. +apply(SystemStreamPartition, StartpointVisitor) - Method in class org.apache.samza.startpoint.Startpoint + +Apply the visitor StartpointVisitor's register methods to the instance of this Startpoint + class. + +apply(SystemStreamPartition, StartpointVisitor) - Method in class org.apache.samza.startpoint.StartpointCustom + +apply(SystemStreamPartition, StartpointVisitor) - Method in class org.apache.samza.startpoint.StartpointOldest + +apply(SystemStreamPartition, StartpointVisitor) - Method in class org.apache.samza.startpoint.StartpointSpecific + +apply(SystemStreamPartition, StartpointVisitor) - Method in class org.apache.samza.startpoint.StartpointTimestamp + +apply(SystemStreamPartition, StartpointVisitor) - Method in class org.apache.samza.startpoint.StartpointUpcoming + apply(IncomingMessageEnvelope) - Method in interface org.apache.samza.system.descriptors.InputTransformer Transforms the provided IncomingMessageEnvelope with deserialized key and message into another message @@ -217,6 +240,10 @@ ASYNC_CALLBACK_POOL_SIZE - Static variable in class org.apache.samza.table.descriptors.RemoteTableDescriptor +AsyncReadWriteTableK,V - Interface in org.apache.samza.table + +A table that supports asynchronous get, put and delete by one or more keys + AsyncStreamTask - Interface in org.apache.samza.task An AsyncStreamTask is the basic class to support multithreading execution in Samza container. @@ -246,6 +273,10 @@ Constructs a table descriptor instance +beforeCheckpoint(MapSystemStreamPartition, String) - Method in interface org.apache.samza.checkpoint.CheckpointListener + +Called before writing the checkpoint for each Task in the Container processing SSPs on this system. + beforeStart() - Method in interface org.apache.samza.runtime.ProcessorLifecycleListener User defined initialization before a StreamProcessor is started @@ -287,6 +318,8 @@ BufferSizeGauge(SystemStreamPartition, String) - Constructor for class org.apache.samza.util.BlockingEnvelopeMap.BufferSizeGauge +build() - Method in class org.apache.samza.sql.schema.SqlSchemaBuilder + build() - Method in class org.apache.samza.storage.StoreProperties.StorePropertiesBuilder buildCommand() - Method in class org.apache.samza.job.CommandBuilder @@ -297,6 +330,8 @@ buildEnvironment() - Method in class org.apache.samza.job.CommandBuilder +builder() - Static method in class org.apache.samza.sql.schema.SqlSchemaBuilder + buildKey(String, String) - Static method in class org.apache.samza.config.JavaTableConfig Build complete config key for a config item @@ -364,8 +399,8 @@ CheckpointListener - Interface in org.apache.samza.checkpoint -This interface should be implemented by SystemConsumers which want to be notified about checkpoint values - of the most recent checkpoint. +SystemConsumers that want to be notified about checkpoints for their SSPs and potentially modify them may + implement this interface. CheckpointManager - Interface in org.apache.samza.checkpoint @@ -409,6 +444,8 @@ Deprecated. +close() - Method in class org.apache.samza.metadatastore.InMemoryMetadataStore + close() - Method in interface
svn commit: r1852769 [13/18] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/latest/ learn/documentation/latest/api/ learn/documentation/latest/api/javadoc
Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/SerdeUtils.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/SerdeUtils.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/SerdeUtils.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/SerdeUtils.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + SerdeUtils (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/package-frame.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/package-frame.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/package-frame.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/package-frame.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + org.apache.samza.table.utils (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/package-summary.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/package-summary.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/package-summary.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/package-summary.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + org.apache.samza.table.utils (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/package-tree.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/package-tree.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/package-tree.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/table/utils/package-tree.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + org.apache.samza.table.utils Class Hierarchy (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/task/AsyncStreamTask.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/task/AsyncStreamTask.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/task/AsyncStreamTask.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/task/AsyncStreamTask.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + AsyncStreamTask (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/task/AsyncStreamTaskFactory.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/task/AsyncStreamTaskFactory.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/task/AsyncStreamTaskFactory.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/task/AsyncStreamTaskFactory.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + AsyncStreamTaskFactory (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/task/ClosableTask.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/task/ClosableTask.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/task/ClosableTask.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/task/ClosableTask.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + ClosableTask (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/task/EndOfStreamListenerTask.html URL:
svn commit: r1852769 [14/18] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/latest/ learn/documentation/latest/api/ learn/documentation/latest/api/javadoc
Added: samza/site/learn/documentation/latest/api/test-framework.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/test-framework.html?rev=1852769=auto == --- samza/site/learn/documentation/latest/api/test-framework.html (added) +++ samza/site/learn/documentation/latest/api/test-framework.html Fri Feb 1 19:39:34 2019 @@ -0,0 +1,967 @@ + + + + + + + + + Samza - Testing Samza jobs: Integration Framework + + + + + + + + + + + + + + https://samza.apache.org; /> + + + + + + + + + + + + + + + + + + + + + + + + + + + + + Home + Docs + Powered By + Downloads + Blog + + + Community + + + + Contact Us + Contributor's Corner + PMC Members and committers + Talks and Meetups + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Getting Started + + + + + + + + + QuickStart + + + Code Examples + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Documentation + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Releases + + + + + + + + + 1.0.0 + + + 0.14 + + + 0.13 + + + 0.12 + + + 0.11 + + + 0.10 + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Blog + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Community + + + + + + + + + Contact Us + + + Contributor's Corner + + + Enhancement Proposal + + + PMC members & Committers + + + Talks and Meetups + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +Case Studies + + + + + + + + + View All + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + eBay + + + + + + + + + + + + + + + + + + + + TripAdvisor + + + + + + + + + + + + + + + + Slack + + + + + + + + + + + + + + Optimizely + + + + + + + + + + + + + + Redfin + + + + + + + + + + + + + + LinkedIn + + + + + + + + + + + + + + + + + + + + + + + + + + + + Testing Samza jobs: Integration Framework + + + + + + +Releases + + + latest + + + + + 0.14 + + + + 0.13 + + + + 0.12 + + + + 0.11 + + + + 0.10 + + + + 1.0 + + + + 0.9 + + + + 0.8 + + + + 0.7 + + + + 0.7.0 + + + + -1000 + + + + + + + + + + + + + +What is Samzas Integration Test Framework ? + + + Samza provides an Integration framework which allows you to test applications by quickly running them against a few messages and asserting on expected results. This alleviates the need to set up dependencies like Kafka, Yarn, Zookeeper to test your Samza applications + Integration Framework can test the new StreamDSL (StreamApplication) and Task APIs (TaskApplication) as well as supports testing for legacy low level (StreamTask and AsyncStreamTask) samza jobs + + +Some Prerequisite
svn commit: r1852769 [16/18] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/latest/ learn/documentation/latest/api/ learn/documentation/latest/api/javadoc
Modified: samza/site/meetups/index.html URL: http://svn.apache.org/viewvc/samza/site/meetups/index.html?rev=1852769=1852768=1852769=diff == --- samza/site/meetups/index.html (original) +++ samza/site/meetups/index.html Fri Feb 1 19:39:34 2019 @@ -81,7 +81,7 @@ Home - Docs + Docs Powered By Downloads Blog @@ -152,10 +152,10 @@ - QuickStart + QuickStart - Code Examples + Code Examples @@ -187,7 +187,7 @@ Documentation - + @@ -3448,7 +3448,7 @@ Meetups Blog - About + About Modified: samza/site/powered-by/index.html URL: http://svn.apache.org/viewvc/samza/site/powered-by/index.html?rev=1852769=1852768=1852769=diff == --- samza/site/powered-by/index.html (original) +++ samza/site/powered-by/index.html Fri Feb 1 19:39:34 2019 @@ -81,7 +81,7 @@ Home - Docs + Docs Powered By Downloads Blog @@ -152,10 +152,10 @@ - QuickStart + QuickStart - Code Examples + Code Examples @@ -187,7 +187,7 @@ Documentation - + @@ -1267,7 +1267,7 @@ A list of companies powered by Samza Meetups Blog - About + About Modified: samza/site/releases/0.10.html URL: http://svn.apache.org/viewvc/samza/site/releases/0.10.html?rev=1852769=1852768=1852769=diff == --- samza/site/releases/0.10.html (original) +++ samza/site/releases/0.10.html Fri Feb 1 19:39:34 2019 @@ -81,7 +81,7 @@ Home - Docs + Docs Powered By Downloads Blog @@ -152,10 +152,10 @@ - QuickStart + QuickStart - Code Examples + Code Examples @@ -187,7 +187,7 @@ Documentation - + @@ -580,7 +580,7 @@ Meetups Blog - About + About Modified: samza/site/releases/0.11.html URL: http://svn.apache.org/viewvc/samza/site/releases/0.11.html?rev=1852769=1852768=1852769=diff == --- samza/site/releases/0.11.html (original) +++ samza/site/releases/0.11.html Fri Feb 1 19:39:34 2019 @@ -81,7 +81,7 @@ Home - Docs + Docs Powered By Downloads Blog @@ -152,10 +152,10 @@ - QuickStart + QuickStart - Code Examples + Code Examples @@ -187,7 +187,7 @@ Documentation - + @@ -576,7 +576,7 @@ Meetups Blog - About + About Modified: samza/site/releases/0.12.html URL: http://svn.apache.org/viewvc/samza/site/releases/0.12.html?rev=1852769=1852768=1852769=diff == --- samza/site/releases/0.12.html (original) +++ samza/site/releases/0.12.html Fri Feb 1 19:39:34 2019 @@ -81,7 +81,7 @@ Home - Docs + Docs Powered By Downloads Blog @@ -152,10 +152,10 @@ - QuickStart + QuickStart - Code Examples + Code Examples @@ -187,7 +187,7 @@ Documentation - + @@ -586,7 +586,7 @@ Meetups Blog - About + About Modified: samza/site/releases/0.13.html URL: http://svn.apache.org/viewvc/samza/site/releases/0.13.html?rev=1852769=1852768=1852769=diff == --- samza/site/releases/0.13.html (original) +++ samza/site/releases/0.13.html Fri Feb 1 19:39:34 2019 @@ -81,7 +81,7 @@ Home - Docs + Docs Powered By Downloads Blog @@ -152,10 +152,10 @@ - QuickStart + QuickStart - Code Examples + Code Examples @@ -187,7 +187,7 @@ Documentation - + @@ -588,7 +588,7 @@ Meetups Blog - About + About Modified: samza/site/releases/0.14.html URL:
svn commit: r1852769 [15/18] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/latest/ learn/documentation/latest/api/ learn/documentation/latest/api/javadoc
Modified: samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/LocalStoreMonitorMetrics.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/LocalStoreMonitorMetrics.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/LocalStoreMonitorMetrics.html (original) +++ samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/LocalStoreMonitorMetrics.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + LocalStoreMonitorMetrics (samza-rest_2.11 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/Monitor.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/Monitor.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/Monitor.html (original) +++ samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/Monitor.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + Monitor (samza-rest_2.11 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/MonitorConfig.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/MonitorConfig.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/MonitorConfig.html (original) +++ samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/MonitorConfig.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + MonitorConfig (samza-rest_2.11 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/MonitorFactory.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/MonitorFactory.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/MonitorFactory.html (original) +++ samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/MonitorFactory.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + MonitorFactory (samza-rest_2.11 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/MonitorLoader.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/MonitorLoader.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/MonitorLoader.html (original) +++ samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/MonitorLoader.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + MonitorLoader (samza-rest_2.11 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/SamzaMonitorService.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/SamzaMonitorService.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/SamzaMonitorService.html (original) +++ samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/SamzaMonitorService.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + SamzaMonitorService (samza-rest_2.11 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/ScheduledExecutorSchedulingProvider.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/ScheduledExecutorSchedulingProvider.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/ScheduledExecutorSchedulingProvider.html (original) +++ samza/site/learn/documentation/latest/rest/javadocs/org/apache/samza/monitor/ScheduledExecutorSchedulingProvider.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + ScheduledExecutorSchedulingProvider (samza-rest_2.11 1.0.1-SNAPSHOT API) - + Modified:
svn commit: r1852769 [6/18] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/latest/ learn/documentation/latest/api/ learn/documentation/latest/api/javadocs
Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/ReadableMetricsRegistry.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/ReadableMetricsRegistry.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/ReadableMetricsRegistry.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/ReadableMetricsRegistry.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + ReadableMetricsRegistry (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/ReadableMetricsRegistryListener.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/ReadableMetricsRegistryListener.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/ReadableMetricsRegistryListener.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/ReadableMetricsRegistryListener.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + ReadableMetricsRegistryListener (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/Reservoir.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/Reservoir.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/Reservoir.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/Reservoir.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + Reservoir (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/SamzaHistogram.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/SamzaHistogram.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/SamzaHistogram.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/SamzaHistogram.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + SamzaHistogram (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/SlidingTimeWindowReservoir.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/SlidingTimeWindowReservoir.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/SlidingTimeWindowReservoir.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/SlidingTimeWindowReservoir.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + SlidingTimeWindowReservoir (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/Snapshot.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/Snapshot.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/Snapshot.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/Snapshot.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + Snapshot (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/Timer.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/Timer.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/Timer.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/Timer.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + Timer (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/metrics/package-frame.html URL:
svn commit: r1852769 [8/18] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/latest/ learn/documentation/latest/api/ learn/documentation/latest/api/javadocs
Added:
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/sql/schema/SqlSchema.SqlField.html
URL:
http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/sql/schema/SqlSchema.SqlField.html?rev=1852769=auto
==
---
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/sql/schema/SqlSchema.SqlField.html
(added)
+++
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/sql/schema/SqlSchema.SqlField.html
Fri Feb 1 19:39:34 2019
@@ -0,0 +1,342 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+SqlSchema.SqlField (samza-api 1.0.1-SNAPSHOT API)
+
+
+
+
+
+
+var methods = {"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your browser.
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
+org.apache.samza.sql.schema
+Class
SqlSchema.SqlField
+
+
+
+java.lang.Object
+
+
+org.apache.samza.sql.schema.SqlSchema.SqlField
+
+
+
+
+
+
+
+Enclosing class:
+SqlSchema
+
+
+
+public static class SqlSchema.SqlField
+extends java.lang.Object
+
+
+
+
+
+
+
+
+
+
+
+Constructor Summary
+
+Constructors
+
+Constructor and Description
+
+
+SqlField(intpos,
+java.lang.Stringname,
+SqlFieldSchemaschema)
+
+
+
+
+
+
+
+
+
+Method Summary
+
+All MethodsInstance MethodsConcrete Methods
+
+Modifier and Type
+Method and Description
+
+
+java.lang.String
+getFieldName()
+
+
+SqlFieldSchema
+getFieldSchema()
+
+
+int
+getPosition()
+
+
+void
+setFieldName(java.lang.StringfieldName)
+
+
+void
+setFieldSchema(SqlFieldSchemafieldSchema)
+
+
+void
+setPosition(intposition)
+
+
+
+
+
+
+Methods inherited from classjava.lang.Object
+clone, equals, finalize, getClass, hashCode, notify, notifyAll,
toString, wait, wait, wait
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Constructor Detail
+
+
+
+
+
+SqlField
+publicSqlField(intpos,
+java.lang.Stringname,
+SqlFieldSchemaschema)
+
+
+
+
+
+
+
+
+
+Method Detail
+
+
+
+
+
+getPosition
+publicintgetPosition()
+
+
+
+
+
+
+
+setPosition
+publicvoidsetPosition(intposition)
+
+
+
+
+
+
+
+getFieldName
+publicjava.lang.StringgetFieldName()
+
+
+
+
+
+
+
+setFieldName
+publicvoidsetFieldName(java.lang.StringfieldName)
+
+
+
+
+
+
+
+getFieldSchema
+publicSqlFieldSchemagetFieldSchema()
+
+
+
+
+
+
+
+setFieldSchema
+publicvoidsetFieldSchema(SqlFieldSchemafieldSchema)
+
+
+
+
+
+
+
+
+
+
+
+
+
+Skip navigation links
+
+
+
+
+Overview
+Package
+Class
+Tree
+Deprecated
+Index
+Help
+
+
+
+
+PrevClass
+NextClass
+
+
+Frames
+NoFrames
+
+
+AllClasses
+
+
+
+
+
+
+
+Summary:
+Nested|
+Field|
+Constr|
+Method
+
+
+Detail:
+Field|
+Constr|
+Method
+
+
+
+
+
+
+
+
Added:
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/sql/schema/SqlSchema.html
URL:
http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/sql/schema/SqlSchema.html?rev=1852769=auto
==
---
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/sql/schema/SqlSchema.html
(added)
+++
samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/sql/schema/SqlSchema.html
Fri Feb 1 19:39:34 2019
@@ -0,0 +1,291 @@
+http://www.w3.org/TR/html4/loose.dtd;>
+
+
+
+
+SqlSchema (samza-api 1.0.1-SNAPSHOT API)
+
+
+
+
+
+
+var methods = {"i0":10};
+var tabs = {65535:["t0","All Methods"],2:["t2","Instance
Methods"],8:["t4","Concrete Methods"]};
+var altColor = "altColor";
+var rowColor = "rowColor";
+var tableTab = "tableTab";
+var activeTableTab = "activeTableTab";
+
+
+JavaScript is disabled on your
svn commit: r1852769 [11/18] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/latest/ learn/documentation/latest/api/ learn/documentation/latest/api/javadoc
Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/KeyValueIterator.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/KeyValueIterator.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/KeyValueIterator.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/KeyValueIterator.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + KeyValueIterator (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/KeyValueSnapshot.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/KeyValueSnapshot.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/KeyValueSnapshot.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/KeyValueSnapshot.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + KeyValueSnapshot (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/KeyValueStore.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/KeyValueStore.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/KeyValueStore.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/KeyValueStore.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + KeyValueStore (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/package-frame.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/package-frame.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/package-frame.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/package-frame.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + org.apache.samza.storage.kv (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/package-summary.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/package-summary.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/package-summary.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/package-summary.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + org.apache.samza.storage.kv (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/package-tree.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/package-tree.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/package-tree.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/kv/package-tree.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + org.apache.samza.storage.kv Class Hierarchy (samza-api 1.0.1-SNAPSHOT API) - + Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/package-frame.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/package-frame.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/package-frame.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/storage/package-frame.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - + org.apache.samza.storage (samza-api 1.0.1-SNAPSHOT API) - + @@ -23,6 +23,10 @@ StoreProperties StoreProperties.StorePropertiesBuilder +Enums + +StorageEngineFactory.StoreMode + Modified:
svn commit: r1852769 [17/18] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/latest/ learn/documentation/latest/api/ learn/documentation/latest/api/javadoc
Modified: samza/site/startup/quick-start/latest/index.html
URL:
http://svn.apache.org/viewvc/samza/site/startup/quick-start/latest/index.html?rev=1852769=1852768=1852769=diff
==
--- samza/site/startup/quick-start/latest/index.html (original)
+++ samza/site/startup/quick-start/latest/index.html Fri Feb 1 19:39:34 2019
@@ -521,192 +521,9 @@
limitations under the License.
-->
-In this tutorial, we will create our first Samza application -
WordCount. This application will consume messages from a Kafka
stream, tokenize them into individual words and count the frequency of each
word. Let us download the entire project from https://github.com/apache/samza-hello-samza/blob/latest/quickstart/wordcount.tar.gz;>here.
+Samza Tutorial
-Setting up a Java Project
-
-Observe the project structure as follows:
-
-wordcount
-|-- build.gradle
-|-- gradle.properties
-|-- scripts
-|-- src
-|-- main
-|-- config
-|-- java
-|-- samzaapp
- |--
WordCount.java
-
-You can build the project anytime by running:
-
- cd wordcount
- gradle wrapper --gradle-version 4.9
- ./gradlew build
-
-Create a Samza StreamApplication
-
-Now letâs write some code! An application written using Samzas high-level
API implements the StreamApplication
interface:
-
-package samzaapp;
-
-import org.apache.samza.application.StreamApplication;
-import org.apache.samza.application.descriptors.StreamApplicationDescriptor;
-
-public class WordCount implements StreamApplication {
- @Override
- public void describe(StreamApplicationDescriptor streamApplicationDescriptor) {
- }
-}
-
-The interface provides a single method named describe(), which
allows us to define our inputs, the processing logic and outputs for our
application.
-
-Describe your inputs and outputs
-
-To interact with Kafka, we will first create a
KafkaSystemDescriptor by providing the coordinates of the Kafka
cluster. For each Kafka topic our application reads from, we create a
KafkaInputDescriptor with the name of the topic and a serializer.
Likewise, for each output topic, we instantiate a corresponding
KafkaOutputDescriptor.
-
-public class WordCount implements StreamApplication {
- private static final String KAFKA_SYSTEM_NAME = kafka;
- private static final ListString
KAFKA_CONSUMER_ZK_CONNECT = ImmutableList.of(localhost:2181);
- private static final ListString
KAFKA_PRODUCER_BOOTSTRAP_SERVERS = ImmutableList.of(localhost:9092);
- private static final MapString,
String KAFKA_DEFAULT_STREAM_CONFIGS = ImmutableMap.of(replication.factor, 1);
-
- private static final String INPUT_STREAM_ID = sample-text;
- private static final String OUTPUT_STREAM_ID = word-count-output;
-
- @Override
- public void describe(StreamApplicationDescriptor streamApplicationDescriptor) {
- // Create a KafkaSystemDescriptor providing properties of
the cluster
- KafkaSystemDescriptor kafkaSystemDescriptor = new KafkaSystemDescriptor(KAFKA_SYSTEM_NAME)
- .withConsumerZkConnect(KAFKA_CONSUMER_ZK_CONNECT)
- .withProducerBootstrapServers(KAFKA_PRODUCER_BOOTSTRAP_SERVERS)
- .withDefaultStreamConfigs(KAFKA_DEFAULT_STREAM_CONFIGS);
-
- // For each input or output stream, create a
KafkaInput/Output descriptor
- KafkaInputDescriptorKVString, String inputDescriptor =
- kafkaSystemDescriptor.getInputDescriptor(INPUT_STREAM_ID,
- KVSerde.of(new StringSerde(), new StringSerde()));
- KafkaOutputDescriptorKVString, String outputDescriptor =
- kafkaSystemDescriptor.getOutputDescriptor(OUTPUT_STREAM_ID,
- KVSerde.of(new StringSerde(), new StringSerde()));
-
- // Obtain a handle to a MessageStream that you can chain
operations on
- MessageStreamKVString, String lines = streamApplicationDescriptor.getInputStream(inputDescriptor);
- OutputStreamKVString, String counts = streamApplicationDescriptor.getOutputStream(outputDescriptor);
- }
-}
-
-The above example creates a MessageStream
which reads from an input topic named sample-text. It also
defines an output stream that emits results to a topic named
word-count-output. Next letâs add our processing logic.
-
-Add word count processing logic
-
-Kafka messages typically have a key and a value. Since we only care about
the value here, we will apply the map operator on the input stream
to extract the value.
-
-lines.map(kv - kv.value)
-
-Next, we will tokenize the message into individual words using the
flatmap operator.
-
-.flatMap(s - Arrays.asList(s.split(\\W+)))
-
-We now need to group the words, aggregate their respective counts and
periodically emit our results. For this, we will use Samzas
session-windowing feature.
-
-.window(Windows.keyedSessionWindow(
- w - w, Duration.ofSeconds(5), () - 0, (m, prevCount)
- prevCount + 1,
- new StringSerde(), new IntegerSerde()), count)
-
-Lets walk through each of the parameters to the above
window function:
-The
svn commit: r1852769 [4/18] - in /samza/site: ./ archive/ blog/ case-studies/ community/ contribute/ learn/documentation/latest/ learn/documentation/latest/api/ learn/documentation/latest/api/javadocs
Modified: samza/site/learn/documentation/latest/api/javadocs/index.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/index.html?rev=1852769=1852768=1852769=diff == --- samza/site/learn/documentation/latest/api/javadocs/index.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/index.html Fri Feb 1 19:39:34 2019 @@ -2,7 +2,7 @@ - + samza-api 1.0.1-SNAPSHOT API tmpTargetPage = "" + window.location.search; Modified: samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/Partition.html URL: http://svn.apache.org/viewvc/samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/Partition.html?rev=1852769&r1=1852768&r2=1852769&view=diff == --- samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/Partition.html (original) +++ samza/site/learn/documentation/latest/api/javadocs/org/apache/samza/Partition.html Fri Feb 1 19:39:34 2019 @@ -2,9 +2,9 @@ - +Partition (samza-api 1.0.1-SNAPSHOT API) - +