Stas Levin created BEAM-579:
---
Summary: Integrate NamedAggregators into Spark's sink system
Key: BEAM-579
URL: https://issues.apache.org/jira/browse/BEAM-579
Project: Beam
Issue Type: Task
[
https://issues.apache.org/jira/browse/BEAM-579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432450#comment-15432450
]
Stas Levin commented on BEAM-579:
-
I've started working on it and should have a patch pretty
[
https://issues.apache.org/jira/browse/BEAM-579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin updated BEAM-579:
Priority: Major (was: Critical)
> Integrate NamedAggregators into Spark's sink system
> -
Stas Levin created BEAM-613:
---
Summary: SimpleStreamingWordCountTest tests only a single batch
Key: BEAM-613
URL: https://issues.apache.org/jira/browse/BEAM-613
Project: Beam
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/BEAM-613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin updated BEAM-613:
Description:
{{org.apache.beam.runners.spark.translation.streaming.SimpleStreamingWordCountTest}}
aims to tes
[
https://issues.apache.org/jira/browse/BEAM-613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455424#comment-15455424
]
Stas Levin edited comment on BEAM-613 at 9/1/16 1:42 PM:
-
This impro
[
https://issues.apache.org/jira/browse/BEAM-613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15455424#comment-15455424
]
Stas Levin commented on BEAM-613:
-
This improvement will helps detecting issues such as BEAM
Stas Levin created BEAM-628:
---
Summary: Sink class
org.apache.beam.runners.spark.aggregators.metrics.sink.GraphiteSink cannot be
instantiated
Key: BEAM-628
URL: https://issues.apache.org/jira/browse/BEAM-628
[
https://issues.apache.org/jira/browse/BEAM-628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin updated BEAM-628:
Fix Version/s: 0.3.0-incubating
> Sink class
> org.apache.beam.runners.spark.aggregators.metrics.sink.Graphit
[
https://issues.apache.org/jira/browse/BEAM-628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin resolved BEAM-628.
-
Resolution: Fixed
> Sink class
> org.apache.beam.runners.spark.aggregators.metrics.sink.GraphiteSink cannot
[
https://issues.apache.org/jira/browse/BEAM-613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15483768#comment-15483768
]
Stas Levin commented on BEAM-613:
-
Pending [pull #909|https://github.com/apache/incubator-be
Stas Levin created BEAM-637:
---
Summary: WindowedValue$ValueInGlobalWindow is not serializable
when using JavaSerializer instead of Kryo
Key: BEAM-637
URL: https://issues.apache.org/jira/browse/BEAM-637
Proj
[
https://issues.apache.org/jira/browse/BEAM-613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin updated BEAM-613:
Summary: Add windwoding use cases to SimpleStreamingWordCountTest (was:
SimpleStreamingWordCountTest tests on
[
https://issues.apache.org/jira/browse/BEAM-613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin updated BEAM-613:
Description:
{{org.apache.beam.runners.spark.translation.streaming.SimpleStreamingWordCountTest}}
should have
[
https://issues.apache.org/jira/browse/BEAM-613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin updated BEAM-613:
Summary: SimpleStreamingWordCountTest does not properly test fixed windows
(was: Add windwoding use cases to
[
https://issues.apache.org/jira/browse/BEAM-613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin updated BEAM-613:
Description:
{{org.apache.beam.runners.spark.translation.streaming.SimpleStreamingWordCountTest}}
does not pr
Stas Levin created BEAM-669:
---
Summary: SimpleStreamingWordCountTest does not have a test for
sliding windows
Key: BEAM-669
URL: https://issues.apache.org/jira/browse/BEAM-669
Project: Beam
Issue T
[
https://issues.apache.org/jira/browse/BEAM-613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513318#comment-15513318
]
Stas Levin commented on BEAM-613:
-
I'll open a separate issue for adding a test for sliding
[
https://issues.apache.org/jira/browse/BEAM-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15516207#comment-15516207
]
Stas Levin commented on BEAM-637:
-
[~amitsela] I agree, we can make it about supporting Java
[
https://issues.apache.org/jira/browse/BEAM-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin updated BEAM-637:
Priority: Minor (was: Major)
> WindowedValue$ValueInGlobalWindow is not serializable when using
> JavaSerial
[
https://issues.apache.org/jira/browse/BEAM-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin updated BEAM-637:
Summary: Support Java serialisation (via JavaSerialiser) (was:
WindowedValue$ValueInGlobalWindow is not seria
[
https://issues.apache.org/jira/browse/BEAM-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin updated BEAM-637:
Issue Type: Improvement (was: Bug)
> Support Java serialisation (via JavaSerialiser)
> --
Stas Levin created BEAM-816:
---
Summary: Aggregators are not properly named when reported to
Graphite
Key: BEAM-816
URL: https://issues.apache.org/jira/browse/BEAM-816
Project: Beam
Issue Type: Bug
[
https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15633346#comment-15633346
]
Stas Levin commented on BEAM-891:
-
Sure.
I looked at it a bit this morning, my first impres
[
https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15650533#comment-15650533
]
Stas Levin commented on BEAM-891:
-
We can indeed try syncing the following block in {{SparkR
[
https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15650533#comment-15650533
]
Stas Levin edited comment on BEAM-891 at 11/9/16 12:28 PM:
---
We can
[
https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15650807#comment-15650807
]
Stas Levin commented on BEAM-891:
-
Perhaps it would be safe to go the other way around, i.e.
[
https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15661083#comment-15661083
]
Stas Levin commented on BEAM-891:
-
[~amitsela], as far as the name goes, we can try to make
[
https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15661083#comment-15661083
]
Stas Levin edited comment on BEAM-891 at 11/13/16 8:21 AM:
---
[~amit
[
https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin updated BEAM-891:
Comment: was deleted
(was: [~amitsela], as far as the name goes, we can try to make it clearer, say
by renami
[
https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15661096#comment-15661096
]
Stas Levin commented on BEAM-891:
-
[~amitsela], as far as the name goes, we can try to make
[
https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15661227#comment-15661227
]
Stas Levin commented on BEAM-891:
-
Cool, turning it off in relevant tests sounds reasonable.
[
https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15663281#comment-15663281
]
Stas Levin edited comment on BEAM-891 at 11/14/16 9:29 AM:
---
Sounds
[
https://issues.apache.org/jira/browse/BEAM-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15663281#comment-15663281
]
Stas Levin commented on BEAM-891:
-
Sounds good.
Btw, why can't we just set {{options.setEna
Stas Levin created BEAM-979:
---
Summary: ConcurrentModificationException exception after hours of
running
Key: BEAM-979
URL: https://issues.apache.org/jira/browse/BEAM-979
Project: Beam
Issue Type:
[
https://issues.apache.org/jira/browse/BEAM-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15666975#comment-15666975
]
Stas Levin commented on BEAM-979:
-
I think it may have to do with {StateSpecFunctions#mapSou
[
https://issues.apache.org/jira/browse/BEAM-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15666975#comment-15666975
]
Stas Levin edited comment on BEAM-979 at 11/15/16 12:24 PM:
I th
[
https://issues.apache.org/jira/browse/BEAM-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667018#comment-15667018
]
Stas Levin commented on BEAM-979:
-
I believe
{{scala.collection.convert.Wrappers$JIteratorW
[
https://issues.apache.org/jira/browse/BEAM-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667018#comment-15667018
]
Stas Levin edited comment on BEAM-979 at 11/15/16 12:38 PM:
I be
[
https://issues.apache.org/jira/browse/BEAM-983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668207#comment-15668207
]
Stas Levin commented on BEAM-983:
-
[~jasonkuster] [~amitsela] Sorry about that, can these te
Stas Levin created BEAM-1039:
Summary: Spark context is never actually re-used in tests
Key: BEAM-1039
URL: https://issues.apache.org/jira/browse/BEAM-1039
Project: Beam
Issue Type: Bug
[
https://issues.apache.org/jira/browse/BEAM-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin reassigned BEAM-1039:
Assignee: Stas Levin (was: Amit Sela)
> Spark context is never actually re-used in tests
>
[
https://issues.apache.org/jira/browse/BEAM-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15687906#comment-15687906
]
Stas Levin commented on BEAM-1039:
--
For some reason it looked like...
Must have been a br
[
https://issues.apache.org/jira/browse/BEAM-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin closed BEAM-1039.
Resolution: Not A Problem
Fix Version/s: Not applicable
> Spark context is never actually re-used in t
Stas Levin created BEAM-1050:
Summary: PipelineResult.State is not set to FAILED in when a
streaming job fails
Key: BEAM-1050
URL: https://issues.apache.org/jira/browse/BEAM-1050
Project: Beam
I
[
https://issues.apache.org/jira/browse/BEAM-1050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15699605#comment-15699605
]
Stas Levin commented on BEAM-1050:
--
I see that the code has changed since (the relevant sn
[
https://issues.apache.org/jira/browse/BEAM-1067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin updated BEAM-1067:
-
Description:
Seems that
{{org.apache.beam.runners.apex.examples.WordCountTest.testWordCountExample}} is
f
Stas Levin created BEAM-1067:
Summary: apex.examples.WordCountTest.testWordCountExample may be
flaky
Key: BEAM-1067
URL: https://issues.apache.org/jira/browse/BEAM-1067
Project: Beam
Issue Type:
[
https://issues.apache.org/jira/browse/BEAM-1067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15716750#comment-15716750
]
Stas Levin commented on BEAM-1067:
--
Not sure, but
{{org.apache.beam.runners.apex.translat
[
https://issues.apache.org/jira/browse/BEAM-298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin reassigned BEAM-298:
---
Assignee: Stas Levin
> Make TestPipeline implement the TestRule interface
> ---
[
https://issues.apache.org/jira/browse/BEAM-85?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin reassigned BEAM-85:
--
Assignee: Stas Levin
> PAssert needs sanity check that it's used correctly
> -
[
https://issues.apache.org/jira/browse/BEAM-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15751670#comment-15751670
]
Stas Levin commented on BEAM-690:
-
Hi,
I'm trying to look into it, correct me if I'm wrong,
[
https://issues.apache.org/jira/browse/BEAM-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15763964#comment-15763964
]
Stas Levin edited comment on BEAM-1176 at 12/20/16 11:18 AM:
-
I
[
https://issues.apache.org/jira/browse/BEAM-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15763964#comment-15763964
]
Stas Levin commented on BEAM-1176:
--
I've started migrating the tests to using the {{TestPi
[
https://issues.apache.org/jira/browse/BEAM-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15763964#comment-15763964
]
Stas Levin edited comment on BEAM-1176 at 12/20/16 11:20 AM:
-
I
Stas Levin created BEAM-1186:
Summary: Migrate the remaining tests to use TestPipeline as a
JUnit rule.
Key: BEAM-1186
URL: https://issues.apache.org/jira/browse/BEAM-1186
Project: Beam
Issue Ty
[
https://issues.apache.org/jira/browse/BEAM-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15764919#comment-15764919
]
Stas Levin commented on BEAM-1176:
--
Sounds good, enter [BEAM-1186|https://issues.apache.or
57 matches
Mail list logo