typos
We have tried this one the job manager can failover, but the task manager
CAN'T be relocated to the new task manager. Is there some settings for this
one ? Or is the task manager also can be relocate to the new job manager ?
Cheers
On Sat, Feb 27, 2016 at 7:27 AM, Welly Tambunan <i
master ?
Thanks for your help.
Cheers
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com <http://www.triplelands.com/blog/>
Hi Ufuk and Fabian,
Is that better to start 48 task manager ( one slot each ) in one machine
than having single task manager with 48 slot ? Any trade-off that we should
know etc ?
Cheers
On Tue, Feb 23, 2016 at 3:03 PM, Welly Tambunan <if05...@gmail.com> wrote:
> Hi Ufuk,
&
down
> (ExecutionConfig.setExecutionMode(ExecutionMode.BATCH)).
>
> Eventually, we want to merge the network buffer and the managed memory
> pools. So the "taskmanager.network.numberOfBuffers" configuration whill
> hopefully disappear at some point in the future.
>
> Bes
omatically resolve by
memory/network buffer manager ?
Thanks a lot for the help
Cheers
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com <http://www.triplelands.com/blog/>
push for the bugfix
> release.
>
>
> On Wed, Jan 13, 2016 at 8:39 AM, Welly Tambunan <if05...@gmail.com> wrote:
>
>> Hi All,
>>
>> We currently using snapshot version for development as we face Data
>> Stream union error. For deployment we may need to b
information I'm looking for are -
>>>>
>>>> 1. How do I do user level authentication to ensure that a job is
>>>> submitted/deleted/modified by the right user ? Is it possible though the
>>>> web client ?
>>>> 2. Authentication across multiple slave nodes (where the task managers
>>>> are running) and driver program so that they can communicate with each
>>>> other
>>>> 3. Support for SSL/encryption for data exchanged happening across the
>>>> slave nodes
>>>> 4. Support for pluggable authentication with existing solution like LDAP
>>>>
>>>> If not there today is there a roadmap for these security features ?
>>>>
>>>> Regards,
>>>> Sourav
>>>>
>>>
>>>
>>
>
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com <http://www.triplelands.com/blog/>
is
>>> submitted/deleted/modified by the right user ? Is it possible though the
>>> web client ?
>>> 2. Authentication across multiple slave nodes (where the task managers
>>> are running) and driver program so that they can communicate with each other
ne way of streaming of operators
>>> rather than typical map/reduce way that followed by hadoop or spark. Is any
>>> good documentation/blog/video avalable which talks about this internal. I
>>> am ok from a batch or streaming point of view.
>>>
>>> It will be gr
ndows start script for the webclient though.
> Would you mind and open a JIRA for that?
>
> Thanks,
> Fabian
>
> 2015-12-02 3:00 GMT+01:00 Welly Tambunan <if05...@gmail.com>:
>
>> Hi All,
>>
>> Is there any way to run WebClient for uploading the job from wind
Hi Aljoscha,
Is this fix has already been available on 0.10-SNAPSHOT ?
Cheers
On Tue, Dec 1, 2015 at 6:04 PM, Welly Tambunan <if05...@gmail.com> wrote:
> Thanks a lot Aljoscha.
>
> When it will be released ?
>
> Cheers
>
> On Tue, Dec 1, 2015 at 5:48 PM, Aljoscha K
nk it'll
> happen in the next 2-3 weeks.
>
>
> On Tue, Dec 1, 2015 at 11:48 PM, Welly Tambunan <if05...@gmail.com> wrote:
>
>> Hi Aljoscha,
>>
>> Is this fix has already been available on 0.10-SNAPSHOT ?
>>
>>
>> Cheers
>>
>> On Tue,
[[ "$SLAVE" =~
^.*/([0-9a-zA-Z.
-]+)$ ]]; then'
Starting Flink webclient
[Terminate]
Cheers
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com <http://www.triplelands.com/blog/>
e.org/jira/browse/FLINK-3080
Is there any plan which release this will be ?
Another issue i have after upgrading is can't union with different level of
parallelism.
I think we will need to fall back to 0.9 again for the time being.
Cheers
--
Welly Tambunan
Triplelands
http://weltam.wordpres
> On 01 Dec 2015, at 11:23, Welly Tambunan <if05...@gmail.com> wrote:
> >
> > Hi All,
> >
> > After upgrading our system to the latest version from 0.9 to 0.10.1 we
> have this following error.
> >
> > Exception in thread "main"
2015, at 02:35, Welly Tambunan <if05...@gmail.com> wrote:
> >
> > Hi All,
> >
> > I would like to know if there any feature differences between using
> Standalone Cluster vs YARN ?
> >
> > Until now we are using Standalone cluster for our jobs.
> > I
1-25 9:46 GMT+01:00 Ufuk Celebi <u...@apache.org>:
>
>> > On 25 Nov 2015, at 02:35, Welly Tambunan <if05...@gmail.com> wrote:
>> >
>> > Hi All,
>> >
>> > I would like to know if there any feature differences between using
>> Sta
egards,
> Andreas
>
> On Wed, Nov 25, 2015 at 10:02 AM, Welly Tambunan <if05...@gmail.com>
> wrote:
>
>> Hi Ufuk
>>
>> >In failure cases I find YARN more convenient, because it takes care of
>> restarting failed task manager processes/containers for you.
that if there's some value to that.
Cheers
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com <http://www.triplelands.com/blog/>
;
> – Ufuk
>
> > On 24 Nov 2015, at 08:26, Gyula Fóra <gyula.f...@gmail.com> wrote:
> >
> > Hi!
> >
> > This issue has been fixed very recently and the fix will go into the
> upcoming bugfix release. (0.10.1)
> >
> > Should be out
On Tue, Nov 24, 2015 at 10:27 AM, Welly Tambunan <if05...@gmail.com>
> wrote:
>
>> What i'm looking for here is the ability to add a node to the cluster
>> (scale out) when there's no task slot left for use.
>>
>>
>> On Tue, Nov 24, 2015 at 4:24 PM, Welly Tambu
Hi All,
Currently we are running flink using standalone mode.
Is there any way to add one node ( task manager ) to the cluster without
bringing the cluster down ?
Cheers
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com <http://www.triplelands.com/blog/>
Hi All,
Is there any way to stop/cancel the job that's restarting ?
I have already stop the cluster and start it again but seems it's still
restarting in dashboard.
I also try to cancel the job via CLI by running bin/flink cancel
but it's not working.
Cheers
--
Welly Tambunan
Triplelands
cel
> but it's not working.
>
>
>
> Cheers
>
>
> --
> Welly Tambunan
> Triplelands
>
> http://weltam.wordpress.com
> http://www.triplelands.com <http://www.triplelands.com/blog/>
>
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com <http://www.triplelands.com/blog/>
he-flink-user-mailing-list-archive.2336050.n4.nabble.com/Specially-introduced-Flink-to-chinese-users-in-CNCC-China-National-Computer-Congress-tp3254p3574.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>
--
Welly Tambunan
Triplelands
http:/
are of the GC issues.
>>>
>>> We are just adding functionality to make the Key/Value operator state
>>> usable in CoMap/CoFlatMap as well (currently it only works in windows and
>>> in Map/FlatMap/Filter functions over the KeyedStream).
>>> Until the, you s
Manager
> *M*: +31 (0)6 55 53 04 01 | *T*: +31 (0)88 10 44 555
> *E*: leon...@sagent.io | *W*: sagent.io | Disclaimer
> <http://sagent.io/email-disclaimer> | Sagent BV
> Herengracht 504 | 1017CB Amsterdam | Netherlands
>
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com <http://www.triplelands.com/blog/>
on watermark arrival.
>
> You can see the API reference and an example here:
> https://ci.apache.org/projects/flink/flink-docs-release-0.10/apis/streaming_guide.html#working-with-time
>
> Is this what you are looking for?
>
> Kostas
>
>
> On Sat, Nov 14, 2015 at 1:
Hi All,
I've just notice that the video has already available for this one.
http://flink-forward.org/?post_type=session
Another weekend gift for all.
Cheers
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com <http://www.triplelands.com/blog/>
on ready now, we expect to mostly to hardening and some
> infrastructure changes (for example annotations that specify API stability)
> for the 1.0 release.
>
> Let us know if you need more information.
>
> Cheers,
> Aljoscha
> > On 12 Nov 2015, at 02:42, Welly Tambunan <
ding the Lambda architecture there is a following book -
> https://www.manning.com/books/big-data (Big Data. Principles and best
> practices of scalable realtime data systems
> Nathan Marz and James Warren).
>
> Regards,
> Roman
>
> 2015-11-12 4:47 GMT+03:00 Welly Tambun
ently
> syncing it. This mirror for example has the update already:
> http://apache.mirror.digionline.de/flink/flink-0.10.0/
>
> On Fri, Nov 13, 2015 at 9:50 AM, Welly Tambunan <if05...@gmail.com> wrote:
>
>> Hi Aljoscha,
>>
>> Thanks for this one. Looking forward for 0
ll be available.
>
> Cheers,
> Max
>
> On Fri, Nov 13, 2015 at 11:08 AM, Welly Tambunan <if05...@gmail.com>
> wrote:
> > Hi All,
> >
> > I've just notice that the video has already available for this one.
> >
> > http://flink-forward.org/?post_
Hi Robert,
Is this version has already handle the stream perfection or out of order
event ?
Any resource on how this work and the API reference ?
Cheers
On Fri, Nov 13, 2015 at 4:00 PM, Welly Tambunan <if05...@gmail.com> wrote:
> Awesome !
>
> This is really the best we
other processes. This is
> reflected in flink-language-binding-generic module. I'm not aware how
> Spark or Storm communication protocols work but this protocol is
> rather low level.
>
> Cheers,
> Max
>
> On Fri, Nov 13, 2015 at 9:49 AM, Welly Tambunan <if05...@gmail.com> wrote:
>
> Greetings,
> Stephan
>
>
> On Tue, Nov 10, 2015 at 7:49 AM, Welly Tambunan <if05...@gmail.com> wrote:
>
>> Hi All,
>>
>> I read a couple of article about Kappa and Lambda Architecture.
>>
>>
>> http://www.confluent.io/blo
that he's using Spark for the streaming processor, do we have to do
the same thing with Apache Flink ?
Cheers
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com <http://www.triplelands.com/blog/>
roadcast.connect(dataStream). coFlatMap( ) Then you can keep
> the latest model in a CoFlatMapRichFunction, not necessarily as Operator
> State, although maybe OperatorState is a good choice too.
>
> Does it make sense to you ?
>
> Anwar
>
> On Fri, Nov 6, 2015 at 10:21 AM, Welly Tambun
t;>> decrease throughput from 25mio elements/core to 15-20mio elements per
>>> core). If your job does not reach that throughput, or is I/O bound, source
>>> bound, etc, it does not matter.
>>>
>>> If you care about super high performance, collapsing the code
the chaining as in the filter is doing very little
work. By minimizing the pipeline we can minimize db/external source hit and
cached local data efficiently.
Cheers
On Fri, Sep 4, 2015 at 2:58 PM, Welly Tambunan <if05...@gmail.com> wrote:
> Hi Stephan,
>
> Cheers
>
> On Fri, S
ou can use hdfs to checkpoint and
> process files in a distributed fashion. So can flink run standalone
> without hdfs?
>
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com <http://www.triplelands.com/blog/>
r high performance, collapsing the code into one
> function helps.
>
> On Thu, Sep 3, 2015 at 5:59 AM, Welly Tambunan <if05...@gmail.com> wrote:
>
>> Hi Gyula,
>>
>> Thanks for your response. Seems i will use filter and map for now as that
>> one is r
operator instance.
Cheers
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com <http://www.triplelands.com/blog/>
like you
described.
If the cached data is the same for all operators and is small enough you
can centralize the updates in a dedicated operator and push the updated
data to the operators every once in a while.
Cheers
Gyula
On Thu, Aug 20, 2015 at 4:31 PM Welly Tambunan if05...@gmail.com
from external event
? Is there some kind of best practice for maintaining model up to date on
streaming operator ?
Thanks a lot
Cheers
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com http://www.triplelands.com/blog/
, 2015 at 8:44 AM Welly Tambunan if05...@gmail.com wrote:
Hi All,
We have a streaming computation that required to validate the data stream
against the model provided by the user.
Right now what I have done is to load the model into flink operator and
then validate against it. However
On Wed, Aug 19, 2015 at 9:56 AM Welly Tambunan if05...@gmail.com wrote:
Thanks Gyula,
Another question i have..
... while external model updates would be *tricky *to keep consistent.
Is that still the case if the Operator treat the external model as
read-only ? We create another stream
archive at Nabble.com.
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com http://www.triplelands.com/blog/
-flink-user-mailing-list-archive.2336050.n4.nabble.com/Data-Source-from-Cassandra-tp1908.html
Sent from the Apache Flink User Mailing List archive. mailing list
archive at Nabble.com.
--
Welly Tambunan
Triplelands
http://weltam.wordpress.com
http://www.triplelands.com http://www.triplelands.com
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Batch-Processing-as-Streaming-tp1909.html
Sent from the Apache Flink User Mailing List archive. mailing list
archive at Nabble.com.
--
Welly Tambunan
Triplelands
http
50 matches
Mail list logo
