-02-19/
large-file-3.txt
Or is there another way to accomplish this?
Thanks!
Austin
On Tue, Feb 18, 2020 at 5:33 PM Austin Cawley-Edwards <
austin.caw...@gmail.com> wrote:
> Hey all,
>
> Has anyone had success using the StreamingFileSink[1] to write CSV files?
> And
Hey all,
Has anyone had success using the StreamingFileSink[1] to write CSV files?
And if so, what about compressed (Gzipped, ideally) files/ which libraries
did you use?
Best,
Austin
[1]:
https://ci.apache.org/projects/flink/flink-docs-stable/dev/connectors/streamfile_sink.html
Cawley-Edwards <
austin.caw...@gmail.com> wrote:
> Hey Anaray,
>
> Have you checked out the “scope” configuration?[1]
>
> Best,
> Austin
>
>
> [1]:
>
> https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/metrics.html#scope
>
> On Wed, J
Hey Anaray,
Have you checked out the “scope” configuration?[1]
Best,
Austin
[1]:
https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/metrics.html#scope
On Wed, Jan 22, 2020 at 4:09 PM anaray wrote:
> Hi flink team,
>
> Is there a way to add a custom label to flink metrics when
to GATE, but
trying to explore the options out there for good text processing within
Flink.
Best,
Austin Cawley-Edwards
[1]: https://gate.ac.uk
[2]:
https://groups.io/g/gate-users/topic/usage_with_data_processing/68761558?p=,,,20,0,0,0::recentpostdate%2Fsticky,,,20,2,0,68761558
Hi there,
I'm getting the following error message on a Flink 1.8 cluster deployed on
Kubernetes. I've already confirmed that the pod has access to S3 and write
permissions to the bucket, but I can't understand what the SSL issue is and
if it is related to S3 or not. I have tried both with the
Have you reached out to the FlinkK8sOperator team on Slack? They’re usually
pretty active on there.
Here’s the link:
https://join.slack.com/t/flinkk8soperator/shared_invite/enQtNzIxMjc5NDYxODkxLTEwMThmN2I0M2QwYjM3ZDljYTFhMGRiNDUzM2FjZGYzNTRjYWNmYTE1NzNlNWM2YWM5NzNiNGFhMTkxZjA4OGU
Best,
Austin
t; [1]
> https://ci.apache.org/projects/flink/flink-docs-release-1.6/monitoring/debugging_classloading.html#overview-of-classloading-in-flink
>
>
> On Wed, Feb 27, 2019 at 8:57 PM Austin Cawley-Edwards <
> austin.caw...@gmail.com> wrote:
>
>> Thanks Gary
://ci.apache.org/projects/flink/flink-docs-release-1.6/monitoring/debugging_classloading.html#inverted-class-loading-and-classloader-resolution-order
> [2]
> https://ci.apache.org/projects/flink/flink-docs-release-1.6/ops/deployment/hadoop.html#configuring-flink-with-hadoop-classpaths
>
>
${main.class}
Thanks again and let me know if there is more information I can provide.
Austin
On Tue, Feb 26, 2019 at 10:59 PM Austin Cawley-Edwards <
austin.caw...@gmail.com> wrote:
> Hi,
>
e$1.class
okio/RealBufferedSource.class
okio/Segment.class
okio/SegmentPool.class
okio/SegmentedByteString.class
okio/Sink.class
okio/Source.class
okio/Timeout$1.class
okio/Timeout.class
okio/Util.class
Thank you,
Austin Cawley-Edwards
d here
<https://mail-archives.apache.org/mod_mbox/flink-user/201811.mbox/%3cc7e61cb0-8799-403a-861b-88d2f3eb2...@bytedance.com%3E>,
and though it lasted longer, the checkpoint still failed.
Thanks,
Austin
On Tue, Dec 4, 2018 at 12:24 PM Austin Cawley-Edwards <
austin.caw...@gmail
, 2018 at 11:24 AM Austin Cawley-Edwards <
austin.caw...@gmail.com> wrote:
> Hi all,
>
> We have a Flink 1.6 streaming application running on Amazon EMR, with a
> YARN session configured with 20GB for the Task Manager, 2GB for the Job
> Manager, and 4 slots (number of vCPUs), i
application on EMR with YARN?
Thank you,
Austin Cawley-Edwards
regarding CEP you've linked concern very old Flink
> version (1.0.3), CEP library was heavily reworked since then and I would
> not look for any similarities in those cases.
>
> Best,
>
> Dawid
> On 01/11/2018 14:24, Austin Cawley-Edwards wrote:
>
> Hi Dawid,
>
&g
ot;after a checkpoint
> fails", what is the reason why checkpoint fails? Would it be possible for
> you to prepare some reproducible example for that problem? Finally, I would
> also recommend trying out Flink 1.6.x, as we reworked the underlying
> structure for CEP - SharedBuff
Following up, we are using Flink 1.5.0 and Flink-CEP 2.11.
Thanks,
Austin
On Tue, Oct 30, 2018 at 3:58 PM Austin Cawley-Edwards <
austin.caw...@gmail.com> wrote:
> Hi there,
>
>
> We have a streaming application that uses CEP processing but are getting this
> error fa
Hi there,
We have a streaming application that uses CEP processing but are
getting this error fairly frequently after a checkpoint fails, though
not sure if it is related. We have implemented both `hashCode` and
`equals()` using `Objects.hash(...properties)` and basic equality,
respectively.
> [2]
> https://ci.apache.org/projects/flink/flink-docs-master/dev/table/udfs.html#aggregation-functions
>
> On Fri, Oct 26, 2018 at 5:08 AM Austin Cawley-Edwards <
> austin.caw...@gmail.com> wrote:
>
>> Hi there,
>>
>> Is it possible to use an Aggregatio
Hi there,
Is it possible to use an AggregationFunction to accumulate n values in a
buffer until a threshold is met, then stream down all records in the batch?
Thank you!
Austin Cawley-Edwards
these two jobs will be subject
> to certain restrictions. For more information, please refer to Official
> documentation.[1]
>
> Thanks, vino.
>
> [1]:
> https://ci.apache.org/projects/flink/flink-docs-release-1.6/ops/upgrading.html#application-state-compatibility
>
> Aus
Hi there,
I would just like a quick sanity-check: it is possible to start a job with
a savepoint from another job, and have the new job save to a new checkpoint
directory without overwriting the original checkpoints, correct?
Thank you so much!
Austin
>
> [4]
> https://hadoop.apache.org/docs/r2.8.3/api/org/apache/hadoop/yarn/api/records/ApplicationReport.html#getRpcPort()
>
> On Fri, Sep 7, 2018 at 12:33 AM, Austin Cawley-Edwards <
> austin.caw...@gmail.com> wrote:
>
>> Hi everyone,
>>
>> I'm
Hi everyone,
I'm running a YARN session on a cluster with one master and one core and
would like to use the Monitoring API programmatically to submit jobs. I
have found that the configuration variables are read but ignored when
starting the session - it seems to choose a random port each run.
101 - 124 of 124 matches
Mail list logo