Ah wow. It was definitely arbitrary
We could make it configurable and arbitrarily larger by default :)
Please file a JIRA. Good catch as this makes the thread the other day make
a lot more sense.
thanks
On Tue, Jan 22, 2019 at 4:06 PM Boris Tyukin wrote:
> Hi guys,
>
> does anyone know
Hi all,
In our application, we faced the same problem. To solve it, we wrote a
Django app that sat at the center of the interaction between NiFi and
several other systems (including Spark and another internal application)
and used it to dispatch tasks as needed. In that architecture, NiFi was not
Hi guys,
does anyone know why 100 topics maximum hardcoded in ConsumeKafka
processor? is there a reason for that?
https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-kafka-bundle/nifi-kafka-0-9-processors/src/main/java/org/apache/nifi/processors/kafka/pubsub/ConsumeKafka.java
for
How would nifi look or have to look to support batch cases I wonder
On January 22, 2019 at 10:24:10, Boris Tyukin (bo...@boristyukin.com) wrote:
We've looked at both...Airflow might be a way better tool for
coordination/scheduling. Why do not you take one of your pipelines and try
to implement
We've looked at both...Airflow might be a way better tool for
coordination/scheduling. Why do not you take one of your pipelines and try
to implement it in both tools?
We really liked Airflow but unfortunately, Airflow was not a good fit for
real-time processes - that's why we decided to go with
update the destination in a remote process group
On Tue, Jan 22, 2019 at 9:58 AM Bryan Bende wrote:
> Just to clarify, when you say "update the destination in a remote
> process group", do you mean changing the URLs field of the RPG, or do
> you mean making a new connection from an RPG to a
Just to clarify, when you say "update the destination in a remote
process group", do you mean changing the URLs field of the RPG, or do
you mean making a new connection from an RPG to a processor?
On Fri, Jan 18, 2019 at 4:55 PM mohammed shambakey wrote:
>
> Hi Bryan
>
> I mean 'refresh nifi'
