What exactly is the error you are getting when using the non-static field?
On Mon, Jun 8, 2015 at 2:41 PM, hagersaleh wrote:
> when use non-static filed display error
> and filter function not show map
>
>
>
>
> --
> View this message in context:
> http://apache-flink-user-mailing-list-archive.2
Hi Hilmi,
I see two possible reasons:
1) The data source / InputFormat is not properly working, so not all HBase
records are read/forwarded, or
2) The aggregation / count is buggy
Roberts suggestion will use an alternative mechanism to do the count. In
fact, you can count with groupBy(0).sum() a
Hi Aljoscha
I want to know what is the apache flink performance if I run the same SQL
as below.
Do you have any apache flink benchmark information?
Such as: https://amplab.cs.berkeley.edu/benchmark/
Thanks.
SELECT pageURL, pageRank FROM rankings WHERE pageRank > X
Query 1A
32,888 resultsQuery
Hi Hilmi,
if you just want to count the number of elements, you can also use
accumulators, as described here [1].
They are much more lightweight.
So you need to make your flatMap function a RichFlatMapFunction, then call
getExecutionContext().
Use a long accumulator to count the elements.
If the
hdfs://ServerURI:8020/user/cloudera/inputs should do the trick
On Mon, Jun 8, 2015 at 12:41 PM Pa Rö
wrote:
> it's works, now i have set the permissiions to the yarn user,
> but my flink app not find the path. i try following path and get the same
> exception:
> file:///127.0.0.1:8020/user/clo
Hi Stephan,
Many thank for your reply!
1) This would be a nice feature. I have already done something similar, if
you told me which informations you would like to export in the runtime
context, I could add them to my code, update unit tests and share them.
2) Yes, I have figured that out. Howeve
please help
why when run program from netbeans not display error
but when run command line display error
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/when-return-value-from-linkedlist-or-map-and-use-in-filter-function-display-error-tp152
Sorry. After a git update I found it.
Thanks.
$ mvn clean package -DskipTests -Dhadoop.version=2.6.0
…
[INFO] BUILD SUCCESS
[INFO]
[INFO] Total time: 07:19 min
[INFO] Finished at: 2015-06-08T08:21:45-05:00
[INFO] Final Memor
Hi,
I implemented a simple Flink Batch job which reads from an HBase Cluster
of 13 machines and with nearly 100 million rows. The hbase version is
1.0.0-cdh5.4.1. So, I imported hbase-client 1.0.0-cdh5.4.1.
I implemented a flatmap which creates a tuple ("a", 1L) for each row .
Then, I use group
Hi,
I implemented a simple Flink Batch job which reads from an HBase Cluster
of 13 machines and with nearly 100 million rows. The hbase version is
1.0.0-cdh5.4.1. So, I imported hbase-client 1.0.0-cdh5.4.1.
I implemented a flatmap which creates a tuple ("a", 1L) for each row .
Then, I use group
when use non-static filed display error
and filter function not show map
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/when-return-value-from-linkedlist-or-map-and-use-in-filter-function-display-error-tp1528p1544.html
Sent from the Apache
it's works, now i have set the permissiions to the yarn user,
but my flink app not find the path. i try following path and get the same
exception:
file:///127.0.0.1:8020/user/cloudera/inputs/
how i must set the path to hdfs??
2015-06-08 11:38 GMT+02:00 Till Rohrmann :
> I assume that the path i
very thanks
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/I-want-run-flink-program-in-ubuntu-x64-Mult-Node-Cluster-what-is-configuration-tp1444p1542.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at
Nabble
I assume that the path inputs and outputs is not correct since you get the
error message *chown `output’: No such file or directory*. Try to provide
the full path to the chown command such as
hdfs://ServerURI/path/to/your/directory.
On Mon, Jun 8, 2015 at 11:23 AM Pa Rö
wrote:
> Hi Robert,
>
>
Thank you for your kind wishes :) Good luck from me as well!
I was just wondering, is it possible to stream the talks or watch them
later on?
On Mon, Jun 8, 2015 at 2:54 AM, Hawin Jiang wrote:
> Hi All
>
>
>
> As you know that Kostas Tzoumas and Robert Metzger will give us two Flink
> talks on
Are you sure, that the TaskManager registered to the JobManager
correctly? You can check on the master machine in your browser:
> localhost:8081
Additionally, you might need to increase the number of slots for the
TaskManager. Increase 'taskmanager.numberOfTaskSlots' within
conf/flink-conf.yaml.
Hi Robert,
i have see that you write me on stackoverflow, thanks. now the path is
right and i get the old exception:
org.apache.flink.runtime.JobException: Creating the input splits caused an
error: File file:/127.0.0.1:8020/home/user/cloudera/outputs/seed-1 does not
exist or the user running Flin
I change IP to good IP
but when run program
Error: The program execution failed:
org.apache.flink.runtime.jobmanager.scheduler.NoResourceAvailableException:
Not enough free slots available to run the job. You can decrease the
operator parallelism or increase the number of slots per TaskManager in t
Hi,
actually, what do you want to know about Flink SQL?
Aljoscha
On Sat, Jun 6, 2015 at 2:22 AM, Hawin Jiang wrote:
> Thanks all
>
> Actually, I want to know more info about Flink SQL and Flink performance
> Here is the Spark benchmark. Maybe you already saw it before.
> https://amplab.cs.berkel
Can you please share the whole console output. It is unclear what the
problem might be from this short message.
On 06/08/2015 10:24 AM, hagersaleh wrote:
> when run progam
>
> display
> error:null
>
>
>
> --
> View this message in context:
> http://apache-flink-user-mailing-list-archive.2336
when run progam
display
error:null
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/I-want-run-flink-program-in-ubuntu-x64-Mult-Node-Cluster-what-is-configuration-tp1444p1534.html
Sent from the Apache Flink User Mailing List archive. mailing
Hi,
in order to use bin/start-cluster.sh you need to configure conf/slaves
on your master machine. (conf/slave is ignored on slave machines).
Hope this helps. If not, please post the error message you get. It's
hard to figure out what wrong without the stacktrace.
-Matthias
On 06/08/2015 09:43
1- I copy flink in the same path all machines
2- in master machine write 10.0.0.1 in conf/flink-conf.yaml
3- in slave machine write 10.0.0.1 in conf/flink-conf.yaml and 10.0.0.2 in
conf/slaves
then in master machine open command line write this
bin/start-cluster.sh
display
Starting job manager
St
23 matches
Mail list logo
