sorry for the mistake... I meant to ask you about *exception* I get from*
'airflow scheduler'* command:
*Error details:*
[2016-06-30 19:00:10,130] {jobs.py:758} ERROR - [Errno 104] Connection
reset by peer
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/airflow/jobs.py", line 755, in
_execute
executor.heartbeat()
File
"/usr/lib/python2.7/site-packages/airflow/executors/base_executor.py", line
107, in heartbeat
self.sync()
File
"/usr/lib/python2.7/site-packages/airflow/executors/celery_executor.py",
line 74, in sync
state = async.state
File "/usr/lib/python2.7/site-packages/celery/result.py", line 394, in
state
return self._get_task_meta()['status']
File "/usr/lib/python2.7/site-packages/celery/result.py", line 339, in
_get_task_meta
return self._maybe_set_cache(self.backend.get_task_meta(self.id))
File "/usr/lib/python2.7/site-packages/celery/backends/amqp.py", line
163, in get_task_meta
binding.declare()
File "/usr/lib/python2.7/site-packages/kombu/entity.py", line 521, in
declare
self.exchange.declare(nowait)
File "/usr/lib/python2.7/site-packages/kombu/entity.py", line 174, in
declare
nowait=nowait, passive=passive,
File "/usr/lib/python2.7/site-packages/amqp/channel.py", line 615, in
exchange_declare
self._send_method((40, 10), args)
File "/usr/lib/python2.7/site-packages/amqp/abstract_channel.py", line
56, in _send_method
self.channel_id, method_sig, args, content,
File "/usr/lib/python2.7/site-packages/amqp/method_framing.py", line 221,
in write_method
write_frame(1, channel, payload)
File "/usr/lib/python2.7/site-packages/amqp/transport.py", line 182, in
write_frame
frame_type, channel, size, payload, 0xce,
File "/usr/lib64/python2.7/socket.py", line 224, in meth
return getattr(self._sock,name)(*args)
error: [Errno 104] Connection reset by peer
[2016-06-30 19:00:10,131] {jobs.py:759} ERROR - Tachycardia!
On Sun, Jul 3, 2016 at 11:50 AM, הילה ויזן <[email protected]> wrote:
> Hi,
> we are using airflow with Celery executor.
>
> Environment:
>
> · *OS*: Red Hat Enterprise Linux Server 7.2 (Maipo)
>
> · *Python*: 2.7.5
>
> · *Airflow*: 1.7.1.3
>
> 'airflow worker' command throws an exception when running it.
>
> Despite the exception, the workers run the tasks from the queues.
>
> Is it normal? should I open a bug in airflow Jira?
>
> The exception:
>
> [2016-07-03 11:22:40,253] {__init__.py:36} INFO - Using executor
> CeleryExecutor
>
> Starting flask
>
> Traceback (most recent call last):
>
> File "/usr/bin/airflow", line 15, in <module>
>
> args.func(args)
>
> File "/usr/lib/python2.7/site-packages/airflow/bin/cli.py", line 474, in
> serve_logs
>
> host='0.0.0.0', port=WORKER_LOG_SERVER_PORT)
>
> File "/usr/lib/python2.7/site-packages/flask/app.py", line 772, in run
>
> run_simple(host, port, self, **options)
>
> File "/usr/lib/python2.7/site-packages/werkzeug/serving.py", line 694,
> in run_simple
>
> inner()
>
> File "/usr/lib/python2.7/site-packages/werkzeug/serving.py", line 656,
> in inner
>
> fd=fd)
>
> File "/usr/lib/python2.7/site-packages/werkzeug/serving.py", line 550,
> in make_server
>
> passthrough_errors, ssl_context, fd=fd)
>
> File "/usr/lib/python2.7/site-packages/werkzeug/serving.py", line 464,
> in __init__
>
> HTTPServer.__init__(self, (host, int(port)), handler)
>
> File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__
>
> self.server_bind()
>
> File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in server_bind
>
> SocketServer.TCPServer.server_bind(self)
>
> File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind
>
> self.socket.bind(self.server_address)
>
> File "/usr/lib64/python2.7/socket.py", line 224, in meth
>
> return getattr(self._sock,name)(*args)
>
> socket.error: [Errno 98] Address already in use
>
> [2016-07-03 11:22:42,359: WARNING/MainProcess] [email protected]
> ready.
>
> Thanks
>
>
