Hi,
You are creating a logger instance on driver and then trying to use that
instance in a transformation function which is executed on the executor.
You should create logger instance in the transformation function itself but
then the logs will go to separate files on each worker node.
Hope this
I have a streaming Spark process and I need to do some logging in the
`foreachRDD` function, but I'm having trouble accessing the logger as a
variable in the `foreachRDD` function
I would like to do the following
import logging
myLogger = logging.getLogger(LOGGER_NAME)
...
...
