>Other python dependencies required by user python code as now needs to be >installed on Hadoop node.
So you are assuming Python itself is installed on each Hadoop node and other Python packages needed by user's Python code are also installed? Can your py4j package be installed thru "pip" - Python's native package manager? If that's possible why does it need to be added to the Apex repo? The user will anyway need to ensure all Python dependencies are satisfied and your py4j package is just one of them. We can just document the dependency, can't we? On Fri, Jul 7, 2017 at 8:46 AM, vikram patil <patilvik...@gmail.com> wrote: > Thanks Vlad, Thomas . > > Py4j acts as a bridge between Java and Python . So py4j package is needed > ( like jar ) for code to work properly. > If it is installed on Hadoop node then it won't be needed but since this > code is used as part of basic framework to establish bridge between java > and python framework, it needs to be transported at application launch. > > Other python dependencies required by user python code as now needs to be > installed on Hadoop node. > > Thanks & Regards, > Vikram > > > >
