Thanks Sathi, Would you able to guide me, if you are relating the /tmp under local unix system or hdfs.
If this hdfs then also how can I write content inside a file thru shell script. At the end of the day I need to generates like this. HDFS file system: Log/xyz.txt xyz.txt ---- date1 | details of file1 date1 | details of file2 How I can achieve this. On Tue, Oct 28, 2014 at 11:35 PM, Sathi Chowdhury < [email protected]> wrote: > Hi Bhagban, > your shell action is running as yarn user in a yarn node, > And that does not have ../Log folder in it possibly.Or yarn user has no > permission on it. > You can try the same thing ,writing log file under /tmp and see. > Thanks > Sathi > > On 10/28/14, 6:30 AM, "Bhagaban Khatai" <[email protected]> wrote: > > >Hi, > > > >I was running a shell script on a node in my Hadoop cluster to copy the > >files from local to HDFS. The script was running fine and generating the > >logs of echo statements to a specified log file in the local file system. > > > >That script needs to be added to a Oozie workflow where certain other > >actions need to be done after this shell script completes. > > > >I am facing the issue of writing to the log file. For example, my log > >statement is like: > > > >echo $ConfigRead >> ../Log/today.log > > > >The script break there. Even though I created the today.log file into > >HDFS, > >still it did not work. > >I can think of removing the output redirected to the file and simply let > >the echo output printed in stdout, however the business requirement is to > >have certain log statements appended to a log file. > > > >So could you please advise how can I achieve it? Thanks a lot in advance. > > > >Thanks > >Bhagaban > >
