If you want persistent storage like that, you're best bet is to use a database like HBase On Jul 18, 2013 7:56 AM, "Bhavesh Shah" <[email protected]> wrote:
> Thanks for reply. :) > > I just came across one command -getmerge > > > > -getmerge <src> <localdst>: Get all the files in the directories that > match the source file pattern and merge and sort them to only > one file on local fs. <src> is kept. > > > > I am thinking if I STORE the data in some other file say TMP_Name > > and later If I use this command to dump the data in the required file. > > > > Is it possible to merge the data using this command in PIG? If yes, then > is it good way to achieve my goal? > > Please let me know. > > > > > > Many Thanks, > > Bhavesh Shah > > > > > > > > Date: Thu, 18 Jul 2013 15:49:47 +0400 > > Subject: Re: Want to add data in same file in Apache PIG? > > From: [email protected] > > To: [email protected] > > CC: [email protected] > > > > it's not possible. It's HDFS. > > > > > > 2013/7/18 Bhavesh Shah <[email protected]> > > > > > Hello, > > > > > > Actually I have a use case in which I will receive the data from some > > > source and I have to dump it in the same file after every regular > interval > > > and use that file for further operation. I tried to search on it, but I > > > didn't see the anything related to this. > > > > > > I am using STORE function, but STORE function always create new file > with > > > specified name and gives error if the specified file already exists. > > > How should I do store the data in same file? Is it possible in Pig or > have > > > some work around for it? > > > Please suggest me some solution over this. > > > > > > > > > Thanks, > > > Bhavesh Shah >
