I've tried piping the argument from a file, but that still gives the same error.
-----Original Message----- From: Stack [mailto:[email protected]] Sent: Monday, October 21, 2019 8:55 AM To: Hbase-User <[email protected]> Subject: Re: Import TSV - too many args/columns CAUTION: This email originated from outside the Allen Institute. Please do not click links or open attachments unless you've validated the sender and know the content is safe. ________________________________ On Thu, Oct 17, 2019 at 10:57 AM Gautham Acharya < [email protected]> wrote: > The error is simply: > -bash: too many arguments > > You've took a look around to see how others have solved this issue? There is no magic here. It is the simple bin/hbase bash script passing the cmd line to the ImportTsv MR java application. Thanks, S > -----Original Message----- > From: Stack [mailto:[email protected]] > Sent: Thursday, October 17, 2019 10:43 AM > To: Hbase-User <[email protected]> > Subject: Re: Import TSV - too many args/columns > > CAUTION: This email originated from outside the Allen Institute. > Please do not click links or open attachments unless you've validated > the sender and know the content is safe. > ________________________________ > > What is the error? I think I know what it is but dump it in here please. > > You can't run your own importtsv instead of theirs? > > S > > On Wed, Oct 16, 2019 at 11:51 AM Gautham Acharya < > [email protected]> wrote: > > > Searched, didn't find any results. > > > > Hacking ImportTSV isn't really an option, as we're using a managed > > Hbase instance on AWS EMR. > > > > -----Original Message----- > > From: Stack [mailto:[email protected]] > > Sent: Wednesday, October 16, 2019 11:25 AM > > To: Hbase-User <[email protected]> > > Subject: Re: Import TSV - too many args/columns > > > > CAUTION: This email originated from outside the Allen Institute. > > Please do not click links or open attachments unless you've > > validated the sender and know the content is safe. > > ________________________________ > > > > You've tried search net for how others deal with arg list too long? > > You might have to hack on the importtsv script? > > S > > > > On Tue, Oct 15, 2019 at 2:41 PM Gautham Acharya < > > [email protected]> > > wrote: > > > > > I'm trying to use the ImportTSV utility to generate HFiles and > > > move them into an instance using the CompleteBulkLoad tool. > > > > > > > > > > > > Right now an error I'm running into is that the arg list is too > > > long > > > - I have over 50,000 columns to specify in my CS, and the bash > > > shell throws an error. Is there an easy way around this? Piping > > > the arguments does not seem to work either. > > > > > > > > > > > > --gautham > > > > > >
