A = load 'input' as (x, y);
B = filter A by SUBSTRING(x, 0, 1) != '#';
...
On Jun 7, 2011, at 12:04 PM, Moore, Michael A. wrote:
Hello all-
I've got a quick question and Google isn't proving to be much help.
I've got a big file, that has a few lines in it prefaced with a
pound sign (#) to indicate they are to be ignored. I would like to
LOAD this file using PigStorage. Is there a way to do this, or is
it handled automatically?
The data might look something like this:
# Data Source: Project A
# Contact MMoore with Questions
# SenderId RecipientId
1 2
3 5
6 7
#2 1
3 6
11 7
Thanks!
-Michael
______________________________________
Michael Moore :: [email protected]
The Johns Hopkins University Applied Physics Laboratory
0B7B17EE1AE2A80B pgp
BC31 A861 9726 8211 F79F 7E21 0B7B 17EE 1AE2 A80B pgp fingerprint
