Re: File control tuples

2017-06-04 Thread Bhupesh Chawda
e like a file input operator > > ​in malhar ​ > > seems > > ​like > > a > > ​good > > feature to provide. It is useful information for any downstream operator > to > > ​know > > that a data tuple belongs to a certain file > > ​ for insta

Re: File control tuples

2017-06-03 Thread Thomas Weise
sed source like a file input operator > > ​in malhar ​ > > seems > > ​like > > a > > ​good > > feature to provide. It is useful information for any downstream operator > to > > ​know > > that a data tuple belongs to a certain file > > ​ for i

Re: File control tuples

2017-06-03 Thread Bhupesh Chawda
> a > ​good > feature to provide. It is useful information for any downstream operator to > ​know > that a data tuple belongs to a certain file > ​ for instance​ > . > > > We propose to add capability in the abstract file input operator to emit > file control tuples.

Re: File control tuples

2017-06-03 Thread Sanjay Pujare
t; feature to provide. It is useful information for any downstream operator to > ​know > that a data tuple belongs to a certain file > ​ for instance​ > . > > > We propose to add capability in the abstract file input operator to emit > file control tuples. These control tupl

Re: File control tuples

2017-06-03 Thread Thomas Weise
file based source like a file input operator ​in malhar ​ seems ​like a ​good feature to provide. It is useful information for any downstream operator to ​know that a data tuple belongs to a certain file ​ for instance​ . We propose to add capability in the abstract file input operator to emit fi

Re: File control tuples

2017-06-02 Thread Pramod Immaneni
downstream operator to > ​know > that a data tuple belongs to a certain file > ​ for instance​ > . > > > We propose to add capability in the abstract file input operator to emit > file control tuples. These control tuples can include filenames as well as > any metadata tha

File control tuples

2017-06-02 Thread Bhupesh Chawda
the abstract file input operator to emit file control tuples. These control tuples can include filenames as well as any metadata that the user wishes to include along with it. ​To link this meta data to each tuple, we can add another port to the input operator which would carry the meta data along