Hi Reza, Where will this metadata be coming from? Beam SQL is tightly coupled with the schema of the PCollection, so adding fields not in the data would be difficult.
If what you want is the timestamp out of the DoFn.ProcessContext we might be able to add a SQL function to fetch that. Andrew *From: *Reza Rokni <r...@google.com> *Date: *Tue, May 14, 2019, 1:08 AM *To: * <dev@beam.apache.org> Hi, > > What are folks thoughts about adding something like > SqlTransform.withMetadata().query(...)to enable users to be able to > access things like Timestamp information from within the query without > having to refiy the information into the element itself? > > Cheers > Reza > > > > -- > > This email may be confidential and privileged. If you received this > communication by mistake, please don't forward it to anyone else, please > erase all copies and attachments, and please let me know that it has gone > to the wrong person. > > The above terms reflect a potential business arrangement, are provided > solely as a basis for further discussion, and are not intended to be and do > not constitute a legally binding obligation. No legally binding obligations > will be created, implied, or inferred until an agreement in final form is > executed in writing by all parties involved. >
