lostluck opened a new issue, #23278:
URL: https://github.com/apache/beam/issues/23278

   ### What happened?
   
   The contributed parquetio write function has a signature of: 
`parquetWriteFn) ProcessElement(ctx context.Context, _ int, iter 
func(*interface{}) bool)` which is incorrect, as "interface{}" isn't a 
supported PCollection type.
   
   
https://github.com/apache/beam/blob/10de67effd46d24fc4f2500012be743b3abc0f6c/sdks/go/pkg/beam/io/parquetio/parquetio.go#L150
   
   This should have been caught at pipeline construction time regardless of 
whether it was registered or not, regardless of the runner used.
   
   The resolution is two fold: Ensure that this kind of signature gets caught 
at pipeline construction and then also fixing the Parquetio write DoFn to not 
have this error.
   
   ### Issue Priority
   
   Priority: 2
   
   ### Issue Component
   
   Component: sdk-go


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to