snleee removed a comment on issue #3515: DATETIMECONVERT udf conversion to Simple_Date_Format are 50x slower than conversion to epoch time URL: https://github.com/apache/incubator-pinot/issues/3515#issuecomment-440394158 If the raw data is stored as SDF (string), then we cannot do any better. If the raw data is stored as epoch and time conversion is to SDF, we can use epoch to epoch conversion on the server side and compute SDF on the broker side for the final result (similar to what @Jackie-Jiang mentioned but time conversion happens in the broker instead of client). However, this will require Pinot to run different UDF on server/broker side from the same UDF definition and require . This feature is a good candidate for performance optimization. But for now, I would also recommend @Jackie-Jiang's approach for your query. @npawar Can you briefly look at the scope of this change
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
