AndrewZhaoLuo commented on code in PR #10949:
URL: https://github.com/apache/tvm/pull/10949#discussion_r846525486
##########
python/tvm/relay/frontend/onnx.py:
##########
@@ -836,6 +837,192 @@ def _impl_v1(cls, inputs, attr, params):
return Gelu._impl_v1([inp], attr, params)
+class EmbedLayerNormalization(OnnxOpConverter):
+ @classmethod
+ def _impl_v1(cls, inputs, attr, params):
+ input_ids = inputs[0]
+ segment_ids = inputs[1]
+ word_emb = inputs[2]
+ pos_emb = inputs[3]
+ segment_emb = inputs[4]
+ gamma = inputs[5]
+ beta = inputs[6]
+
+ mask = inputs[7]
+ pos_ids = inputs[8]
+
+ eps = attr["epsilon"] if "epsilon" in attr else 1e-12
Review Comment:
https://github.com/microsoft/onnxruntime/commit/6e341c002f6760baa5b08c6970d9cd994730a835#diff-534f8d4a645c4fa2e80983b37196e601f7a69424e93bbcb4008a75d18427b8d6R30
Appears to be 1e-12
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
