MaximilianSchreff opened a new pull request, #2184:
URL: https://github.com/apache/systemds/pull/2184
This PR introduces the full BERT layer from the BERT transformer
architecture to SystemDS as a built-in operation.
This PR is part of a series of PRs to support the BERT architecture in
SystemDS. The BERT layer is the component in the BERT architecture. Backward
pass will follow, as well as rest of components.
Includes
- Forward pass
### Testing:
Added a comprehensive test cases comparing the forward pass results against
HuggingFace Transformer Library's implementation for correctness.
- The tests validate:
- Forward pass against HuggingFace Transformer Library's
`transformers.models.bert.modeling_bert.BertLayer`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@systemds.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
