i seem to be a little interested now in discerning if transformer xl will run on my local system
there's a doc page at https://huggingface.co/docs/transformers/model_doc/transfo-xl . it starts off with this example: from transformers import TransfoXLConfig, TransfoXLModel # Initializing a Transformer XL configuration configuration = TransfoXLConfig() # Initializing a model from the configuration model = TransfoXLModel(configuration) # Accessing the model configuration configuration = model.config finding a pretrained transformer xl model would be very helpful for using adapter transformers with them.
