This example is now at https://github.com/xloem/gitrepository.git .
It presently runs the facebook/opt-iml-max-30b model locally using langchain and uses 60GB of vram. It doesn't know how to write code: Human: write a hello world program in python AI: Hello world! Human: like def hello_world(): AI: Hello world! It would make sense to upgrade it to a fancier langchain example. Maybe to make it an agent or something.
