Re: [ot][spam][crazy] coping spam while trying to make code to prompt a model

[Undescribed Horrific Abuse, One Victim & Survivor of Many]

ok ummmmmmmmmmmm
i have about 2G gpu ram.
so i'll want a model that fits in a little under that.
if i use 16 bit floats, that means ummm 2b / 2 = <1b params
if i use 32 bit floats, that means ummm 2b / 4 = <500m params

maybe i'll see if bloomz-560m loads to start with