Bookmarked and will come back to this. One thing that may be if interest to add is for AMD cards with 20gb of ram. I’d suppose that it would be Qwen 2.5 34B with maybe less strict quant or something.

Also, it may be interesting to look at the AllenAI molmo related models. I’m kind of planning to do this myself but haven’t had time as yet.

Maybe also egg corn?

https://m.youtube.com/watch?v=F12LSAbos7A&t=467s&pp=ygULTWFsYXByb3Bpc20%3D