I could run it on 7900 XT with 64k context. You could run it more comfortably on... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		sbmthakur 1 day ago \| parent \| context \| favorite \| on: Running local models is good now I could run it on 7900 XT with 64k context. You could run it more comfortably on a 24 gb vram.
		help

dackdel 17 hours ago [–]

thanks

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact