☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to US News@lemmygrad.mlEnglish · 2 months agoSo OpenAI strategy was to become too big to fail and live off government bailouts. Nothing says free market like a public safety net for private billion-dollar bets. A beautiful capitalist fairy tale.www.barrons.comexternal-linkmessage-square13linkfedilinkarrow-up150arrow-down10cross-posted to: usa@lemmy.ml
arrow-up150arrow-down1external-linkSo OpenAI strategy was to become too big to fail and live off government bailouts. Nothing says free market like a public safety net for private billion-dollar bets. A beautiful capitalist fairy tale.www.barrons.com☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to US News@lemmygrad.mlEnglish · 2 months agomessage-square13linkfedilinkcross-posted to: usa@lemmy.ml
minus-squarePeeOnYou [he/him]@lemmygrad.mllinkfedilinkarrow-up2·2 months agothere is no way you’re running the full deepseek model on a $2000 gpu much less computer
minus-squareCriticalResist8@lemmygrad.mllinkfedilinkarrow-up6·2 months agohttps://digitalspaceport.com/how-to-run-deepseek-r1-671b-fully-locally-on-2000-epyc-rig/ it’s even better, this rig doesn’t even have a GPU.
minus-squarePeeOnYou [he/him]@lemmygrad.mllinkfedilinkarrow-up1·1 month agothat is mind blowing! without a gpu at all and getting even 3 t/s? just… wow
minus-squareCriticalResist8@lemmygrad.mllinkfedilinkarrow-up2·1 month agoAnd it’s only going to get faster… (Note that this is the Q4 model, but otherwise still the full 671b params and thinking mode enabled)
minus-squarePeeOnYou [he/him]@lemmygrad.mllinkfedilinkarrow-up2·1 month agooh i missed that… yeah Q4 makes way more sense
there is no way you’re running the full deepseek model on a $2000 gpu much less computer
https://digitalspaceport.com/how-to-run-deepseek-r1-671b-fully-locally-on-2000-epyc-rig/ it’s even better, this rig doesn’t even have a GPU.
that is mind blowing! without a gpu at all and getting even 3 t/s? just… wow
And it’s only going to get faster…
(Note that this is the Q4 model, but otherwise still the full 671b params and thinking mode enabled)
oh i missed that… yeah Q4 makes way more sense