inari@piefed.zip to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.comEnglish · edit-21 month agoPirate Face - a Pirate Bay for LLMspirateface.coexternal-linkmessage-square61fedilinkarrow-up1221arrow-down122
arrow-up1199arrow-down1external-linkPirate Face - a Pirate Bay for LLMspirateface.coinari@piefed.zip to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.comEnglish · edit-21 month agomessage-square61fedilink
minus-squareCethin@lemmy.ziplinkfedilinkEnglisharrow-up5arrow-down1·28 days agoMost consumers are not purchasing a GPU to run an LLM. They may choose to run one if they own a GPU. This does next to nothing for their demand. I don’t mean a subscription to Hugging Face. I mean a subscription to an LLM service. They don’t want you owning. They want you renting.
minus-squarenilloc@discuss.tchncs.delinkfedilinkEnglisharrow-up2arrow-down1·28 days agoI could see nvidia de-porting the hugging face models and making them harder to run on anything but their chips.
Most consumers are not purchasing a GPU to run an LLM. They may choose to run one if they own a GPU. This does next to nothing for their demand.
I don’t mean a subscription to Hugging Face. I mean a subscription to an LLM service. They don’t want you owning. They want you renting.
I could see nvidia de-porting the hugging face models and making them harder to run on anything but their chips.