fubarx@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoSam Altman says OpenAI will not go public this year as AI fears growwww.sfchronicle.comexternal-linkmessage-square81linkfedilinkarrow-up1314arrow-down110file-text
arrow-up1304arrow-down1external-linkSam Altman says OpenAI will not go public this year as AI fears growwww.sfchronicle.comfubarx@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square81linkfedilinkfile-text
minus-squaresetVeryLoud(true);@lemmy.calinkfedilinkEnglisharrow-up2·12 hours ago24 is ideal, 16 works fine especially with some MoE offloading. If you use llama-swap, a fast PCIe bus and fast storage is ideal. Takes about 20 seconds to swap between two models on my X570 board.
24 is ideal, 16 works fine especially with some MoE offloading. If you use llama-swap, a fast PCIe bus and fast storage is ideal. Takes about 20 seconds to swap between two models on my X570 board.