The news: Meta and Qualcomm have joined forces to bring Llama 2, Meta's advanced language model, to mobile devices and PCs powered by Qualcomm Snapdragon chips. Details: Qualcomm plans to introduce support for Llama 2-based AI services, powering applications like virtual assistants, on Snapdragon devices in 2024. This will allow Llama 2, packaged as a smaller program, to operate directly on the devices themselves, eliminating the need for cloud-based processing. Why it matters: Running large language models on phones instead of data centers can significantly lower the cost of AI operations. Other benefits of on-device AI models include faster and more personalized experiences, along with enhanced security and privacy, according to Qualcomm. What the numbers say: KBV Research predicts the global edge AI processor market will reach $5.5B by 2028, growing at a CAGR of 15.3%.
|
