Meta and Qualcomm team up to run big A.I. models on phones

Raw Text

Skip Navigation

watch live

Markets

Pre-Markets

U.S. Markets

Currencies

Cryptocurrency

Futures & Commodities

Bonds

Funds & ETFs

Business

Economy

Finance

Health & Science

Media

Real Estate

Energy

Climate

Transportation

Industrials

Retail

Wealth

Life

Small Business

Investing

Personal Finance

Fintech

Financial Advisors

Options Action

ETF Street

Buffett Archive

Earnings

Trader Talk

Tech

Cybersecurity

Enterprise

Internet

Media

Mobile

Social Media

CNBC Disruptor 50

Tech Guide

Politics

White House

Policy

Defense

Congress

Equity and Opportunity

CNBC TV

Live TV

Live Audio

Business Day Shows

Entertainment Shows

Full Episodes

Latest Video

Top Video

CEO Interviews

CNBC Documentaries

CNBC Podcasts

CNBC World

Digital Originals

Live TV Schedule

Watchlist

Investing Club

Trust Portfolio

Analysis

Trade Alerts

Meeting Videos

Homestretch

Jim's Columns

Education

PRO

Pro News

Pro Live

Market Forecast

Subscribe

Sign In

Menu

Make It

select ALL SELECT Credit Cards Loans Banking Mortgages Insurance Credit Monitoring Personal Finance Small Business Taxes Help for Low Credit Scores Investing SELECT All Credit Cards Find the Credit Card for You Best Credit Cards Best Rewards Credit Cards Best Travel Credit Cards Best 0% APR Credit Cards Best Balance Transfer Credit Cards Best Cash Back Credit Cards Best Credit Card Welcome Bonuses Best Credit Cards to Build Credit SELECT All Loans Find the Best Personal Loan for You Best Personal Loans Best Debt Consolidation Loans Best Loans to Refinance Credit Card Debt Best Loans with Fast Funding Best Small Personal Loans Best Large Personal Loans Best Personal Loans to Apply Online Best Student Loan Refinance SELECT All Banking Find the Savings Account for You Best High Yield Savings Accounts Best Big Bank Savings Accounts Best Big Bank Checking Accounts Best No Fee Checking Accounts No Overdraft Fee Checking Accounts Best Checking Account Bonuses Best Money Market Accounts Best CDs Best Credit Unions SELECT All Mortgages Best Mortgages Best Mortgages for Small Down Payment Best Mortgages for No Down Payment Best Mortgages with No Origination Fee Best Mortgages for Average Credit Score Adjustable Rate Mortgages Affording a Mortgage SELECT All Insurance Best Life Insurance Best Homeowners Insurance Best Renters Insurance Best Car Insurance Travel Insurance SELECT All Credit Monitoring Best Credit Monitoring Services Best Identity Theft Protection How to Boost Your Credit Score Credit Repair Services SELECT All Personal Finance Best Budgeting Apps Best Expense Tracker Apps Best Money Transfer Apps Best Resale Apps and Sites Buy Now Pay Later (BNPL) Apps Best Debt Relief SELECT All Small Business Best Small Business Savings Accounts Best Small Business Checking Accounts Best Credit Cards for Small Business Best Small Business Loans Best Tax Software for Small Business SELECT All Taxes Best Tax Software Best Tax Software for Small Businesses Tax Refunds SELECT All Help for Low Credit Scores Best Credit Cards for Bad Credit Best Personal Loans for Bad Credit Best Debt Consolidation Loans for Bad Credit Personal Loans if You Don't Have Credit Best Credit Cards for Building Credit Personal Loans for 580 Credit Score or Lower Personal Loans for 670 Credit Score or Lower Best Mortgages for Bad Credit Best Hardship Loans How to Boost Your Credit Score SELECT All Investing Best IRA Accounts Best Roth IRA Accounts Best Investing Apps Best Free Stock Trading Platforms Best Robo-Advisors Index Funds Mutual Funds ETFs Bonds

USA

INTL

watch live

Search quotes, news & videos

Watchlist

SIGN IN

Create free account

Markets

Business

Investing

Tech

Politics

CNBC TV

Watchlist

Investing Club

PRO

Menu

Tech

Kif Leswing

@kifleswing

WATCH LIVE

Qualcomm and Meta will enable the social networking company's so-called new large language model, Llama 2, to run on Qualcomm chips on phones and PCs starting in 2024

Qualcomm says the technology will enable applications like intelligent virtual assistants.

In this article

META

QCOM

Follow your favorite stocks CREATE FREE ACCOUNT

Qualcomm and Meta will enable the social networking company's new large language model, Llama 2, to run on Qualcomm chips on phones and PCs starting in 2024, the companies announced today.

So far, LLMs have primarily run in large server farms, on Nvidia graphics processors, due to the technology's vast needs for computational power and data, boosting Nvidia stock, which is up more than 220% this year. But the AI boom has largely missed the companies that make leading edge processors for phones and PCs, like Qualcomm. Its stock is up about 10% so far in 2023, trailing the NASDAQ's gain of 36%.

related investing news

Wall Street is bullish on Big Tech heading into earnings — here's what we think

Zev Fima

Nothing can keep tech down. Here's how that affects our thinking about stocks

Matthew J. Belvedere

Don't expect Nvidia's rally to lose steam, Citi says

Alex Harring

The announcement on Tuesday suggests that Qualcomm wants to position its processors as well-suited for A.I. but "on the edge," or on a device, instead of "in the cloud." If large language models can run on phones instead of in large data centers, it could push down the significant cost of running A.I. models, and could lead to better and faster voice assistants and other apps.

Qualcomm will make Meta's open-source Llama 2 models available on Qualcomm devices, which it believes will enable applications like intelligent virtual assistants. Meta's Llama 2 can do many of the same things as ChatGPT, but it can be packaged in a smaller program, which allows it to run on a phone.

Qualcomm's chips include a "tensor processor unit," or TPU, that is well-suited for the kinds of calculations that A.I. models require. However, the amount of processing power that is available on a mobile device pales in comparison to a data center stocked with cutting-edge GPUs.

Meta's Llama is notable because Meta published its "weights," a set of numbers that helps govern how a particular AI model works. Doing this will allow researchers and eventually commercial enterprises to use the AI models on their own computers without asking permission or paying. Other notable LLMs, like OpenAI's GPT-4, or Google's Bard, are closed-source, and their weights are closely held secrets.

Qualcomm has worked with Meta closely in the past, notably on chips for its Quest virtual reality devices. It has also demoed some A.I. models running slowly on its chips, such as the open source image generator Stable Diffusion.

Subscribe to CNBC PRO

Licensing & Reprints

CNBC Councils

Select Personal Finance

CNBC on Peacock

Join the CNBC Panel

Supply Chain Values

Select Shopping

Closed Captioning

Digital Products

News Releases

Internships

Corrections

About CNBC

Ad Choices

Site Map

Podcasts

Careers

Help

Contact

News Tips

Got a confidential news tip? We want to hear from you.

Get In Touch

Advertise With Us

Please Contact Us

CNBC Newsletters

Sign up for free newsletters and get more CNBC delivered to your inbox

Sign Up Now

Get this delivered to your inbox, and more info about our products and services.

Privacy Policy

|

Do Not Sell My Personal Information

|

CA Notice

|

Terms of Service

© 2023 CNBC LLC. All Rights Reserved. A Division of NBCUniversal

Data is a real-time snapshot *Data is delayed at least 15 minutes. Global Business and Financial News, Stock Quotes, and Market Data and Analysis.

Market Data Terms of Use and Disclaimers

Data also provided by

Single Line Text

Skip Navigation. watch live. Markets. Pre-Markets. U.S. Markets. Currencies. Cryptocurrency. Futures & Commodities. Bonds. Funds & ETFs. Business. Economy. Finance. Health & Science. Media. Real Estate. Energy. Climate. Transportation. Industrials. Retail. Wealth. Life. Small Business. Investing. Personal Finance. Fintech. Financial Advisors. Options Action. ETF Street. Buffett Archive. Earnings. Trader Talk. Tech. Cybersecurity. Enterprise. Internet. Media. Mobile. Social Media. CNBC Disruptor 50. Tech Guide. Politics. White House. Policy. Defense. Congress. Equity and Opportunity. CNBC TV. Live TV. Live Audio. Business Day Shows. Entertainment Shows. Full Episodes. Latest Video. Top Video. CEO Interviews. CNBC Documentaries. CNBC Podcasts. CNBC World. Digital Originals. Live TV Schedule. Watchlist. Investing Club. Trust Portfolio. Analysis. Trade Alerts. Meeting Videos. Homestretch. Jim's Columns. Education. PRO. Pro News. Pro Live. Market Forecast. Subscribe. Sign In. Menu. Make It. select ALL SELECT Credit Cards Loans Banking Mortgages Insurance Credit Monitoring Personal Finance Small Business Taxes Help for Low Credit Scores Investing SELECT All Credit Cards Find the Credit Card for You Best Credit Cards Best Rewards Credit Cards Best Travel Credit Cards Best 0% APR Credit Cards Best Balance Transfer Credit Cards Best Cash Back Credit Cards Best Credit Card Welcome Bonuses Best Credit Cards to Build Credit SELECT All Loans Find the Best Personal Loan for You Best Personal Loans Best Debt Consolidation Loans Best Loans to Refinance Credit Card Debt Best Loans with Fast Funding Best Small Personal Loans Best Large Personal Loans Best Personal Loans to Apply Online Best Student Loan Refinance SELECT All Banking Find the Savings Account for You Best High Yield Savings Accounts Best Big Bank Savings Accounts Best Big Bank Checking Accounts Best No Fee Checking Accounts No Overdraft Fee Checking Accounts Best Checking Account Bonuses Best Money Market Accounts Best CDs Best Credit Unions SELECT All Mortgages Best Mortgages Best Mortgages for Small Down Payment Best Mortgages for No Down Payment Best Mortgages with No Origination Fee Best Mortgages for Average Credit Score Adjustable Rate Mortgages Affording a Mortgage SELECT All Insurance Best Life Insurance Best Homeowners Insurance Best Renters Insurance Best Car Insurance Travel Insurance SELECT All Credit Monitoring Best Credit Monitoring Services Best Identity Theft Protection How to Boost Your Credit Score Credit Repair Services SELECT All Personal Finance Best Budgeting Apps Best Expense Tracker Apps Best Money Transfer Apps Best Resale Apps and Sites Buy Now Pay Later (BNPL) Apps Best Debt Relief SELECT All Small Business Best Small Business Savings Accounts Best Small Business Checking Accounts Best Credit Cards for Small Business Best Small Business Loans Best Tax Software for Small Business SELECT All Taxes Best Tax Software Best Tax Software for Small Businesses Tax Refunds SELECT All Help for Low Credit Scores Best Credit Cards for Bad Credit Best Personal Loans for Bad Credit Best Debt Consolidation Loans for Bad Credit Personal Loans if You Don't Have Credit Best Credit Cards for Building Credit Personal Loans for 580 Credit Score or Lower Personal Loans for 670 Credit Score or Lower Best Mortgages for Bad Credit Best Hardship Loans How to Boost Your Credit Score SELECT All Investing Best IRA Accounts Best Roth IRA Accounts Best Investing Apps Best Free Stock Trading Platforms Best Robo-Advisors Index Funds Mutual Funds ETFs Bonds. USA. INTL. watch live. Search quotes, news & videos. Watchlist. SIGN IN. Create free account. Markets. Business. Investing. Tech. Politics. CNBC TV. Watchlist. Investing Club. PRO. Menu. Tech. Kif Leswing. @kifleswing. WATCH LIVE. Qualcomm and Meta will enable the social networking company's so-called new large language model, Llama 2, to run on Qualcomm chips on phones and PCs starting in 2024. Qualcomm says the technology will enable applications like intelligent virtual assistants. In this article. META. QCOM. Follow your favorite stocks CREATE FREE ACCOUNT. Qualcomm and Meta will enable the social networking company's new large language model, Llama 2, to run on Qualcomm chips on phones and PCs starting in 2024, the companies announced today. So far, LLMs have primarily run in large server farms, on Nvidia graphics processors, due to the technology's vast needs for computational power and data, boosting Nvidia stock, which is up more than 220% this year. But the AI boom has largely missed the companies that make leading edge processors for phones and PCs, like Qualcomm. Its stock is up about 10% so far in 2023, trailing the NASDAQ's gain of 36%. related investing news. Wall Street is bullish on Big Tech heading into earnings — here's what we think. Zev Fima. Nothing can keep tech down. Here's how that affects our thinking about stocks. Matthew J. Belvedere. Don't expect Nvidia's rally to lose steam, Citi says. Alex Harring. The announcement on Tuesday suggests that Qualcomm wants to position its processors as well-suited for A.I. but "on the edge," or on a device, instead of "in the cloud." If large language models can run on phones instead of in large data centers, it could push down the significant cost of running A.I. models, and could lead to better and faster voice assistants and other apps. Qualcomm will make Meta's open-source Llama 2 models available on Qualcomm devices, which it believes will enable applications like intelligent virtual assistants. Meta's Llama 2 can do many of the same things as ChatGPT, but it can be packaged in a smaller program, which allows it to run on a phone. Qualcomm's chips include a "tensor processor unit," or TPU, that is well-suited for the kinds of calculations that A.I. models require. However, the amount of processing power that is available on a mobile device pales in comparison to a data center stocked with cutting-edge GPUs. Meta's Llama is notable because Meta published its "weights," a set of numbers that helps govern how a particular AI model works. Doing this will allow researchers and eventually commercial enterprises to use the AI models on their own computers without asking permission or paying. Other notable LLMs, like OpenAI's GPT-4, or Google's Bard, are closed-source, and their weights are closely held secrets. Qualcomm has worked with Meta closely in the past, notably on chips for its Quest virtual reality devices. It has also demoed some A.I. models running slowly on its chips, such as the open source image generator Stable Diffusion. Subscribe to CNBC PRO. Licensing & Reprints. CNBC Councils. Select Personal Finance. CNBC on Peacock. Join the CNBC Panel. Supply Chain Values. Select Shopping. Closed Captioning. Digital Products. News Releases. Internships. Corrections. About CNBC. Ad Choices. Site Map. Podcasts. Careers. Help. Contact. News Tips. Got a confidential news tip? We want to hear from you. Get In Touch. Advertise With Us. Please Contact Us. CNBC Newsletters. Sign up for free newsletters and get more CNBC delivered to your inbox. Sign Up Now. Get this delivered to your inbox, and more info about our products and services. Privacy Policy. |. Do Not Sell My Personal Information. |. CA Notice. |. Terms of Service. © 2023 CNBC LLC. All Rights Reserved. A Division of NBCUniversal. Data is a real-time snapshot *Data is delayed at least 15 minutes. Global Business and Financial News, Stock Quotes, and Market Data and Analysis. Market Data Terms of Use and Disclaimers. Data also provided by.