AI Info

2m ago

Filter:

Curated AI news, research, and engineering updates

AI Info brings together AI news, research posts, engineering write-ups, and product announcements from major labs, companies, and communities in one crawlable hub.

An Organizational Second Brain: Building an AI That Learns From Experts

We’ve built an AI agent that acts as a secondary expert for a given domain, making deep specialist knowledge readily available and preserved for anyone in an organization to access, share, and build upon. This is not a typical domain-specific agent. Its novelty comes from integrating two layers:  A structured, auditable knowledge architecture separates what [...] Read More... The post An Organizational Second Brain: Building an AI That Learns From Experts appeared first on Engineering at Meta.

Wed, 02 Sep 2026 09:00:29 +0000

GEM Training: How Meta Doubled the Efficiency of Its LLM-Scale Ads Foundation Model

Meta’s Generative Ads Recommendation Model (GEM), the foundation model behind ads recommendations across Instagram and Facebook, now trains at LLM scale on several thousand of the latest-generation GPUs. This post goes into the details on how we achieved: doubling end-to-end (E2E) training efficiency to 20–25% Model FLOPs Utilization (MFU) while scaling training FLOPs 4x in [...] Read More... The post GEM Training: How Meta Doubled the Efficiency of Its LLM-Scale Ads Foundation Model appeared first on Engineering at Meta.

Mon, 03 Aug 2026 18:00:17 +0000

Exploring Hierarchical Interest Representation For Meta Ads Deep Funnel Optimization

Hierarchical Interest Representation is a research area for Meta Ads. We’re exploring an upstream representation layer over the universe of Ads entities – users, advertisers, products, services – learning unified embeddings that connect users’ inferred interests with the breadth of what advertisers offer in their deep funnel ads. The innovations in Hierarchical Interest Representation are [...] Read More... The post Exploring Hierarchical Interest Representation For Meta Ads Deep Funnel Optimization appeared first on Engineering at Meta.

Wed, 15 Jul 2026 17:00:52 +0000

10 Years of Meta’s Commitment to Python

This year marks Meta’s 10th consecutive year as a sponsor of the Python Software Foundation (PSF), the charitable organization dedicated to advancing, supporting, and protecting the open-source Python programming language and the community that sustains it. Python is one of the world’s most influential programming languages, and we use it across our engineering stack, from [...] Read More... The post 10 Years of Meta’s Commitment to Python appeared first on Engineering at Meta.

Tue, 30 Jun 2026 16:00:46 +0000

RCCLX: Innovating GPU Communications on AMD Platforms

We are open-sourcing the initial version of RCCLX – an enhanced version of RCCL that we developed and tested on Meta’s internal workloads. RCCLX is fully integrated with Torchcomms and aims to empower researchers and developers to accelerate innovation, regardless of their chosen backend. Communication patterns for AI models are constantly evolving, as are hardware [...] Read More... The post RCCLX: Innovating GPU Communications on AMD Platforms appeared first on Engineering at Meta.

Tue, 24 Feb 2026 21:30:54 +0000

Monitoring production agent lifecycle with AWS DevOps Agent and AgentCore Evaluations

Multi-agent systems fail in ways traditional monitoring misses. This post presents a dual-layer approach to monitoring production agents: Amazon Bedrock AgentCore Evaluations for continuous quality scoring and AWS DevOps Agent for autonomous infrastructure investigation, shown on a four-agent airline reservation system.

Fri, 11 Sep 2026 18:26:38 +0000

Beyond the price per token: Choosing the right OpenAI model on Amazon Bedrock for your workload

Comparing models on dollars per million tokens misses what production workloads actually pay for: outcomes. This post shares an open-source benchmarking harness that measures cost per correct answer, agent trajectory cost, and rubric-graded deliverable quality across OpenAI models on Amazon Bedrock.

Fri, 11 Sep 2026 18:24:38 +0000

Build interactive MCP Apps using Amazon Bedrock AgentCore

Learn how to build and deploy an MCP App with interactive HTML widgets on Amazon Bedrock AgentCore. Because MCP Apps is a host-agnostic standard, the same server delivers the same rich experience across AI hosts like ChatGPT and Claude that support the extension.

Fri, 11 Sep 2026 18:23:17 +0000

Reduce LLM latency with prefix-aware routing on Amazon SageMaker Inference

Amazon SageMaker Inference now offers prefix-aware routing, a routing strategy that sends requests sharing the same prompt prefix to the same instance so the KV cache stays warm. In benchmarks on Llama 3.1 70B, it reduced P50 time-to-first-token by up to 77% and raised KV cache hit rates from about 25% to over 80%.

Thu, 10 Sep 2026 21:58:09 +0000

Reduce inference cold starts on Amazon SageMaker HyperPod with model caching

Amazon SageMaker HyperPod now supports model caching for inference, which pre-loads model weights and container images onto cluster nodes so pods read from local NVMe storage instead of downloading over the network. Learn how model caching cuts cold starts from tens of minutes to seconds, how it works, and how to enable it.

Thu, 10 Sep 2026 21:37:49 +0000

ZGateway: Learnings from Putting a Proxy in Front of ZippyDB

We’re introducing ZGateway, the proxy we are using to unify traffic through ZippyDB, Meta’s most widely-used key value store. As a bonus, it also enables admission control, load balancing, cross-region resilience, and richer operations. ZippyDB is the most widely used key value store at Meta, backing product metadata, counters, and configuration, and can serve billions [...] Read More... The post ZGateway: Learnings from Putting a Proxy in Front of ZippyDB appeared first on Engineering at Meta.

Thu, 03 Sep 2026 16:00:20 +0000

An Organizational Second Brain: Building an AI That Learns From Experts

We’ve built an AI agent that acts as a secondary expert for a given domain, making deep specialist knowledge readily available and preserved for anyone in an organization to access, share, and build upon. This is not a typical domain-specific agent. Its novelty comes from integrating two layers:  A structured, auditable knowledge architecture separates what [...] Read More... The post An Organizational Second Brain: Building an AI That Learns From Experts appeared first on Engineering at Meta.

Wed, 02 Sep 2026 09:00:29 +0000

MetaRoCE: A New RDMA Transport Built for AI-Scale Ethernet

Training and serving frontier AI models depends on fast, reliable networks that move data between GPUs without wasting compute cycles.  To meet this challenge at scale, Meta designed MetaRoCE – a clean-sheet RDMA transport protocol purpose-built for AI workloads on commodity Ethernet.  We’re releasing the MetaRoCE specification, a reference software implementation and a compliance test [...] Read More... The post MetaRoCE: A New RDMA Transport Built for AI-Scale Ethernet appeared first on Engineering at Meta.

Mon, 24 Aug 2026 18:02:29 +0000

MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines

MTIA 300 is the first of Meta’s family of in-house training and inference accelerators optimized for training ranking and recommendation models. We’re sharing how MTIA 300’s built-in NIC chiplets allow it to meet the communication needs associated with training recommendation models with superior performance over general-purpose GPUs. By co-designing MTIA’s communication library, HCCL, alongside the [...] Read More... The post MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines appeared first on Engineering at Meta.

Mon, 24 Aug 2026 17:45:52 +0000

How We’re Building Scam Alert on WhatsApp With End-to-End Encryption and Verifiability Guarantees

WhatsApp is committed to helping people stay safe while protecting the privacy of their messages. As scam tactics evolve — from impersonation to social engineering to AI-generated lures — we’re always evolving as well, so that our protections stay ahead of scammers while protecting people’s personal messages with end-to-end encryption. Today, we’re sharing an early [...] Read More... The post How We’re Building Scam Alert on WhatsApp With End-to-End Encryption and Verifiability Guarantees appeared first on Engineering at Meta.

Wed, 12 Aug 2026 13:00:28 +0000

#501 – DHH: Future of Programming, AI, Agentic Engineering, Vibe Coding & Linux

DHH is the creator of Ruby on Rails, Omarchy Linux, CTO of 37signals, and a racecar driver. https://lexfridman.com/sponsors/ep501-sc Transcript: https://lexfridman.com/dhh-2-transcript CONTACT LEX: Feedback – give feedback to Lex: https://lexfridman.com/survey AMA – submit questions, videos or call-in: https://lexfridman.com/ama Hiring – join our team: https://lexfridman.com/hiring Other – other ways to get in touch: https://lexfridman.com/contact EPISODE LINKS: https://x.com/dhh https://world.hey.com/dhh https://omarchy.org https://rubyonrails.org https://37signals.com SPONSORS: Wispr Flow: AI-powered voice dictation app. https://wisprflow.ai/lex Blitzy: AI agent for large enterprise codebases. https://blitzy.com/lex NetSuite: Business management software. http://netsuite.ai/lex Shopify: Sell stuff online. https://shopify.com/lex LMNT: Zero-sugar electrolyte drink mix. https://drinkLMNT.com/lex Plaud: AI-powered note-taking devices and software. https://plaud.ai/lex Higgsfield AI: AI-based video generation, filmmaking, and creative studio. https://higgsfield.ai Perplexity: AI-powered answer engine. https://perplexity.ai/ OUTLINE: (00:00) – Introduction (01:14) – Sponsors, Comments, and Reflections (08:56) – Programming with AI agents (24:14) – How software will change (33:30) – AI impact on open source (43:21) – Building Omarchy Linux distro (53:05) – Vibe coding vs agentic engineering (1:06:06) – The end of manual programming (1:16:24) – Advice for programmers (1:28:31) – Surviving Internet Hate (1:37:46) – Programming setup for AI Agents (1:50:11) – Obsessing about speed (2:13:06) – Voice prompting vs typing (2:27:05) – Best AI coding models (2:43:55) – Best AI coding harnesses (2:56:57) – AI video generation and filmmaking (3:16:28) – Fatherhood (3:44:35) – Linux will win the desktop (3:55:51) – PewDiePie (4:05:25) – Future of programming (4:28:18) – Politics and immigration (4:59:55) – Longevity, over-optimization, and fear of death (5:11:38) – Eternal recurrence and future of human civization

Wed, 26 Aug 2026 21:47:04 +0000

#500 – Khabib Nurmagomedov: Dagestan, MMA, UFC, Islam, Conor, Fedor & Football

Khabib Nurmagomedov is one of the greatest fighters of all time, who retired from the UFC undefeated with a perfect 29-0 record. We did this conversation entirely in Russian. It’s translated and dubbed into English. Both language audio tracks (and subtitles) are available on YouTube. Here, only the English audio is available. We worked hard to make it enjoyable to listen to, by carefully dubbing the translation using voice-cloning, as we’ve done for previous foreign-language podcasts. Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep500-sc Transcript: https://lexfridman.com/khabib-nurmagomedov-transcript CONTACT LEX: Feedback – give feedback to Lex: https://lexfridman.com/survey AMA – submit questions, videos or call-in: https://lexfridman.com/ama Hiring – join our team: https://lexfridman.com/hiring Other – other ways to get in touch: https://lexfridman.com/contact EPISODE LINKS: https://instagram.com/khabib_nurmagomedov/ https://youtube.com/@KhabibTheEagle https://facebook.com/KhabibTheEagle/ https://x.com/TeamKhabib https://t.me/khabib_nurmagomedov https://khabib.com SPONSORS: Wispr Flow: AI-powered voice dictation app. https://wisprflow.ai/lex LMNT: Zero-sugar electrolyte drink mix. https://drinkLMNT.com/lex Shopify: Sell stuff online. https://shopify.com/lex BetterHelp: Online therapy and counseling. https://betterhelp.com/lex Perplexity: AI-powered answer engine. https://perplexity.ai/ OUTLINE: (00:00) – Introduction (01:29) – Sponsors, Comments, and Reflections (08:24) – Why Dagestan produces so many great fighters (18:31) – History of Dagestan warrior culture (27:51) – Hard training in the mountains of Dagestan (31:42) – The trap of fame, money, and power (42:23) – The key to Khabib’s dominance (53:36) – Discipline and hard work (1:06:04) – Street fights in Dagestan (1:19:45) – Khabib’s top pressure (1:25:29) – Khabib vs Conor McGregor (1:38:14) – Khabib’s toughest fight (1:46:02) – Greatest MMA fighters of all time (2:03:46) – Coaching (2:09:19) – Daniel Cormier (2:13:38) – Islam Makhachev (2:23:35) – Dana White (2:27:05) – Joe Rogan (2:29:20) – Ali Abdelaziz (2:31:57) – Football (2:39:12) – Messi vs Ronaldo (2:57:12) – Dubai (3:01:03) – God (3:08:46) – Advice for young people

Wed, 12 Aug 2026 13:11:45 +0000

#499 – Gary Gallagher: American Civil War, Slavery, Lincoln, Grant & Lee

Gary Gallagher is a historian of the American Civil War. https://lexfridman.com/sponsors/ep499-sc Transcript: https://lexfridman.com/gary-gallagher-transcript CONTACT LEX: Feedback – give feedback to Lex: https://lexfridman.com/survey AMA – submit questions, videos or call-in: https://lexfridman.com/ama Hiring – join our team: https://lexfridman.com/hiring Other – other ways to get in touch: https://lexfridman.com/contact EPISODE LINKS: https://history.virginia.edu/people/gary-w-gallagher https://en.wikipedia.org/wiki/Gary_W._Gallagher https://amzn.to/4yletel https://amzn.to/3QT1jED https://amzn.to/4fdrbD5 https://amzn.to/4wFxk1X https://amzn.to/4vsAogU https://bit.ly/4gDX3mQ SPONSORS: Upwork: Platform for hiring freelancers. https://upwork.com/lex NetSuite: Business management software. http://netsuite.ai/lex Shopify: Sell stuff online. https://shopify.com/lex LMNT: Zero-sugar electrolyte drink mix. https://drinkLMNT.com/lex BetterHelp: Online therapy and counseling. https://betterhelp.com/lex Perplexity: AI-powered answer engine. https://perplexity.ai/ Plaud: AI-powered note-taking devices and software. https://plaud.ai/lex OUTLINE: (00:00) – Introduction (00:07) – Sponsors, Comments, and Reflections (08:36) – What caused the Civil War? (18:33) – Slavery (46:07) – Lincoln (1:01:03) – Grant vs Lee (1:09:57) – Could the Civil War have been avoided? (1:19:23) – The bloodiest war in US history (1:36:31) – How the Confederate Army could’ve won (1:57:05) – Key battles of the Civil War (2:20:07) – Best and Worst Presidents (2:34:06) – Robert E. Lee (2:53:40) – The most important battle of the Civil War (3:03:51) – The final showdown of the Civil War – Grant vs Lee (3:26:10) – Lost Cause and Confederate Monuments (3:43:37) – Extreme political division in US

Tue, 28 Jul 2026 20:06:06 +0000

#498 – Anthony Kaldellis: Roman Empire, Byzantine Empire, Rise & Fall of Empires

Anthony Kaldellis is a historian of the Roman Empire and author of “The New Roman Empire”, a comprehensive history of the Byzantine Empire (Eastern Roman Empire). https://lexfridman.com/sponsors/ep498-sc Transcript: https://lexfridman.com/anthony-kaldellis-transcript CONTACT LEX: Feedback – give feedback to Lex: https://lexfridman.com/survey AMA – submit questions, videos or call-in: https://lexfridman.com/ama Hiring – join our team: https://lexfridman.com/hiring Other – other ways to get in touch: https://lexfridman.com/contact EPISODE LINKS: https://amzn.to/49AX7Q1 https://kaldellispublications.weebly.com https://classics.uchicago.edu/people/anthony-kaldellis https://amzn.to/3PTFTqk https://amzn.to/4fgRMRq https://byzantiumandfriends.podbean.com/ https://thehistoryofbyzantium.com/ SPONSORS: Upwork: Platform for hiring freelancers. https://upwork.com/lex Fin: AI agent for customer service. https://fin.ai/lex BetterHelp: Online therapy and counseling. https://betterhelp.com/lex LMNT: Zero-sugar electrolyte drink mix. https://drinkLMNT.com/lex Shopify: Sell stuff online. https://shopify.com/lex Perplexity: AI-powered answer engine. https://perplexity.ai/ OUTLINE: PODCAST LINKS: https://lexfridman.com/podcast https://apple.co/2lwqZIr https://spoti.fi/2nEwCF8 https://lexfridman.com/feed/podcast/ https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 https://www.youtube.com/lexclips

Tue, 30 Jun 2026 21:33:40 +0000

#497 – Biggest Mysteries in Physics: Antimatter, Dark Energy & ToE – Don Lincoln

Don Lincoln is a particle physicist at Fermilab who has spent decades working at the frontiers of high energy physics. https://lexfridman.com/sponsors/ep497-sc CONTACT LEX: Feedback – give feedback to Lex: https://lexfridman.com/survey AMA – submit questions, videos or call-in: https://lexfridman.com/ama Hiring – join our team: https://lexfridman.com/hiring Other – other ways to get in touch: https://lexfridman.com/contact EPISODE LINKS: https://facebook.com/Dr.Don.Lincoln/ https://drdonlincoln.com/ https://bit.ly/4nHeNiF https://bit.ly/3PCIW67 https://x.com/DrDonLincoln https://amzn.to/4uYbkOZ https://shop.thegreatcourses.com/don-lincoln https://adbl.co/4wGioRV https://www.youtube.com/fermilab https://www.fnal.gov/ https://x.com/fermilab SPONSORS: Upwork: Platform for hiring freelancers. https://upwork.com/lex Larridin: Measure AI adoption in your business. https://larridin.com Fin: AI agent for customer service. https://fin.ai/lex LMNT: Zero-sugar electrolyte drink mix. https://drinkLMNT.com/lex Shopify: Sell stuff online. https://shopify.com/lex Perplexity: AI-powered answer engine. https://perplexity.ai/ OUTLINE: PODCAST LINKS: https://lexfridman.com/podcast https://apple.co/2lwqZIr https://spoti.fi/2nEwCF8 https://lexfridman.com/feed/podcast/ https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 https://www.youtube.com/lexclips

Fri, 29 May 2026 16:22:02 +0000