Blog

  • Top 10 AI Platforms Revolutionizing Media and Content Creation in 2026

    Top 10 AI Platforms Revolutionizing Media and Content Creation in 2026

    Artificial intelligence is fundamentally reshaping the media landscape. From voice synthesis and video generation to enterprise-grade cloud infrastructure, AI platforms are now essential tools for studios, newsrooms, and creators. Here are the top 10 AI platforms driving this transformation.

    1. ElevenLabs – Founded in 2022 and based in New York, ElevenLabs specializes in context-aware voice synthesis. Its technology captures human emotion, pacing, and intonation, enabling creators to produce lifelike audiobooks, game dialogue, and multilingual dubbing at scale.
    2. Midjourney – A self-funded research lab from San Francisco (founded 2021), Midjourney democratizes visual concept design. Its high-fidelity text-to-image generation is widely used for pre-visualization in film, TV, and graphic design, compressing weeks of sketching into minutes.
    3. Runway – Founded in 2018 in New York, Runway leads generative video with powerful video-to-video and text-to-video models. It partners with studios like Lionsgate to provide tools for automated rotoscoping, VFX, and marketing asset production.
    4. Anthropic (Claude) – San Francisco-based Anthropic (founded 2021) offers the Claude family of models. With large context windows and strong safety features, Claude helps news networks and screenwriters process research, organize plots, and edit transcripts without compromising brand safety.
    5. Amazon Web Services (Amazon Bedrock) – AWS (founded 2006, Bedrock in 2023) provides the industrial backend for media distribution. Bedrock offers a unified API to access top foundation models, powering personalized recommendations and metadata management for streaming giants.
    6. Adobe (Firefly) – Adobe (founded 1982, Firefly in 2023) takes a responsible approach by training Firefly on licensed content. Integrated into Photoshop, Premiere, and Illustrator, Firefly allows commercial creators to generate and edit images, video, and audio safely.
    7. Microsoft (Copilot and Azure AI) – Microsoft (founded 1975) weaves AI into media workflows through Azure AI and Copilot. Azure handles real-time translation and video indexing, while Copilot assists journalists with summaries and breaking news drafts.
    8. NVIDIA (AI Enterprise/Omniverse) – NVIDIA (founded 1993) provides the hardware and software foundation for AI media. Its AI Enterprise suite accelerates live audio cleanup and video upscaling, while Omniverse enables collaborative 3D environment building for VFX teams.
    9. Google DeepMind – London-based DeepMind (founded 2010, acquired by Google in 2014) drives multimodal AI breakthroughs. Its research powers video generation, audio synthesis, and predictive analytics for YouTube and archival search.
    10. OpenAI – Founded in 2015 in San Francisco, OpenAI remains the catalyst of generative AI. It has publisher licensing deals (e.g., Getty Images) and provides LLMs for script brainstorming and news synthesis. OpenAI is also expanding into ad delivery tools within ChatGPT.
  • Generalists Outperform Specialists in Certain Game Theory Scenarios, MIT Study Finds

    Generalists Outperform Specialists in Certain Game Theory Scenarios, MIT Study Finds

    In a surprising twist that challenges long-held assumptions in game theory, a new MIT study shows that general-purpose algorithms called policy gradient methods can outperform specialized game-theoretic algorithms in certain imperfect-information games. The findings, presented at the International Conference on Learning Representations in Rio De Janeiro, could reshape how artificial intelligence agents are trained to make decisions in competitive, real-world scenarios.

    Imperfect-information games—where players don’t know everything about their opponents—are common in life, from poker and bidding wars to military operations and financial negotiations. For decades, the prevailing belief was that algorithms specifically designed for these games, grounded in game theory, would always outshine general-purpose alternatives. However, the MIT-led team discovered that policy gradient methods, originally developed in the 1990s for single-agent decision-making, often perform better and with greater efficiency.

    The researchers created a benchmark to fairly evaluate different algorithms, measuring performance through a concept called exploitability—how well a player does against a worst-case adversary. In experiments involving five games, including Phantom Tic-Tac-Toe, imperfect-information Hex, and Liar’s Dice, neural networks trained with policy gradient algorithms consistently achieved lower exploitability scores than those trained with game-theoretic algorithms.

    “Our study showed that policy gradient methods can work better than these specialized algorithms, and that the specialized algorithms may not work as well as people thought,” said Samuel Sokota, a co-author from Carnegie Mellon University. The team’s benchmarking software, which they have made freely available, allows others to test and compare algorithms with just a single line of code added to the OpenSpiel library.

    The implications extend far beyond board games. “Hidden information is a very important property of the world,” said Eugene Vinitsky of New York University, another co-author. “It pervades military operations, trading scenarios, and negotiations—all of which are carried out under conditions of hidden information. The idea that we can improve on these games suggests that we can also do better in these other settings as well.”

    Ian Gemp, a computer scientist and game theory expert at Google DeepMind not involved in the study, called the results encouraging: “This work serves as a compelling reminder that modernizing classical tools remains a highly productive path for solving complex strategic problems.”

  • MIT Develops Long-Term Memory System That Lets Robots Answer Where You Left Your Keys

    MIT Develops Long-Term Memory System That Lets Robots Answer Where You Left Your Keys

    Imagine asking a robot, “Where did I leave my keys?” and getting an accurate, real-time answer. MIT researchers have created a new spatial memory framework called DAAAM (Describe Anything, Anywhere, Anytime, at Any Moment) that gives robots the ability to form and recall detailed mental models of large-scale environments. This breakthrough could transform how robots assist humans in factories, homes, and beyond.

    DAAAM combines advanced map representations with rich, language-based descriptions of objects a robot encounters as it explores. The system runs fast enough for mobile robots to use in real-time, answering complex queries in plain English with 21% to 53% higher accuracy than existing methods.

    “If we want robots to work side-by-side with humans and interact better with humans, they must speak the same language,” says Luca Carlone, associate professor in MIT’s Department of Aeronautics and Astronautics and lead researcher on the project. “The robot must be able to reason about time and space the same way humans do.”

    The framework bridges computer vision and robotic mapping. As a robot moves through an environment, DAAAM attaches detailed descriptions to objects—like noting that a red bicycle with a flat tire is in the bike rack outside the Stata Center. It stores this information in a 3D map-based representation arranged spatially, grouping objects into regions for efficient retrieval.

    To overcome the speed limitations of existing annotation techniques, DAAAM aggregates nearby objects and uses an optimization method to select key frames—images with the clearest view of multiple objects—allowing the system to describe several items in parallel. This speeds up computation tenfold, making real-time performance possible.

    “We annotate every object only once, so our framework can run in very large-scale environments in real time,” explains lead author Nicolas Gorlo, an MIT graduate student. “And by clustering objects into regions, it can answer a wide range of queries about objects and locations.”

    The researchers used a large language model (LLM) that calls on various tools to retrieve specific information quickly, reducing hallucinations. For example, if asked about a sculpture near an MIT campus building, DAAAM can use a semantic search tool to retrieve information based on the word “sculpture” or a location-based tool to find the building.

    Future work aims to expand DAAAM to capture significant events and incorporate confidence levels into responses. “Ultimately, we want to have robots that can help with any sort of tasks,” Gorlo says. “With this framework, we are trying to create the foundations to enable a generalist agent that can do anything you ask.”

    The research was presented at the Conference on Computer Vision and Pattern Recognition (CVPR) and funded by the U.S. Army Research Laboratory and the Office of Naval Research.

  • Policy Gradient Methods Outperform Specialized Game Theory Algorithms in Imperfect-Information Games

    Policy Gradient Methods Outperform Specialized Game Theory Algorithms in Imperfect-Information Games

    A new MIT-led study challenges long-held assumptions in game theory, demonstrating that general-purpose policy gradient methods can outperform specialized game-theoretic algorithms in imperfect-information, zero-sum games. The research, presented at the International Conference on Learning Representations, provides a benchmark for evaluating algorithms that train neural networks to compete in strategic interactions where players have hidden information.

    The team, including MIT PhD student Sobhan Mohammadpour and Assistant Professor Gabriele Farina, found that policy gradient methods—originally developed in the 1990s for decision-making—achieved lower exploitability scores than game-theory-based approaches in games like Phantom Tic-Tac-Toe, imperfect-information Hex, and Liar’s Dice. Exploitability measures how well a player performs against a worst-case adversary; a score of zero indicates perfect play.

    “It had been pretty much taken for granted that specialized game-theoretic algorithms were the right approach,” said co-author Samuel Sokota. “Our study showed that policy gradient methods can work better than these specialized algorithms.” The researchers attribute the oversight to a lack of rigorous benchmarking, which they have now addressed by releasing a freely available benchmark tool that runs on ordinary laptops.

    The benchmark, built on OpenSpiel, allows researchers to train and compare algorithms on games with up to 30 billion states. Farina emphasized that the term “game” applies broadly to multi-agent strategic interactions, including military operations, trading, and negotiations—all of which involve hidden information. “The idea that we can improve on these games suggests that we can also do better in these other settings,” said co-author Eugene Vinitsky.

    Ian Gemp of Google DeepMind praised the work: “This work serves as a compelling reminder that modernizing classical tools like policy gradient methods remains a highly productive path for solving complex strategic problems.”

  • MIT Leaders and Faculty Show How Massachusetts Can Drive the Next Wave of Tech Innovation

    MIT Leaders and Faculty Show How Massachusetts Can Drive the Next Wave of Tech Innovation

    On June 9, The Boston Globe released its 2026 “Tech Power Players” list, recognizing 50 influential local leaders in technology and business across Massachusetts. The list includes eight MIT affiliates: President Sally Kornbluth, Prof. Daniela Rus (director of CSAIL), Prof. Regina Barzilay, Prof. Yet-Ming Chiang, Prof. Max Tegmark, Ana Bakshi (executive director of the Martin Trust Center for MIT Entrepreneurship), Katie Rae (CEO and Managing Partner of Engine Ventures), and Senior Lecturer Brian Halligan, along with numerous MIT alumni.

    The Power Players coverage highlights MIT’s research labs, its culture of innovation and entrepreneurship, industry connections, new AI initiatives, and the Institute’s commitment to maintaining Massachusetts’ technological leadership. “Massachusetts can absolutely lead in this next wave,” says President Kornbluth, pointing to opportunities in manufacturing, life and health sciences, quantum technologies, and energy that can serve Americans nationwide.

    MIT is “working to drive artificial intelligence forward in sectors where the region is strongest, from biotechnology and robotics to defense and clean energy. It’s also trying to broaden entrepreneurship through a ‘dorm-to-startup’ push, creating a pipeline of support services—from hack-a-thons to venture funding—to help students start companies between classes,” writes Robert Weisman for The Globe. President Kornbluth is reinvigorating the school’s support of the local innovation ecosystem, unveiling new online AI classes—with free entry-level courses for anyone—and encouraging more on-campus entrepreneurship.

    MIT is carving out a specialty in applied AI, sometimes called “AI+X,” deploying the technology to help businesses, hospitals, and research institutions supercharge productivity, innovation, and scientific breakthroughs. Aman Narang ’04, CEO of Toast, notes: “The superpower has always been the university system. The best thing Boston can do is keep these people around.”

    MIT startups are a key driver of the region’s entrepreneurial ecosystem. To maintain Boston as a hub for innovators, MIT is building on its existing entrepreneurship resources, including more than 150 courses and 85 centers and programs. President Kornbluth and Provost Anantha Chandrakasan recently formed the Committee on Accelerating Translation and Entrepreneurship (CATE) to explore how the Institute can better support and accelerate the movement of ideas from research into new ventures.

    Applications for The Martin Trust Center’s startup accelerator program have doubled from last year, and nearly one-fifth of MIT undergraduates—about 800 students—attended a recent startup career fair.

    The Globe also highlights MIT startup Liquid AI, which develops AI models inspired by the brain structure of a simple worm. These models require far less electricity to operate than large language models, saving energy and water. Liquid AI recently signed a deal with Mercedes-Benz to incorporate its technology into onboard systems of cars sold in North America.

    Researchers are also focusing on energy innovation. Prof. Yet-Ming Chiang’s lab is developing batteries that store more electricity over longer periods, creating more opportunities for wind, solar, and other clean energy sources. Chiang’s lab and other MIT research centers work on microchips, critical minerals, fusion technology, and defense tech—examples of “tough tech” that combine science and engineering, which Chiang says “are in the sweet spot of the Boston ecosystem.”

    Soon, 80 MIT students will work as summer interns at GE Vernova, thanks to the MIT-GE Vernova Climate and Energy Alliance, a collaboration aimed at accelerating the global energy transition. GE Vernova CEO Scott Strazik dedicated $50 million over five years to fund internships and research projects.

    When asked about the most promising thing about the Greater Boston tech scene, Prof. Rus answers: “talent. Boston has the best AI researchers in the world, and they’re producing genuinely new ideas, not incremental ones.” Bob Mumgaard SM ’15, co-founder and CEO of Commonwealth Fusion Systems, says the region’s expertise in engineering, designing, and manufacturing hardware and access to university researchers made it possible to build the company only in Massachusetts. “The ecosystem has the building blocks… Massachusetts is the strongest in the nation in innovation in energy.”

    President Kornbluth points to quantum: “There isn’t a more important technological field right now than quantum science and technology, and the Boston area has the greatest concentration of quantum talent anywhere in the world.”

  • MIT Affiliates Shine in Boston Globe’s Tech Power Players List, Underscoring State’s Leadership Potential

    MIT Affiliates Shine in Boston Globe’s Tech Power Players List, Underscoring State’s Leadership Potential

    The Boston Globe released its 2026 “Tech Power Players” list on June 9, recognizing 50 influential leaders in technology and business across Massachusetts. Eight MIT affiliates are among the honorees, including President Sally Kornbluth, CSAIL Director Daniela Rus, Professors Regina Barzilay, Yet-Ming Chiang, and Max Tegmark, along with Ana Bakshi (Executive Director of the Martin Trust Center for MIT Entrepreneurship), Katie Rae (CEO of Engine Ventures), and Senior Lecturer Brian Halligan. The list also features numerous MIT alumni.

    The coverage goes beyond individual accolades, spotlighting MIT’s research labs, innovation culture, industry ties, new AI initiatives, and the Institute’s commitment to maintaining Massachusetts’ technological edge. “Massachusetts can absolutely lead in this next wave,” President Kornbluth told the Globe, emphasizing opportunities in manufacturing, life and health sciences, quantum technologies, and energy.

    AI and Entrepreneurship at the Forefront

    MIT is driving artificial intelligence forward in sectors where the region excels, from biotechnology and robotics to defense and clean energy. The Institute is also broadening entrepreneurship through a “dorm-to-startup” push, creating a pipeline of support services that include hackathons, venture funding, and more than 150 courses and 85 centers dedicated to fostering entrepreneurial ventures.

    President Kornbluth is reinvigorating MIT’s support for the local innovation ecosystem by unveiling new online AI classes—offering free entry-level courses for anyone—and encouraging more on-campus entrepreneurship. The Globe notes that these free courses could help local tech leaders ensure that people, not just corporations, benefit from AI.

    MIT is carving a specialty in applied AI, sometimes called “AI+X,” deploying the technology to help businesses, hospitals, and research institutions supercharge productivity and innovation. Aman Narang ’04, CEO of Toast, commented, “The superpower has always been the university system. The best thing Boston can do is keep these people around.”

    To further support student entrepreneurs, President Kornbluth and Provost Anantha Chandrakasan formed the Committee on Accelerating Translation and Entrepreneurship (CATE) to explore how MIT can accelerate the movement of ideas from research into new ventures. Applications for the Martin Trust Center’s startup accelerator program have doubled from last year, and nearly 800 undergraduates attended a recent startup career fair.

    Startups Driving Innovation Beyond Campus

    MIT startup Liquid AI is developing models inspired by the brain structure of a simple worm, which could significantly reduce AI energy consumption. The models, capable of detecting financial fraud and piloting autonomous drones, require far less electricity than large language models. Liquid AI recently signed a deal with Mercedes-Benz to integrate its technology into vehicles sold in North America.

    In energy, Professor Yet-Ming Chiang’s lab is developing long-duration batteries that enable greater use of wind, solar, and other clean energy sources. The lab and other MIT research centers are also working on innovations in microchips, critical minerals, fusion technology, and defense tech—examples of “tough tech” that Chiang says are in the sweet spot of the Boston ecosystem.

    Eighty MIT students will work as summer interns at GE Vernova through the MIT-GE Vernova Climate and Energy Alliance, a $50 million, five-year collaboration funding internships and research projects. GE Vernova CEO Scott Strazik emphasized the importance of plugging into MIT’s innovation culture.

    Quantum and the Future

    When asked about the most promising aspect of the Greater Boston tech scene, Daniela Rus pointed to talent: “Boston has the best AI researchers in the world, and they’re producing genuinely new ideas, not incremental ones.” Bob Mumgaard SM ’15, co-founder of Commonwealth Fusion Systems, noted that Massachusetts’ expertise in engineering and manufacturing made it the only place he could build his fusion energy company. “The ecosystem has the building blocks,” he said. “Massachusetts is the strongest in the nation in innovation in energy.”

    President Kornbluth highlighted quantum science and technology: “There isn’t a more important technological field right now than quantum science and technology, and the Boston area has the greatest concentration of quantum talent anywhere in the world.”

  • MIT Researchers Unveil New Method to Accurately Model Metal Alloy Behavior

    MIT Researchers Unveil New Method to Accurately Model Metal Alloy Behavior

    Companies working at the frontier of aerospace, energy, and computing are constantly searching for new materials to improve performance. However, understanding how these materials will behave inside rockets or on computer chips typically requires physically making and testing them first. This is because even the most powerful simulation techniques struggle to model the complex chemical arrangements found in most solid materials, adding significant costs and time to materials innovation.

    Now, a team of MIT researchers has developed a way to accurately model the behavior of metals, regardless of the complexity of their chemical arrangement. The core of the approach involves machine-learning models that accelerate and improve material simulations. The researchers enhanced these models by building training datasets that capture the diversity of atomic environments in chemically disordered materials.

    In a new paper published in Sciences Advances, the team demonstrated that their approach can accurately predict material properties for a diverse group of metal alloys under various conditions. They also showed how the method could be used to develop new materials, especially in scenarios where experimentation is expensive.

    “The focus of the paper is metallic alloys, but this could be adapted to other types of materials, like semiconductors,” says senior author Rodrigo Freitas, MIT’s TDK Career Development Professor in Materials Science and Engineering. “This is not specific to any one application — you could use this approach to create new sustainable steels, new materials for aerospace, and more. That’s what makes this exciting.”

    Modeling Metals

    Material properties are largely determined by the internal arrangement of their chemical elements. Even two materials with the same chemical composition can differ drastically — one might be brittle while the other deforms without breaking — depending on the atomic arrangement.

    Capturing that distinction requires simulating materials atom by atom. Researchers rely on models that describe how atoms interact. Over the last two decades, machine learning has become the most accurate way to build these models. Such models work well when chemical arrangements follow highly ordered patterns, but most solid materials are chemically disordered, with varying arrangements from one region to another.

    “The real challenge in our field is modelling these chemically disordered phases,” Freitas says. “Chemical disorder means there’s a huge variety of local chemical environments, which is hard for the machine-learning model to learn. This is a problem because every single metal we use in practice is chemically disordered.”

    The issue stems from a lack of representative training data for atom-by-atom simulations. The current leading approach uses brute force, often requiring over 100,000 hours of computation to create training data for a single material, and it does not transfer well when the material’s composition changes.

    Information Theory Approach

    In previous work, Freitas’ group developed a way to measure the chemical complexity of solid materials by analyzing the frequency and spacing of tiny groups of atoms. For this study, they used that capability to build better training datasets. They applied a mathematical approach known as information theory to generate datasets that capture a wider variety of local chemical environments inside disordered materials. The method works by swapping out atoms from samples to reduce repetition and expose the model to chemical environments it might otherwise miss.

    “We kept optimizing the training set so it captured as many different local environments as possible,” Freitas says. “If the same kind of environment showed up many times, we replaced redundant examples with ones the model hadn’t seen before. That makes the training set much more informative because each example adds something new.”

    When trained on the researchers’ datasets, the models predicted material properties more accurately than models trained using random sampling or another popular sampling method.

    “The starting point for all these atom-by-atom simulations is: Are you able to accurately describe the chemical bond between atoms?” Freitas explains. “If not, it can still teach you about materials in general, but it doesn’t tell you what will happen to specific materials in the real world. This approach makes the simulations high fidelity in terms of their chemistry, to better reflect what’s happening to materials.”

    The researchers applied their technique to create machine-learning training datasets for a group of chemically diverse metal alloys. Using a set of machine-learning models, they showed that models trained on their datasets are more accurate than much larger models created by companies like Google and Microsoft.

    From Lab to Industry

    The method works, in part, by capturing hidden patterns in the sample data — described as “subtle energetic biases toward certain local chemical configurations.” These small energetic differences determine which phases form in an alloy, how those phases change with temperature and composition, and ultimately what properties the material will have.

    As one test, simulations led by MIT PhD student Daniel Xiao showed that the team’s models could predict phase diagrams that closely matched experimental data. Phase diagrams map which phases are stable across different temperatures and chemical compositions, and they are a central tool for designing and processing alloys.

    “Phase diagrams are one of the main ways people connect materials modeling to real processing decisions,” Freitas says. “If you are welding, casting, or heat-treating an alloy, you need to know which phases are likely to form under different conditions. Our goal is to make these kinds of predictions accurate enough, and accessible enough, that they become part of how people design materials.”

    The researchers are now using the approach to study how changing an alloy’s composition affects mechanical properties and radiation tolerance, aiming to design materials that remain strong and damage-tolerant in harsh environments. They are also working to make the method easier to integrate with the tools and workflows materials engineers already rely on.

    “Industry isn’t going to change the way they do things if what you’re creating doesn’t fit into their existing operating procedures,” Freitas says. “The goal is to make these predictions useful in the places where materials decisions are actually made.”

    The research was supported by the U.S. Air Force Office of Scientific Research.

  • New Machine Learning Approach Accurately Predicts Metal Alloy Properties

    New Machine Learning Approach Accurately Predicts Metal Alloy Properties

    Companies in aerospace, energy, and computing constantly seek new materials to boost performance, but understanding how those materials will behave in real-world applications often requires costly and time-consuming physical testing. Traditional simulation techniques struggle to model the complex chemical arrangements found in most solid materials, particularly metal alloys. Now, MIT researchers have developed a method that accurately models the behavior of metals regardless of their chemical complexity.

    At the core of the approach are machine-learning models that simulate materials atom by atom. The researchers improved these models by building training datasets that capture the diversity of atomic environments in chemically disordered materials. Using information theory, they optimized the training sets to include a wider variety of local chemical configurations, replacing redundant examples with new ones to make the data more informative.

    In a paper published in Science Advances, the team demonstrated that their technique could accurately predict material properties for a diverse group of metal alloys under various conditions. The approach also showed promise for developing new materials, especially in scenarios where experimentation is expensive.

    “The focus is metallic alloys, but this could be adapted to other materials like semiconductors,” says senior author Rodrigo Freitas, MIT’s TDK Career Development Professor in Materials Science and Engineering. “You could use this approach to create new sustainable steels, new materials for aerospace, and more.”

    The researchers applied their technique to create machine-learning training datasets for several chemically diverse alloys. Models trained on these datasets outperformed larger models from companies like Google and Microsoft in accuracy. The team also validated their predictions against experimental data on atomic ordering in alloys.

    One key test involved predicting phase diagrams—maps showing which phases of an alloy are stable at different temperatures and compositions. The models closely matched experimental data, a crucial step for connecting materials modeling to real-world processing decisions like welding, casting, or heat-treating.

    The researchers are now using the method to study how changing an alloy’s composition affects mechanical properties and radiation tolerance, aiming to design materials that remain strong and damage-tolerant in harsh environments. They also plan to make the approach easier to integrate with existing tools used by materials engineers.

    “Industry isn’t going to change the way they do things if what you’re creating doesn’t fit into their existing operating procedures,” Freitas notes. “The goal is to make these predictions useful where materials decisions are actually made.”

    The research was supported by the U.S. Air Force Office of Scientific Research.

  • Ultra-Low-Power Chip Lets Tiny Robots Create Real-Time 3D Maps for Navigation

    Ultra-Low-Power Chip Lets Tiny Robots Create Real-Time 3D Maps for Navigation

    MIT researchers have unveiled a new chip that could transform how tiny, battery-powered robots navigate complex environments. The chip, named Gleanmer, enables small autonomous vehicles and other power-limited devices to build detailed 3D maps of their surroundings in real time while consuming only about 6 milliwatts of power — roughly the same as a single LED.

    Traditional 3D mapping systems require significant memory and energy because they store and process every pixel from depth images. The MIT team took a different approach, combining an efficient algorithm with custom hardware to dramatically reduce both power and memory demands.

    How Gleanmer Works

    Instead of representing the environment with rigid cube-shaped voxels (3D pixels), the chip uses flexible ellipsoid shapes called Gaussians. These ellipsoids can be smoothly adjusted in size, shape, and thickness to match curved objects more efficiently than voxels. This compact representation captures both obstacles and free space, allowing a robot to plan collision-free paths without storing massive amounts of data.

    The researchers leveraged an algorithm developed in their lab called GMMap, which generates Gaussian-based maps from depth images in a single pass. By only comparing each pixel to its immediate neighbors, the algorithm avoids storing entire images at once — significantly reducing memory footprint.

    “At any point in time, we only need to store a few pixels in memory, which significantly reduces the memory footprint our algorithm requires,” said co-lead author Peter Zhi Xuan Li, an MIT graduate student.

    Co-Design for Maximum Efficiency

    As a robot moves, it often sees the same object from multiple angles, creating overlapping Gaussians. The chip fuses these overlapping shapes directly — without revisiting the original pixels — keeping the map compact. This principle extends throughout the design: most computations operate on compact Gaussians rather than raw pixels, enabling major energy savings.

    The hardware is built to keep active Gaussians in small, fast on-chip memory right next to the processing units. This eliminates the need to fetch data from distant, power-hungry off-chip storage.

    “By having a dedicated memory that just stores the objects you’ve seen in the previous few frames, you can access the data much more efficiently,” explained co-lead author Zih-Sing Fu.

    Real-World Testing and Future Applications

    The team tested Gleanmer on diverse 3D environments and live data from an iPhone camera. The chip generated accurate maps in real time while using just 2.5% of the power required by the best existing map-construction chip. It also allowed a simulated robot to plan safe trajectories using only about 20% of the energy it would otherwise need.

    Beyond robotics, the ultra-low-power operation makes the chip well-suited for lightweight augmented reality headsets that can be worn for extended periods — for applications like medical training simulations or detailed repair work.

    “Real-time 3D mapping has been the missing piece for small autonomous systems. A drone inspecting a pipeline or a pair of AR glasses navigating a room both need to understand the space around them — instantly, continuously, and at almost no power cost. Gleanmer makes that possible for the first time in a chip you can hold between your fingers,” said co-author Sertac Karaman, a professor of aeronautics and astronautics.

    The work was supported by the MIT-MathWorks Fellowship, Amazon, the U.S. National Science Foundation, and Intel. The paper was presented at the IEEE Very Large-Scale Integrated Circuits Symposium.

  • MIT’s 6-Milliwatt AI Chip Brings Real-Time 3D Mapping to Tiny Robots

    MIT’s 6-Milliwatt AI Chip Brings Real-Time 3D Mapping to Tiny Robots

    Researchers at MIT have unveiled a new system-on-a-chip that could revolutionize how tiny, low-power robots navigate complex environments. The chip, named Gleanmer, enables autonomous drones and other battery-limited devices to construct detailed 3D maps in real time using only about 6 milliwatts of power—roughly the energy of a single LED. This breakthrough, presented at the IEEE Very Large-Scale Integrated Circuits Symposium, promises to make small-scale robotics more capable and energy-efficient than ever.

    A Smarter Approach to 3D Mapping

    Traditional 3D mapping for robots relies on power-hungry systems that process and store thousands of 3D pixels (voxels) per image. The MIT team took a radically different approach by combining an efficient algorithm called GMMap with custom hardware optimized for its workload. Instead of using rigid cube-shaped voxels, GMMap represents obstacles and free space with flexible ellipsoidal blobs known as Gaussians. These shapes can stretch and shrink to match curved objects, storing far less data than traditional methods while still capturing accurate geometry.

    “This paper showcases a key example of how you can leverage co-design of the algorithm and hardware to really push energy efficiency,” says Vivienne Sze, a professor in EECS and senior author of the paper. “Our chip allows you to store very large maps in a very small space, and do it in a very energy efficient manner.”

    Hardware-Algorithm Co-Design at Its Best

    The chip’s efficiency stems from several clever optimizations. First, the GMMap algorithm processes each depth image in a single pass, comparing only neighboring pixels rather than all pixels in an image. This drastically reduces the amount of data that needs to be stored and retrieved. Second, as the robot moves and observes the same object from different angles, overlapping Gaussians are fused into a single compact representation without re-examining the original pixels. Because Gaussians are more compact than raw pixel data, this fusion process runs on-chip with minimal memory traffic.

    The hardware design keeps active Gaussians in small, fast on-chip memory right next to the processing units. “By having a dedicated memory that just stores the objects you’ve seen in the previous few frames, you can access the data much more efficiently,” explains co-lead author Zih-Sing Fu.

    Unmatched Energy Efficiency

    In tests, Gleanmer generated detailed 3D maps in real time while consuming only about 6 milliwatts of power—just 2.5 percent of what the best existing mapping chip requires. When used for path planning, the chip reuses compact Gaussians along the planned route, using only about 20 percent of the energy that conventional approaches would need.

    The low power consumption makes Gleanmer ideal not only for tiny drones inspecting HVAC systems or pipelines, but also for lightweight augmented reality headsets that require continuous environmental mapping for educational medical simulations or repair work. Sertac Karaman, a professor of aeronautics and astronautics and co-author, notes: “Real-time 3D mapping has been the missing piece for small autonomous systems. Gleanmer makes that possible for the first time in a chip you can hold between your fingers.”

    Looking Ahead

    The researchers plan to push energy efficiency even further by moving processing units closer to the sensors that gather environmental data. They are also exploring applications beyond robotics, such as using Gaussians to represent complex schematics for AI reasoning systems. This work was supported by the MIT-MathWorks Fellowship, Amazon, the U.S. National Science Foundation, and Intel.