Streamlining data collection for improved salmon population management

Assistant Professor Sara Beery is using automation to improve monitoring of migrating salmon in the Pacific Northwest.

Avery Plachcinski | Abdul Latif Jameel Water and Food Systems Lab • mit
Feb. 6, 2025 ~13 min

Ecologists find computer vision models’ blind spots in retrieving wildlife images

Biodiversity researchers tested vision systems on how well they could retrieve relevant nature images. More advanced models performed well on simple queries but struggled with more research-specific prompts.

Alex Shipps | MIT CSAIL • mit
Dec. 20, 2024 ~9 min


Teaching a robot its limits, to complete open-ended tasks safely

The “PRoC3S” method helps an LLM create a viable action plan by testing each step in a simulation. This strategy could eventually aid in-home robots to complete more ambiguous chore requests.

Alex Shipps | MIT CSAIL • mit
Dec. 12, 2024 ~6 min

A new way to create realistic 3D shapes using generative AI

Researchers propose a simple fix to an existing technique that could help artists, designers, and engineers create better 3D models.

Adam Zewe | MIT News • mit
Dec. 4, 2024 ~7 min

New AI tool generates realistic satellite images of future flooding

The method could help communities visualize and prepare for approaching storms.

Jennifer Chu | MIT News • mit
Nov. 25, 2024 ~8 min

Can robots learn from machine dreams?

MIT CSAIL researchers used AI-generated images to train a robot dog in parkour, without real-world data. Their LucidSim system demonstrates generative AI's potential for creating robotics training data.

Rachel Gordon | MIT CSAIL • mit
Nov. 19, 2024 ~8 min

Combining next-token prediction and video diffusion in computer vision and robotics

A new method can train a neural network to sort corrupted data while anticipating next steps. It can make flexible plans for robots, generate high-quality video, and help AI agents navigate digital environments.

Alex Shipps | MIT CSAIL • mit
Oct. 16, 2024 ~8 min

AI pareidolia: Can machines spot faces in inanimate objects?

New dataset of “illusory” faces reveals differences between human and algorithmic face detection, links to animal face recognition, and a formula predicting where people most often perceive faces.

Rachel Gordon | MIT CSAIL • mit
Sept. 30, 2024 ~8 min


Helping robots zero in on the objects that matter

A new method called Clio enables robots to quickly map a scene and identify the items they need to complete a given set of tasks.

Jennifer Chu | MIT News • mit
Sept. 30, 2024 ~9 min

Helping robots practice skills independently to adapt to unfamiliar environments

New algorithm helps robots practice skills like sweeping and placing objects, potentially helping them improve at important tasks in houses, hospitals, and factories.

Alex Shipps | MIT CSAIL • mit
Aug. 8, 2024 ~7 min

/

14