Google Research published research on long-form video generation, proposing an AI video co-director multi-agent orchestration framework built on Gemini and Veo to plan visual continuity across multi-shot narratives.
Google released research prototype AgentHands, published at CHI 2026, mapping LLM reasoning to speech-synchronised hand animations in XR headsets so agents can point and demonstrate object operations in 3D. It combines environment perception, a gesture event library, gesture-embedding reasoning and local synchronised execution, supporting deictic, iconic and expressive gestures. In an N=12 user study, it significantly improved spatial reference over voice-only interaction.
Google Research proposed PhotoScan, a deep learning framework that estimates body fat percentage, A/G ratio and V/S ratio from ordinary 2D phone photos to predict insulin resistance.
Microsoft Research introduced MindTopo to evaluate multimodal models' reasoning and planning over connectivity, enclosure, order, separation and knotting. Current models perform much better at static-image recognition than interactive planning, with failures mainly in planning rather than perception and overall performance far below humans. Image and video generation helps only when preserving structural relations in a single frame; multi-step operations often change topology or violate constraints.
Google Research released AMIE (Video), built on Gemini and Project Astra, for real-time video clinical consultations. It can perceive non-verbal cues and guide virtual physical examinations.
Microsoft Research released CARE-X, a unified chest X-ray vision-language research model for report generation and structured prediction. It rewards clinical correctness using multitask reinforcement learning (DAPO). Generation and dual-inference modes cover lesion presence and negation, localisation, multilabel classification, catheter and tube malposition detection, and localisation of 29 anatomical regions.
Google Research published SymptomAI research, using five Gemini Flash 2.0 agents with different questioning strategies for symptom interviews and differential diagnosis, involving 13,917 participants.
Google Research released vector data converting Farmscapes 2020 high-resolution raster maps into usable inventories of hedgerows, stone walls and coppices across over 130,000 square kilometres of the UK. The framework fine-tunes an RSF Vision-Transformer pretrained on over 300 million global satellite images with around 247 square kilometres of labelled data. Polsby–Popper compactness distinguishes woodland, clusters of trees and hedgerows, with a threshold below 0.5 for linear features.
Google published two studies on AI-assisted understanding of skin problems. In a survey of 2,345 participants, over 62% using AI tried to name a skin condition versus 41% in the control group, with 23% accuracy, nearly triple the control group's 8%. A mixed-methods study examined how people use these tools for their own skin concerns, their understanding and differences in doctor communication. AI offered limited help in deciding the next steps for seeking care.
Google Research published a study in Nature introducing PHRM, which records video with a phone’s front camera in the seconds after face unlock and uses deep learning to estimate heart rate and resting heart rate in the background.
Google DeepMind announced AI co-clinician research to explore AI agents assisting patient care under clinical supervision. In blinded assessments of 98 real primary-care queries, 97 responses had no critical errors, and doctors preferred them to existing evidence-synthesis tools. Across 140 consultation skills, AI matched or exceeded primary-care doctors on 68, but expert doctors were better overall at recognising red flags and guiding key physical examinations.
Google released PaperVizAgent for paper illustrations and ScholarPeer for automated peer review. PaperVizAgent combines retrieval, planning, style, visualisation and review agents, scoring 60.2 on a 0–100 evaluation, ahead of GPT-Image-1.5, Nano-Banana-Pro and Paper2Any. It was the only framework above the 50.0 human baseline.
The AIMS collaboration between Google Research and several NHS organisations published two companion studies in Nature Cancer evaluating an AI breast cancer detection system within NHS screening workflows.