Skip to content

Multimodal

Abilities beyond text: visual understanding, mixed image and text, and audio and video input and output.

Latest selected

21–40 of 47

Jul 23

Thursday

Jul 21

Tuesday

Jul 15

Wednesday

Jul 8

Wednesday
  1. Introducing Robostral Navigate

    Mistral AI released its first embodied navigation model, Robostral Navigate. The 8B model uses one ordinary RGB camera without LiDAR or depth sensors, achieving 76.6% success in unseen R2R-CE validation environments, 9.7 percentage points above the best single-camera approach and 4.5 points above the best depth- or multi-camera system.

Jul 1

Wednesday

Jun 23

Tuesday
  1. Introducing Mistral OCR 4

    Mistral released OCR 4, returning bounding boxes, block-type classifications and per-page and per-word confidence alongside text extraction. It supports 170 languages and single-container self-hosting. Independent annotators preferred OCR 4 on average 72% of the time in blind evaluations of over 600 documents. It scored 85.20 on OlmOCRBench and 93.07 on OmniDocBench, though Mistral warns both benchmarks have known scoring limitations.

Jun 9

Tuesday

Jun 5

Friday

May 18

Monday
  1. Introducing Gemini Omni

    Google DeepMind released Gemini Omni Flash, the first model in the Gemini Omni family, generating high-quality video from combined image, audio, video and text inputs and supporting iterative video editing through natural-language conversations.

May 17

Sunday

May 16

Saturday

Apr 30

Thursday
  1. Enabling a new model for healthcare with AI co-clinician

    Google DeepMind announced AI co-clinician research to explore AI agents assisting patient care under clinical supervision. In blinded assessments of 98 real primary-care queries, 97 responses had no critical errors, and doctors preferred them to existing evidence-synthesis tools. Across 140 consultation skills, AI matched or exceeded primary-care doctors on 68, but expert doctors were better overall at recognising red flags and guiding key physical examinations.

Apr 16

Thursday

Apr 13

Monday

Apr 3

Friday

Mar 25

Wednesday

Mar 18

Wednesday