Skip to content

Start Here: The Plan

What multimodal means, and how images and audio become numbers.

0 of 3 complete

  1. ▶ Up next10 min+50 XPWhat multimodal means, and the planHow models handle images, audio, video and documents by turning them into tokens or vectors, what that costs, the…
  2. 15 min+50 XPImages as numbers: pixels, channels and patchesWhat an image is to a computer, how colour channels and resolution set the data size, how vision models cut images…
  3. 15 min+50 XPAudio as numbers: samples, frames and why speech is latency-sensitiveWhat digital audio is, how sample rate and bit depth set the data size, how models cut audio into frames, and why a…