Needless to say, this is not how human intelligence works. Human intelligence is compositional, which means you can understand the cross product of two spaces without being explicitly exposed to a dense sampling of data pairs from those spaces. When reading a book, most people can visually picture what's going on, no matter how far from everyday reality the text gets -- and these people were never exposed to billions of explicit text:video pairs. In fact, they were exposed to virtually no such data.