Multimedia Semiotics

How do verbal, visual, auditory, and tactile-interactional semiotic resources combine and integrate in multimedia productions, systems, and events? How are these resource system co-evolved to integrate with one another? What are the historical traditions in various cultures by which they are conventionally linked or integrated? What kinds of differences in meaning-making typically occur for resources of each type in the context of co-deployment of resources of the other modalities? What possible cross-multiplications of meaning-potential among these systems have not yet been realized by existing or historical systems in various cultures? How can those which have been realized be usefully hybridized for various contemporary projects and agendas?


Source:academic.brooklyn.cuny.edu/education/jlemke/phd-tops.htm