Camera/vision agent for film/video production

Application Number 006

Yakup Paker

Queen Mary and Westfield College

Advanced multimedia applications, such as virtual studios, require handling of video streams, coming at real time rates from a number of cameras, to be combined within a production environment, for example for mixing, which is then composited with other elements such as a synthetic component to form a sequence which is then broadcast or stored. The functionalities required from the cameras is the visual representation of the real world as seen by the eye in order to recreate this world by transmitting to another point in space or to extract some information such as an object in the scene or determining the position of the camera. Thus agent technology is appropriate to handle what we could express as the the "intelligent eyes" to retrieve reality in order to transmit or recreate a real, augmented reality or totally virtual world. A possible camera/vision agent could take the following form.

Functionalities:

-2D video manipulations: mixing, fading, etc.

-Object extraction/ chroma keying

-Feature extraction tracking

-Single view/ multiple view/stereo

-Compositing

Applications:

-TV production live/pre-recorded

-Virtual studio

-Enhanced reality

-Tele-conferencing, cooperative working

-Shared Virtual Reality