|
The goal of the Distributed Digital Signal Processing (DDSP) Project is to transform a network of heterogeneous, distributed computing platforms into an array of audio/video sensors and actuators capable of performing complex DSP tasks such as distributed beamforming, audio rendering, audio/visual tracking, and camera array processing. In particular, this requires putting distributed heterogeneous computing platforms with audio-visual sensors into a common time and space coordinate system. Toward that goal, we are investigating ad-hoc synchronization, I/O calibration, sensor/actuator localization, joint audio-video processing, distributed source coding--and distributed signal processing in general--from a system hardware-software angle. The DDSP Project also explores the vast dimension and opportunities offered by the rich media in multiple streams, from multiple channels of audio-to-audio combined with visual data, and/or video and synthetic data. One example is a distributed microphone array instantiated in an ad-hoc fashion from all wirelessly connected laptops in a conference room, or a self-synchronized system of multiple PCs with audio/video input/output capability to enhance people’s experience in future entertainment and communication.
The project team members has co-organized special sessions in international conferences:
| 
