- Detection & Identification of Rare Audio-Visual Cues Project FP6 EU, 2006-2010 ... identifying the relevant from the irrelevant. CMP contributes by the camera tracking and 3D reconstruction for city modeling & by human motion tracking and interpretation. Contact person @ CMP: Tomas Pajdla

Partners:  IDIAP  Research Institute (CH), ETH Zurich (CH), Hebrew University Jerusalem (IL), Czech Technical University Prague (CZ)
                    Von Ossietzky University (DE), Leibniz Institut fur Neurobiologie (DE), KUL Leuven (BE), OHSU Oregon (USA)

[Dirac Project Page | Internal CMP Dirac Page]

Presentations

1. T. Pajdla.  Ideas @ Ice-Breaking Workshop
2. M. Havlena,  Z. Kukelova, H. Bakstein, T. Pajdla.  Omnidirectional Camera Tracking.
3. T. Pajdla & DIRAC WP1 collaborators. Some advances in WP1 in 2008. Zurich 19 Dec 2008.[ ppt | pdf]

WP-1 & Data

1. Dirac-CMPdata-01-Walk Omnidirectional walking sequence, Kyocera FineCam M410R + Nikon FC-E9 (video and audio data)
2. Dirac-CMPdata-02-Walk_stereo Omnidirectional stereo walking sequence, 2x Kyocera FineCam M410R + Nikon FC-E9 (video data, detected regions, camera calibration, image patches, 3 perspective cut-outs)
3. Dirac-CMPdata-03-Leuven First dataset acquired in cooperation with Oldenburg team during the Dirac meeting in Leuven, Fire-I + Sunex DSL 125, hearing aids (video and audio data)
4. Dirac-CMPdata-04-Marlin Images from the test of the Marlin camera at CMP, AVT Marlin + Nikon FC-E9 (video data)
5. Dirac-CMPdata-05-Slow Data for testing the modified KUL SfM framework - extremely slow camera movement, 2x Kyocera FineCam M410R + Nikon FC-E9 (video data)
6. Dirac-CMPdata-06-Ride Data for testing the modified KUL SfM framework - omnidirectional cameras mounted on a car together with perspective DV cameras in order to compare 3D reconstruction results, 2x Kyocera FineCam M410R + Nikon FC-E9, 2x Sony DV (video data)
7. Dirac-CMPdata-07-Audio Audio experiment at CMP, Canon XM-1 built-in stereo microphone (audio data)
8. Dirac-CMPdata-08-Audio_cont Continuation of the audio experiment at CMP, Canon XM-1 built-in stereo microphone (audio data)
9. Dirac-CMPdata-09-Manual Omnidirectional data acquired from a tripod to ensure perfect stereo synchronization, 2x Kyocera FineCam M410R + Nikon FC-E9 (video data)
10. Dirac-CMPdata-10-Awear1 1st AWEAR demonstrator experiment at CMP, 2x Kyocera FineCam M410R + Nikon FC-E9, Canon XM-1 built-in stereo microphone (video and audio data, frontal and 3 perspective cut-outs)
11. Dirac-CMPdata-11-Awear2 2nd AWEAR demonstrator experiment at CMP, 2x Kyocera FineCam M410R + Nikon FC-E9, Canon XM-1 built-in stereo microphone (video and audio data, pedestrian cut-outs, face cut-outs)
12. Dirac-CMPdata-12-Awear3 3rd AWEAR demonstrator experiment at CMP in cooperation with OL, 2x Kyocera FineCam M410R + Nikon FC-E9, 2x USB microphone, 2x hearing aid, clip, and headset (video and audio data, face cut-outs)
13. Dirac-CMPdata-13-Awear4 4th AWEAR demonstrator experiment at CMP in cooperation with OL, 2x Kyocera FineCam M410R + Nikon FC-E9, 2x USB microphone, 2x hearing aid, clip, and headset (video and audio data, face cut-outs)
14. Dirac-CMPdata-14-Gonstop Data for the sufficient camera movement detection experiment, 2x Kyocera FineCam M410R + Nikon FC-E9 (video data)
15. Dirac-CMPdata-15-Face Data for the gender recognition experiment acquired in cooperation with OL during the Dirac meeting in Zurich, Kyocera FineCam M410R + Nikon FC-E9, 2x hearing aid, headset (video and audio data, face cut-outs)
16. Dirac-CMPdata-16-Awear5 5th AWEAR demonstrator experiment at OL in cooperation with OL, 2x Kyocera FineCam M410R + Nikon FC-E9, 2x hearing aid, clip, and static microphone (video and audio data)
17. Dirac-CMPdata-17-Oldenburg AWEAR 2.0 calibration, 2x AVT Stingray F-201C + Fujinon FE185CO86HA1, 4x T.Bone EM700 (video and audio data)
18. Dirac-CMPdata-18-Awear6 6th AWEAR 2.0 experiment at OL in cooperation with OL, 2x AVT Stingray F-201C + Fujinon FE185CO86HA1, 4x T.Bone EM700 (video and audio data)
19. Dirac-CMPdata-19-Awear7 7th AWEAR 2.0 experiment at OL in cooperation with OL, 2x AVT Stingray F-201C + Fujinon FE185CO86HA1, 4x T.Bone EM700 (video and audio data)

WP-6

1. Omni-Camera-Designs - Dirac image acquisition sensor designs
2. Omni-Camera-Specs-01 - Dirac image acquisition sensor specifications for the first demonstrator
3. Omnidirectional camera tracking - Dirac image acquisition demonstrator

Meetings

1. Ice Breaker Workshop Prague 25-26 March 2006

Dissemination, related projects

• BeNoGo - BeNoGo - "Being There - Without Going", IST-2001-39184, 2002-2005
• Neovision s.r.o. manufactures panoramic optics, acquisition hardware

CTU Team