The CBC Newsworld Holodeck

banner

The CBC Newsworld Holodeck utilizes the GestureTek software system and Microsoft Kinect to sense the user’s gestures, enabling interaction with multi-screen video display. Video data communicates with the gesture-based library through an open-source C++ toolkit, which allows flexibility of video control, animation, and speed optimization. The Kinect searches for the user’s hand; upon detecting the gesture the system calls an action that corresponds to that gesture. The called action selects a video, plays that video, which initiates keywords to populate the screen, or hides them during video playback, enabling focused viewing.

Keyword/phrase selection takes the viewer directly to the selected video clip (enabled by natural language processing technologies), a novel interaction in video browsing, search and display. The Holodeck interface enables gestural interaction, and rich, context-aware browsing and search of the CBC Newsworld ‘big data’ video corpus.

WEBSITES

Demo video https://www.youtube.com/watch?v=cgI9Mxwoc7A

Mobile Lab http://research.oacdu.ca/mobilelab/project/cbc-newsworld-holodeck

CIV-DDD http://www.civ-ddd.ca/project/cbc-newsworld-project/

PRINCIPAL INVESTIGATORS

Martha Ladly, PhD

Gerald Penn, PhD

INDUSTRY PARTNER

GestureTek

INSTITUTIONAL PARTNERS

CBC Newsworld

Carleton University Libraries

CIV-DDD

OCAD University

University of Toronto

RESEARCH ASSISTANTS

Cathy Chen

Bryn A. Ludlow

Ana Jofre, PhD

Siavash Kazemian

 

PAST RESEARCH ASSISTANTS

Ruzette Tanyag

Pavika Chintraruck (Pui)

Jessica Peter

Pei Zhou (Peggy)

Maziar Ghaderi

Funding: