Camera Postura
Detecting and matching poses from film fragments

Imagine you can use your body as the start for a search in a movie. Imagine searching for similar films scenes as Rocky’s victory dance on top of the steps just by raising your arms.

A non-linear way of experiencing movies
Film, by definition, is linear, the narrative unfolds itself over time. However, using motion tracking methods we can introduce a new way to interact with film-based footage. Rather than surrendering to the screen as a passive viewer, users can penetrate an archive of movies from a new perspective. This subversion of the traditional film/viewer relationship brings unexpected juxtapositions and a more engaging interaction.

The unpredictable nature of physicality brings an element of freedom into an often static and methodical activity. In its most complex form, after an analysis has been carried out on archival footage, the users body position is recorded in real-time, and matched directly with film clips.

Documentation of the Camera Postura project

While films tend to be linear, databases are more unpredictable. Unforeseen associations emerge as one navigates them, recalling the action of strolling across some archive with its associated lot of discoveries. Yet, databases precisely lack this embodied, strolling dimension. Each path within the database is amplified by cinematic expansions of color values and acoustic enhancements that trigger nothing but a fiction of mastery – fiction that obnubilates the actual experience of the archive.

The point of departure was the idea to explore the inherent cinematic quality of the database, while pushing film away from its linear self. By transforming the ‘filmbase’ into a mirror that is responsive to the body as a whole, the experience of the films and the one of their selection are “folded” together. The database is reincarnated — becoming endowed with the archive and cinema’s bodily dimension — while films are endued with the archive’s collage-like structure — jumping across all scenes and shots alike. A posture initiates a search request, a movement a transition between two films and information then reveals itself insofar as it is given a body — the user’s.

Navigator
In a more functional form, motion tracking can also be used as a navigation tool. You use your hands and body to search through the archive. Essentially you are the playhead, cutting a path through vast amounts of imagery. Context is challenged and new narratives are pieced together from fragments, triggering the mind in new ways.

Examples of different postures

After an analysis has been carried out on archival footage, the user’s body position is recorded and matched with film clips. You make a movement and that movement is repeated in film. These scenes are then augmented with additional information, such as actor names, locations, tweets and film reviews of the movie. Each pose results in different matched scenes creating unique film posters at each visit.

Overview of generated posters
Examples of generated posters
Date
2014
Location
Utrecht
Commissioned by
Nederlands Film Festival
Design and interaction
Furniture design
Gebr. Bosma, Utrecht
Supported by
Vevam foundation
OPENRNDR
Open source framework for creative coding
Read more
UNCODE
Interactive real-time installation exposing the mechanics of creative coding for Electric Castle Festival, 2019
Read more
No_Code: Shelter
Graphical language for an exhibition at Salone del Mobile 2019, Milano
Read more
The Blue Front
Using archives to dig-up locations of air attacks on the North Sea from World War II
Read more
Open Highway
A real time light installation visualizing highway vehicles in scale 1:1
Read more
Load more

Studio

RNDR is a design studio for interactive media that develops ‘tools’ that are only finished by how they are used.

To achieve this, we develop processes, create structures, design visualisations, code programs, and create interactions. The end result can manifest itself across different media, ranging from interactive installations, data visualisations, generative identities, prints and everything in between – often real-time. We are triggered by how information and technology transforms networks, cultures, societies, relationships, behaviours, and interactions between people.

RNDR was founded in 2017 in The Hague, (NL). Its main members have years of experience as partners, computer scientists, designers, and developers at LUST and LUSTlab.

One of our core projects, and basis for most of our projects, is OPENRNDR, an open source framework for creative coding –written in Kotlin for the JVM– with over seven years of development, that simplifies writing real-time audio-visual interactive software. OPENRNDR is fundamental for the work and software capacity of RNDR as a studio, as it allows us to realize complex interactive works.

People
Jeroen Barendse (NL), partner. Design and art direction. Former partner of LUST and LUSTlab. Awarded BNO Piet Zwart Oeuvre Prize 2017
Edwin Jakobs (NL), partner. Computer scientist, creative coder and visual artist. Creator of OPENRNDR
Boyd Rotgans (NL), partner. Creative coder & interaction designer
Viola Bernacchi (IT). Design & data visualisation
Els van Dijk (NL), Office manager
Ferdinand Sorg (DE), Intern
Previously at RNDR
Jaekook Han (KR), Intern, Graduate Interactive Telecommunications Program, NYC, 2019
Gábor Kerekes (HU), Developer, 2017-2019
Amir Houieh (IR), Developer, 2017-2018
Łukasz Gula (PL), Intern, Royal Academy of Art, The Hague, 2018
Noemi Biro (RO), Intern, Willem de Kooning Academy, Rotterdam, 2018
Selection of exhibitions
Open Highway, Raum, Utrecht, 2018
Typojanchi Typography Biennale Seoul, main exhibitor (as LUST), 2017
Cartographies of Rest, interactive installation at Mile End Art Pavilion in London (as LUST), 2016
Hyperlocator, What’s next, Future Tomorrow, 38CC Delft (as LUST), 2016
Type/Dynamics exhibition, Stedelijk Museum Amsterdam (as LUST), 2014
Selection of lectures
MiXit conference, Lyon, 2019
Google Span conference, presentation and demo, Helsinki, 2018
JFuture conference, Minsk, 2018
Creative Coding Utrecht, Launch of OPENRNDR, 2018
Selection of workshops
Workshop OPENRNDR at Artez Interaction Design, Arnhem, 2019
Processing Community Day 2019, CCU and Sensorlab, Utrecht, 2019
Royal Academy of Art (KABK), Techweek, The Hague, 2019
Utrecht School for the Arts (HKU), OPENRNDR workshop, 2018
La Scuola Open Source, 1-week workshop, Bari, Italy, 2018
Two-week workshop at TUMO foundation, Yerevan, Armenia, 2019

Contact

RNDR

Paviljoensgracht 20
2512 BP, The Hague
+31 (0)70.3635776

info@rndr.studio

interns@rndr.studio

OPENRNDR
Open source framework for creative coding that simplifies writing real-time interactive software

info@openrndr.org
openrndr.org