Reflector
Autonomous AI engine that edits film in continuous real time

An autonomous AI engine that arranges and edits film in continuous real time. Putting this computer program in the editor’s seat opens new doors to innovative ways of filmmaking. 

Artificial intelligence is widely used in the production and distribution of films, with algorithms “deciding” when to release them to maximize audience size. Computers running hundreds, if not thousands, of scripts know in advance whether a film is going to be a hit or a flop. Statistically, AI can predict box office success three times more accurately than humans, and that includes highly experienced producers.

Based on never used footage, shot by twice Oscar-nominated director James Longley, depicting the life and trials of Pakistani orphans, the team trained an AI to edit and assemble an artistic documentary, which raises questions about what makes a film human and how we may collaborate with deep learning algorithms to expose new truths about our world. Reflector is the next step in the integration of AI into the film industry. 

RNDR developed the Reflector installation to show a glimpse of the potential role of machines in documentary and arthouse film production, and to find common ground for dialogue among filmmakers about the future of film as an art form. The initial outcomes were presented as an interactive installation at IDFA DocLab 2019. Reflector is part of the larger research project Kaspar initiated by Piotr Winiewicz, authored by Piotr Winiewicz and Dawid Gorny and produced by Mads Damsbo, Makropol.

The installation visualises how an AI chooses the different scenes as a dynamic treemap with indications of how the different scenes scoreon certain parameters. Visitors can also influence the edit of the documentary by changing three different parameters (shot length, shot colour, shot framing) on a touch screen. These three parameters stand for the total about 30 different parameters that are used to classify the scenes.

Interactive visualisation and interface to show scene ranking based on certain parameters
Visualisation of all the scenes in the database

BACKGROUND ON THE CINEMATOGRAPHY
Piotr Winiewicz acquired the rights to use more than 60 hours of pristine material shot in Pakistan in 2010 and 2011 by James Longley. Longley intended to tell the story of a country torn by war and an everlasting domestic and international conflict, through the eyes of the young boys of a forgotten orphanage. The raw material is rich, characterized by beautiful cinematography by Longley.

He envisioned the project as a feature length film, but following American CIA agent Ryan Davis’ scandal, events took a different turn. All American citizens were sent away from Pakistan including the director, who never got to finish shooting his film. The existing material is nevertheless ideal for a short­format documentary. When looking at the raw material shot by James Longley in Pakistan we immediately see the footages potential to assemble into an important film. A film that could give us an inside look at Pakistan. We believe in the idea that if you can understand some part in detail, it makes it easier to comprehend the complexity of the whole. Longley wanted to reconstruct the internal world of the orphans at Faizul Islam as a cinematic experience, and through their perspective to make a film that would bring audiences closer to understanding Pakistan as a society ­by seeing some part of it in detail.

We share his ambition for the film and acknowledge the fact that due to economical, political reasons and significantly complex film production processes, some films and their stories remain untold. It is a chance to tell a relevant story and pay respect to the hard work of the filmmaker and at the same time reveal an innovative approach to documentary filmmaking.

Reflector timeline visualisation
Date
2019
Location
Tolhuistuin, Amsterdam
Directors
Piotr Winiewicz, Dawid Gorny,RNDR
Production
Co-production
Key collaborator
Anton Marini
Executive producer
Jakob Høgel
Cinematography
James Longley
Editing
Kaspar
Design and coding
Developer
Rasmus Ravn Frost, Esbern Torgard Kaspersen
Sound Design
Rebekka Bohse Meyer
Screening copy
Winner
2019 Film Fund DocLab Interactive Grant

Nominated
Nominated Immersive Non-Fiction competition
Nominated
IDFA Competition for Creative Use of Archive
OPENRNDR
Open source framework for creative coding
Read more
NOWHERE
Imagining The Global City
Read more
Climate Layers
Visualising the impact of climate stressors
Read more
Who is We?
Draw your own exhibition
Read more
I Know...
A Digital Ritual for the online edition of Holland Festival 2020
Read more
Quarantine Stories
A platform that collects stories of isolation as a result of home-quarantining in efforts to reduce the effects of COVID-19
Read more
Load more

Studio

RNDR is a design studio for interactive media that develops ‘tools’ that are only finished by how they are used.

To achieve this, we develop processes, create structures, design visualisations, code programs, and create interactions. The end result can manifest itself across different media, ranging from interactive installations, data visualisations, generative identities, prints and everything in between – often real-time. We are triggered by how information and technology transforms networks, cultures, societies, relationships, behaviours, and interactions between people. Our work explores and engages with hybrid space as it embraces both digital and physical realms.

RNDR was founded in 2017 in The Hague, (NL). Its main members have years of experience as partners, computer scientists, designers, art directors and developers at LUST and LUSTlab.

One of our core projects, and basis for most of our projects, is OPENRNDR, an open source framework for creative coding –written in Kotlin for the JVM– with over nine years of development, that simplifies writing real-time audio-visual interactive software. OPENRNDR is fundamental for the capacity of RNDR as a studio, as it allows us to realize complex interactive works. OPENRNDR was awarded the Dutch Design Award 2019

Fields of work
Interactive design (ui/ux), data visualisation, information systems, software tools, interactive installations, media architecture, immersive experiences, interface design, visual identities, generative video, creative coding, exhibition design, graphic design systems, hybrid spaces and platforms, machine learning and artificial intelligence (ai), code and design workshops.

People
Jeroen Barendse (NL), partner. Design and art direction. Former partner of LUST and LUSTlab. Awarded BNO Piet Zwart Oeuvre Prize 2017
Edwin Jakobs (NL), partner. Computer scientist, creative coder and visual artist. Creator of OPENRNDR
Boyd Rotgans (NL), partner. Creative coder & interaction designer
Viola Bernacchi (IT). Design & data visualisation
Els van Dijk (NL), Office manager
Derrek Chow (CA), University of Waterloo, Waterloo, intern, 2021
Rein van der Woerd (NL), Data Art Technology Arnhem, Artez, intern, 2021
Previously at RNDR
Marco Dell'Abate (IT), Royal Academy for the Arts, The Hague, intern, 2021
Jon Packles (USA), intern Parsons School of Design | The New School, and freelance, 2021
Jasper Kamphuis (NL), Intern, Willem de Kooning Academy, Rotterdam, 2020
Ferdinand Sorg (DE), Intern, Hochschule für Gestaltung Schwäbisch Gmünd , 2020
Jaekook Han (KR), Intern, Graduate Interactive Telecommunications Program, NYC, 2019
Gábor Kerekes (HU), Developer, 2017-2019
Amir Houieh (IR), Developer, 2017-2018
Łukasz Gula (PL), Intern, Royal Academy of Art, The Hague, 2018
Noemi Biro (RO), Intern, Willem de Kooning Academy, Rotterdam, 2018
Selection of exhibitions
Perpetual Beta; Encounters in open space, The Grey Space, The Hague, 2021
Open Highway, Raum, Utrecht, 2018
Typojanchi Typography Biennale Seoul, main exhibitor (as LUST), 2017
Cartographies of Rest, interactive installation at Mile End Art Pavilion in London (as LUST), 2016
Hyperlocator, What’s next, Future Tomorrow, 38CC Delft (as LUST), 2016
Type/Dynamics exhibition, Stedelijk Museum Amsterdam (as LUST), 2014
Selection of lectures
Lecture Information Design masters. Design Academy Eindhoven, 2021
Talk for Graphic Days Turin, Eyes on the Netherlands (IT), 2021
Lecture for TAAALKS conference, Munich, 2020
Presentation at GitHub Satellite, 2020
Lecture at Britisch Library for Central Saint Martins' Form, Reform, Perform: futures of writing, 2019
MiXit conference, Lyon, 2019
Google Span conference, presentation and demo, Helsinki, 2018
JFuture conference, Minsk, 2018
Creative Coding Utrecht, Launch of OPENRNDR, 2018
Selection of workshops
Workshop OPENRNDR for Graphic Days, Turin (IT), 2021
OPENRDNR workshop for Digital Society School, Amsterdam, 2020
Weeklong workshop OPENRNDR @Politecnico di Milano, 2020
OPENRNDR x Machine Learning workshop @ KABK during Tech Week, 2020
Two week OPENRNDR workshop at Tumo, Armenia, 2019
Workshop OPENRNDR at Artez Interaction Design, Arnhem, 2019
Processing Community Day 2019, CCU and Sensorlab, Utrecht, 2019
Royal Academy of Art (KABK), Techweek, The Hague, 2019
Utrecht School for the Arts (HKU), OPENRNDR workshop, 2018
La Scuola Open Source, 1-week workshop, Bari, Italy, 2018
Two-week workshop at TUMO foundation, Yerevan, Armenia, 2019

Contact

RNDR

Paviljoensgracht 20
2512 BP, The Hague
+31 (0)70.3635776

info@rndr.studio


INTERNSHIPS

We are mostly looking for interns that have a background in interactive design. Some experience in coding is preferred. 

interns@rndr.studio

OPENRNDR
Open source framework for creative coding that simplifies writing real-time interactive software

info@openrndr.org
openrndr.org