When virtual production and, in particular, mixed reality production took flight in early 2020 ARRI and ROE Visual came into contact and connected to develop a better understanding of the impact of this technology on both LED volumes and camera performance. This mutual understanding has led to the development of a continuous testing program.
Early 2020, when Europe had to face the first COVID-19 measures, it became clear for ARRI and ROE Visual that virtual production would become an essential technology. Both companies, leading in respectively image caption and LED technology, realized they are a vital link in the chain in developing and disseminating knowledge in this field.
Not put off by the impossibility of meeting regularly, and in person, the ARRI and ROE Visual teams gradually developed the idea of a joint testing program. Working under NDA to protect the intellectual property involved, both companies created a safe and open environment wherein the technical teams could openly share their thoughts and insights.
“We started this cooperation just by spending some hours on zoom immersing ourselves in the related professional fields and becoming familiar with each other’s technology. This exchange of knowledge was beneficial,” explains Victor Kortekaas, Technical Director for ROE Visual Europe. Soon we realized we did touch on the same subjects, only had not yet developed a common vocabulary to describe it”.
The cooperation resulted in the implementation of two identical test environments, one in Ismaning near Munich at the premises of ARRI, one in Leek at ROE Visual Europe. These set-ups comprise a Ruby LED wall and an AMIRA camera. The involvement deepened during the regular recaps of the technical teams, led by Victor Kortkaas and Andreas Oestreich, responsible for Software Development for Mixed Reality Production Solutions at ARRI, and touching on LED panel and camera behavior.
“It was basically about what happens internally in the LED volume and the camera, testing from theory to practice. But we also tested color and color processing, how the color gamut relates to the camera’s capabilities, how to optimize syncing the LED with the camera shutter, and gamma curves. We also were able to test topics like artifacts, scan lines, refresh rates, and multiplexing”, continues Kortekaas.
“One of our key findings, particularly interesting for ARRI, was the behavior of rolling shutter sensors, often used in cine productions, in combination with LED walls. There was a common sentiment that rolling shutters are not suited in mixed reality productions. Our research proved differently. By optimizing the timing of the camera and the LED volume, it became clear that the use of a rolling shutter was not a limitation”, comments Andreas Oestreich. “In addition, we also found a way to reduce common artifacts by offsetting the synchronization correctly, therefore aligning the exposure time of the camera with the refresh cycle of the LED and enabling the full camera sensor.”
Based on the results achieved so far, it is indisputable that ARRI and ROE Visual will continue and intensify the collaboration and prolong their testing program.
“Our goal for the future is to continue our research on the deepest possible levels. In doing so, we strive to obtain optimum integration between systems resulting in a more user-friendly experience”, states Oestreich. “For ARRI, the collaboration with ROE Visual is another important step to offer our customers the best possible solutions for mixed reality applications.”
About ROE Visual
Founded in 2006, ROE Visual manufactures unrivalled, award-winning LED Display technology for a broad range of applications, like touring productions, broadcast, film, live and virtual events, corporate, architectural, retail, control room and many more.
ROE Visual products are used by the largest touring artists as well as spectacular broadcast events, retail and architectural installations. ROE Visual products offer maximal creativity, ease-of-use, durability and visual excellence.
ROE Visual has several operational bases; the lead manufacturing facility in Shenzhen, China and additional sales offices and service centers in Europe and the United States. The company enjoys relationships with leading global AV Installers, rental companies and other notable partners in the production, film and event industry.
ROE Visual is known to offer expert knowledge in LED display technology and extensive support on a global scale through its American, European and China based teams.
“Inspiring images. Since 1917.” ARRI is a global player within the motion picture industry, employing around 1,200 staff worldwide. Named after its founders August Arnold and Robert Richter, ARRI was established in Munich, Germany, where the headquarters is still located today. Other subsidiaries are in Europe, North and South America, Asia, and Australia.
The ARRI Group consists of the business units Camera Systems, Lighting, and Rental, all dedicated to connecting creativity and future technologies for moving images. ARRI is a leading designer and manufacturer of camera and lighting systems as well as system solutions for the film, broadcast, and media industries, with a worldwide distribution and service network. The portfolio includes digital cameras, lenses, camera accessories, archive technologies, lamp heads, and lighting accessories. Along with offering exclusive technologies, ARRI Rental’s first-class services and equipment provide camera, lighting, and grip packages to professional productions around the world.
The Academy of Motion Picture Arts and Sciences has recognized ARRI’s engineers and their contributions to the industry with 19 Scientific and Technical Awards.