On-set virtual production

On-set virtual production (OSVP), also known as virtual production (VP), or In-Camera Visual Effects (ICVFX),[1] often called The Volume is a technology for television and film production in which LED panels are used as a backdrop for a set, on which video or computer-generated imagery can be displayed in real-time. The technology has become famous with the development of ILM's StageCraft and its use in The Mandalorian.[2]

"Virtual studio" redirects here. For the audio interface standard, see Virtual Studio Technology. For the former film company, see Virtual Studios.

Technology

With careful adjustment and calibration, an OSVP set can be made to closely approximate the appearance of a real set or outdoor location.[3] OSVP can be viewed as an application of extended reality. OSVP contrasts with virtual studio technology, in which a green screen backdrop surrounds the set, and the virtual surroundings are composited into the green screen plate downstream from the camera, in that in OSVP the virtual world surrounding the set is visible to the camera, actors, and crew, and objects on set are illuminated by light from the LED screen, creating realistic interactive lighting effects, and that the virtual background and foreground are captured directly in camera, complete with natural subtle cues like lens distortion, depth of field effects, bokeh and lens flare. This makes it a far more natural experience that more closely approximates location shooting, making the film-making process faster and more intuitive than can be achieved on a virtual set.

To render parallax depth cues correctly from the viewpoint of a moving camera, the system requires the use of match moving of the background imagery based on data from low-latency real-time motion capture technology to track the camera.

Industry organizations including SMPTE, the Academy of Motion Picture Arts and Sciences and the American Society of Cinematographers have started initiatives to support the development of OSVP.[3][4][5][6]

History

Since its inventive use in The Mandalorian, the technology has become increasingly popular. Miles Perkins, industry manager of film and TV for Epic Games and maker of the Unreal Engine, states: "We are tracking roughly 300 stages, up from only three in 2019”.[7]

Stages that use OSVP include the various StageCraft stages, Pixomondo’s Toronto-based LED stage, which has a longterm lease from CBS or Lux Machina various stages.[7]

Productions using the technologies

Television series

Feature films

Short films
  • The Vandal (2021)[36]

References
  1. "In-Camera Visual Effects (ICVFX)". www.nepgroup.com. Retrieved 2023-02-04.
  2. Giardina, Carolyn (2022-10-19). "Too Much Volume? The Tech Behind 'Mandalorian' and 'House of the Dragon' Faces Growing Pains". The Hollywood Reporter. Retrieved 2023-02-04.
  3. "2021: The On-Set Virtual Production Initiative". www.smpte.org. Retrieved 2022-02-22.
  4. "Partnering to Develop Advisory Group of the On-Set Virtual Production (OSVP) Initiative". systemscontractor. 2022-01-18. Retrieved 2022-02-22.
  5. "SMPTE Hollywood To Explore Lighting and Color Science For Virtual Production". SHOOTonline. Retrieved 2022-02-22.
  6. "AMPAS Science & Technology Council Presents Virtual Production Primer - The American Society of Cinematographers". theasc.com. Retrieved 2022-02-22.
  7. Giardina, Carolyn (2022-10-19). "Too Much Volume? The Tech Behind 'Mandalorian' and 'House of the Dragon' Faces Growing Pains". The Hollywood Reporter. Retrieved 2023-02-04.
  8. Gartenberg, Chaim (February 20, 2020). "How The Mandalorian teamed up with Fortnite creator Epic Games to create its digital sets". The Verge. Archived from the original on February 20, 2020. Retrieved February 20, 2020.
  9. Lane, Carly (June 9, 2021). "Exclusive: Here's When 'The Mandalorian' Season 3 Is Filming; New Details on 'Book of Boba Fett' Connection". Collider. Archived from the original on June 9, 2021. Retrieved June 9, 2021.
  10. "ILM STAGECRAFT HONORED WITH ENGINEERING, SCIENCE & TECHNOLOGY EMMY® AWARD". Industrial Light & Magic. July 29, 2022. Retrieved July 29, 2022.
  11. Peterson, Karen M. (April 29, 2022). "How 'Our Flag Means Death' Designers Mixed History With Broad Theatricality". Variety. Retrieved July 16, 2022.
  12. Bui, Hoai-Tran (June 17, 2020). "The Obi-Wan Kenobi Disney+ Series Will Use the Same Technology as 'The Mandalorian'". /Film. Archived from the original on June 18, 2020. Retrieved June 18, 2020.
  13. "StageCraft | Industrial Light & Magic". www.ilm.com. Retrieved 2023-02-04.
  14. Dominguez, Noah (November 14, 2022). "Andor Actually Used StageCraft Technology Despite Early Reports". ComicBook.com. Retrieved November 25, 2022.
  15. "HOUSE OF THE DRAGON MAY LOOK TOTALLY DIFFERENT IN SEASON 2 FOR ONE CONTROVERSIAL REASON". Inverse. Retrieved 25 October 2022.
  16. "Inside Dark Bay, the spinning LED volume at the heart of Netflix's upcoming '1899'". TechCrunch. 10 February 2022. Retrieved 20 November 2022.
  17. Fisher, Jacob (June 24, 2021). "'The Acolyte' Aiming To Begin Filming In February In London". DiscussingFilm. Archived from the original on June 30, 2021. Retrieved June 30, 2021.
  18. "MoTA = @cary_fukunaga". www.instagram.com. Retrieved 2023-02-04.
  19. Giardina, Carolyn (June 28, 2022). "'Percy Jackson and the Olympians' Takes ILM Virtual Production Route (Exclusive)". The Hollywood Reporter. Archived from the original on June 28, 2022. Retrieved June 28, 2022.
  20. "Oblivion". Lux Machina. Retrieved 2023-02-04.
  21. Bardini, Julio (2022-08-14). "Industrial Light & Magic's Digital StageCraft Technology: What We Know About the Volume". Collider. Retrieved 2023-02-04.
  22. "Lux Machina Consulting on Instagram: "We had a great time working with Director of Photography Jess Hall on Ghost in the Shell to provide LED green screen replacement for some of the driving scenes in the movie. Contact us for help with any film or television projects! We specialize in capturing realistic environments in camera as part of the visual effects workflow! Pictured: Pilou Asbaek and Scarlett Johansson in Ghost in the Shell from Paramount Pictures and Dreamworks Pictures."". Instagram. Retrieved 2023-02-04.
  23. "How Cutting-Edge ILM Technology Brought 'The Mandalorian' to Life". No Film School. February 5, 2020. Retrieved June 26, 2021.
  24. "The Irishman". Lux Machina. Retrieved 2023-02-04.
  25. "Lux Machina Consulting on Instagram: "Congrats to @starwarsriseofskywalker and @theirishmanfilm for the many Oscar nominations this week, including for Visual Effects! We are so grateful to have been a part of both productions. Looking forward to the big night, Feb 5 live at 8e | 5p! . . . . . . #virtualproduction #incameravfx #vfx #film #technology #videoproduction #led #projection #videoscreens #luxmc #luxmachina #consultants #engineers #programmers"". Instagram. Retrieved 2023-02-04.
  26. Mike Seymour (January 21, 2021). "The Midnight Sky's Virtual Production using StageCraft". Fxguide. Retrieved June 26, 2021.
  27. Filippo Magnifico (December 23, 2020). "In Vacanza su Marte: il film con Boldi e De Sica realizzato con una tecnologia simile a quella di The Mandalorian". Blog Screenweek. Retrieved May 30, 2022.
  28. "The Next Generation of Extended Reality Sounds Stages". Lux Machina. Retrieved 2023-02-04.
  29. Giardina, Carolyn (October 19, 2020). "'The Batman' Using 'Mandalorian' Virtual Production Techniques". The Hollywood Reporter. Archived from the original on October 19, 2020. Retrieved October 19, 2020.
  30. Carolyn Giardina (September 10, 2020). "Industrial Light & Magic Expands Virtual Production Services, Supports 'Thor 4'". The Hollywood Reporter. Retrieved June 26, 2021.
  31. "Lux Machina Consulting on Instagram: "Congratulations to @topgunmovie "Maverick" on its six @theacademy nominations, including Best Visual Effects and Best Picture! It was an honor for @luxmc_ to be part of such an iconic project by providing in-camera virtual backgrounds and working closely with "Maverick's" overall VFX supervisor Ryan Tudhope and Director of Photography @claudiomirandadop We are thrilled at how much the fans, the critics, and now the Academy of Motion Picture Arts and Sciences have responded to the film. The Oscars will be handed out Sunday, March 12, 2023. Get your popcorn ready! (@luxmc_ is part of @nep_group) #vfx #visualeffects #luxmc #awards #oscars #nominations #academy #topgun #NEP #NEPVS #topgunmaverick #sequel #ICFVX #film #photography #directorofphotography"". Instagram. Retrieved 2023-02-04.
  32. Villaverde, Noah (June 8, 2022). "'Black Adam' Director Talks Using Lucasfilm's Volume & Other New Tech". Heroic Hollywood. Retrieved July 19, 2022.
  33. "Lux Machina Consulting on Instagram: "Wishing Eddie Alcazar the best of luck as he heads to #Sundance to premier his newest film "Divinity." A portion of the film was shot using the #LuxMC LED volume, and Junaid Baig, VP of Research & Development for #NEPVS, used AI to provide slow motion footage of already animated stop motion sequences on the film."". Instagram. Retrieved 2023-02-04.
  34. Erao, Math (May 17, 2021). "Ant-Man and the Wasp: Quantumania Director Shares Photo From The Mandalorian's Virtual Set". Comic Book Resources. Archived from the original on May 17, 2021. Retrieved May 17, 2021.
  35. Couch, Kim Masters,Scott Feinberg,Aaron; Masters, Kim; Feinberg, Scott; Couch, Aaron (2023-01-09). "Francis Ford Coppola's 'Megalopolis' in Peril Amid Ballooning Budget, Crew Exodus (Exclusive)". The Hollywood Reporter. Retrieved 2023-02-04.
  36. "Lux Machina Consulting on Instagram: "What does it take to make an award winning film? We're glad you asked! Watch the new behind the scenes video and find out how the creative artists were able to seamlessly blend live action video with stop-motion for @eddiealcazar 's #VimeoBestOfTheYear award-winning short film "The Vandal." In "The Making of The Vandal," you'll see how we used our #LUXMC LED stage and interactive lighting sources for the miniature photography. Watch "The Making of The Vandal" via the link in our bio."". Instagram. Retrieved 2023-02-04.


This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.