A Seamless Mixed Reality System between
The Real World and The Virtual World

Perfume Live "STORY (SXSW-MIX)"(NO POST PRODUCTION !! )

■ A Realtime Seamless Morphing between Multiple Cameras utilizing Preliminarily Scanned 3D Models

■ A Realtime Seamless Transition between The Real World and The Virtual World utilizing Preliminarily Scanned 3D Models

■ A Realtime Automatic Projector Calibration with a 3D Model Data and 3D Tracking Data

3D Scanned Image

Abstract

Perfume appeared as headliner on March 17, 2015, the opening day of SXSW Music and the final day of SXSW Interactive.

The technical production in this live performance going back and forth between the live venue and the virtual world beyond time and space has been developed by members centering around stage and movie director MIKIKO (elevenplay), which highly integrates 3D scanning, motion tracking and video morphing technologies.
The event was live-broadcasted on YouTube, including the technical production mentioned above.

The performance for five minutes bringing out the best of physical abilities of three Perfume members with MIKIKO’s complete, meticulous direction immediately became a topic of conversation in the world, and indicated a new course of action in the world of entertainment using augmented reality and virtual reality technologies.

Perfumeが、SXSWミュージックの初日かつ、SXSWインタラクティブの最終日となる2015年3月17日にヘッドライナーで登場。

本ライブパフォーマンスの中継映像のために3D Scan Technology, Motion Tracking Technology, Video Morphing Technology, を複合的に組み合わせ、リアルなライブ会場と時空を超えたバーチャルの世界をシームレスに行き来するテクニカル演出をStage and Movie Director MIKIKO(elevenplay)を中心としたメンバーで開発しYouTubeで生中継を行った。

MIKIKOによる緻密で密度の濃い演出と、Perfumeの3人の身体能力を活かした5分間のパフォーマンスはすぐさま世界中で話題となり、Augumented Reality, Virtual Realty技術を用いたエンターテイメントの新たな方向性を示した。

Credit

Stage Direction, Movie Direction and Choreograph
MIKIKO (elevenplay)
Technical Direction and Programming
Daito Manabe (Rhizomatiks)
Produce , Creative Direction
Kaoru Sugano (dentsu)
Camera System Development and Programming
Yuya Hanai (Rhizomatiks)
Technical Direction
Motoi Ishibashi (Rhizomatiks)
Technical Support
Crescent,inc and Ray Corporation