Rhizomatiks Research, ELEVENPLAY, MIKIKO, TAKCOM

Nosaj Thing / Cold Stares ft.

Work Details

LAを拠点に世界で活躍するアーティスト／ビートメーカーのNosaj Thingとラッパー Chance The Rapperのコラボレーション楽曲「Cold Stares」のミュージックビデオ。
歌詞の中で語られている”現実と妄想の境界線を彷徨いながら自分の存在意識、記憶を探す心理状態、葛藤” を映像で表現するために、二人のダンサーによるダンス作品を制作。そのダンスを実写による現実世界とCGによる妄想世界の二つの空間で展開した。
This is a music video of “Cold Stares,” a collaboration between Los Angeles-based artist and beatmaker Nosaj Thing, who is actively working around the world, and rapper Chance The Rapper.
A dance piece by two dancers was produced to express a message in the lyrics——their mental situation and conflict searching for reason of being and memories, wandering along the border between reality and illusion. This dance has been shown in two ways: the real world performed by people and the delusional world of CG.

Work Technical Details

software

カメラ搭載の映像合成用のドローンとドローン制御、そして映像合成ソフトウェア、及び既存CGソフト(Mayaなど)との連携プラグインを開発。モーションキャプチャー技術を用いてドローン及びカメラの位置・角度をプログラム制御しながら、CG合成用のカメラデータも同時に記録。
撮影時に取得したデータを既存のCGソフト上で使用することによって大幅な工程の短縮を実現した。
A plug-in has been developed to link a drone equipped with a camera for synthesizing video images, drone control, image synthesizing software, and existing CG software (e.g. Maya). While controlling with a program the position and angle of the drone and the camera using the motion capture technology, the camera data for synthesizing CG are recorded at the same time.
The significant reduction of the process has been realized by using the acquired data at the time of shooting on the existing CG software.
現実世界のダンサーは6台のドローンに取り付けたカメラでのみ撮影。妄想、幻覚の世界のダンサーは64台のカメラで撮影。
複数の2Dデータから3Dモデルを復元する技術を用いてテクスチャのクオリティが高い3Dモデルを生成。
Dancers in the real world are shot by cameras set on six drones. Dancers in the world of illusion are shot by 64 cameras.
Using technology for restoring 3D models from plural 2D data, 3D models with a high quality of texture can be achieved.
現実、妄想(仮想)、二つの世界のカメラのモーションは同一のものを使用している。通常、実世界のカメラのモーションは物理的な制約が多いためCGのカメラの様に自由に動かすことは出来ないが、本プロジェクトではCGソフトで作成したカメラのモーションを用いてドローンを動かすことが出来るシステムを開発。
これを用いることでドローンをCGのカメラの様に緻密かつ自由に動かし、かつ実写とCGのトランジションをスムーズに行うことが出来た。
Camera motions used for two worlds of reality and fantasy are identical. It is usually difficult to move a camera motion for the real world as freely as a camera motion for CG due to many restrictions. In this project, however, a system to move drones according to a camera motion created by CG software has been developed.
Using this system, we can move drones accurately and freely like a CG camera. What’s more, we could achieve a smooth transition between live-action and CG.
現実世界のカメラと仮想世界のカメラを
シームレスにモーフィングできるシステムを開発
We created a realtime morphing system between both point of view of real & virtual world.
カメラを取り付けたドローンの動きをレコーディングし、
プレイバック出来るシステムを開発
We created a recording & repeatable feedback system of cam-drone movement.
3Dスキャンデータを利用して
現実世界のカメラと仮想世界のカメラをシームレスに移動
By using 3D scanning data, we could easily switch point of view between real & virtual world.

hardware

ダンサーと一緒にパフォーマンする上で出来るだけ小型でかつ2軸ジンバルカメラ搭載のドローンを独自開発で行った。
ドローンの位置、カメラのロールとピッチはすべて無線でmayaで作られたモーションパスデータによって制御されている。
In order to do a performance with dancers, we created new drones as small as we can. Also, we developed and customized it to hold camera thorugh a gimbal 2 way axis.
A position of the drones, and roll and pitch of camera movement is controlled by a motion path data, which is generated on Maya.
Technical Requirements
DRONE 001
DRONE 002
DRONE 003
DRONE 004

41cm(W) x 30cm(H) x 41cm(D) / 7inch prop, multiwii based controller / Xbee wireless module
2axis camera gimbal / full color LED light approx.1000g (include battery)
Motion capture system / Drone with camera * 6 / 10m x 10m x 10m space / 50cm x 50cm x 50cm cube / Chair / Bed / Macbook Pro Retina * 2

Drone + AR test

test 01
test 02
test 03

Profile

ELEVENPLAY
ELEVENPLAY
Dance company directed by choreographer & art director, MIKIKO. ELEVENPLAY was founded by MIKIKO in 2009, in the hopes of creating dancers who posses highly artistic sense and creativity on top of exquisite techniques, body and spirit. Composed of female dancers from a variety of genre, ELEVENPLAY's methods of expression are diverse, including stages, video works, and still photos.
http://elevenplay.net/
Rhizomatiks Research
Rhizomatiks Research
Rhizomatiks Research mainly takes up projects focusing on the field of research and development, and sets priority in opening a new expression for the future. The team which is leading Rhizomatiks Research, has produced projects with artists such as Perfume and Elevenplay in addition to media-art and data-art projects, and is also in charge of all processes through the projects―planning, implementation and operation.
http://www.rzm-research.com/
MIKIKO
MIKIKO
Stage Designer, Choreographer. MIKIKO, a stage designer/choreographer, has taken an artistic direction and choreographed almost fifty artists and world popular Japanese artists like Perfume, BABYMETAL, Ringo Shiina and more. She won many prizes, and her choreography is outstanding in the scene of Japanese Pop­music. MIKIKO is one of the most greatest choreographer and represents Japan. Also, as choreographer/director of dance company "ELEVENPLAY", she has been building up her very own creative world of MIKIKO with the company's highly talented dancers.
http://www.mikiko0811.net/
TAKCOM(takafumi tsuchiya)
TAKCOM(takafumi tsuchiya)
Motion Picture & Art Director. He has garnered acclaim worldwide,through exposure in many countries via gallery exhibitions & art festivals. His variety of media formats pursues new forms of expression. His detailed illustrations are renown. In 2013, he awarded the Cannes Lions international Festival of Creativity Cyber Division Silver Award for “Mori building Roppongi Hills­Tokyo City Symphony”(video production),ADFEST PROMO LOTUS GOLD Award,and the D&AD Yellow Pencil award.
http://www.takafumitsuchiya.com/

Credit