EN / JA
Music video “Terminal Slam” is a subversive video where all the ads around the city is deleted or replaced with the ones related to Squarepusher. Inspiration behind this is Daito Manabe’s thought that the scenery in the city will become rewritable with AR/MR glasses In the near future, as seen in the video.
With machine learning technologies,
are applied to create the video.
Also, masks are generated from those data to add optical camouflage effects in post-processing such as glitch effect only on the areas where humans are.
Since such detection to extract only ads was not possible yet with current machine learning technologies, some operations had to be done by hands. But it is expected that those operations also can be automated within the near future.
Below are footage used in the video, footage added with the effects, and some open source code that was actually used.
optical camouflage effects to people for privacy reason.
Screen capture images of a Max patch to synchronize glitch effects with audio and compose visuals with machine learning data.
The quality of motion of audio-reactive graphics improves by extracting each of drums and bass separately from 2-ch sound with Spleeter.
We created fake ads of Squarepusher to replace the ones in the city with. Below are some exmaples.