Squarepusher BTS

Music video “Terminal Slam” is a subversive video where all the ads around the city is deleted or replaced with the ones related to Squarepusher. Inspiration behind this is Daito Manabe’s thought that the scenery in the city will become rewritable with AR/MR glasses In the near future, as seen in the video.
With machine learning technologies,

• - Object Detection (to recognize the position of objects in the image)
• - Semantic Segmentation (to classify the segment of the image into categories based on meaning of each pixels by labeling every pixels)
• - Image Inpaint (image restoration technique)

are applied to create the video.
Also, masks are generated from those data to add optical camouflage effects in post-processing such as glitch effect only on the areas where humans are.

Since such detection to extract only ads was not possible yet with current machine learning technologies, some operations had to be done by hands. But it is expected that those operations also can be automated within the near future.

Below are footage used in the video, footage added with the effects, and some open source code that was actually used.