DIPS for Max: Digital image Processing with Sound

Since 2000, I am supervising the development of DIPS (Digital Image Processing with Sound), which is free plug-in software for Max/MSP. DIPS is a powerful and user-friendly programming tool for the creation of interactive multimedia art, supporting interaction between sound events and visual events in Max using Apple’s Core Image technology as well as OpenGL and OpenCV technologies. DIPS can be used to detect a performer’s motions and track the position of subtle details, such as the face, mouth, and eyes, offers powerful tools for real-time image processing of incoming video signal and stored movie files, and can be used to create complex images in a virtual three-dimensional space.

The DIPS consists of a library of more than three hundreds Max external objects and abstractions, a comprehensive set of sample patches, and a detailed tutorial. Some of DIPS strong points, in comparison with similar plugin software such as Jitter or Processing, include its ease of programming, power, and efficiency. It is also good for the education of Max programming. Students in Music and Music Technology at Lancaster University studying DIPS programming techniques were able to realize sophisticated real-time multiple video effects on an incoming video signal in their very first DIPS class. My students regularly create state-of-the-art interactive dance performance works, multimedia installations, interactive multimedia artworks, and VJ applications using DIPS.

Impulse for percussion and computer (1997)

Impulse -multimedia version (2004)

Impulse -multimedia version (2004)

Impulse -multimedia version (2004)

Impulse -multimedia version (2004)

Impulse -multimedia version (2004)

Impulse -multimedia version (2004)

Impulse -multimedia version (2004)

DIPS5: The Most Recent Release

The DIPS was developed for Max/FTS first in 1997 by Shu Matsuda at Sonology Department, Kunitachi College of Music in Tokyo. It was first presented in the international computer music world at the ICMC 2000 in Berlin as a plug-in software for the legendary Max family application ‘jMax’, and later ported to Max/MSP environment of Cycling '74. The most recent version, 'DIPS5v1', was released in August, 2013, and downloadable from http://dips.kcm-sd.ac.jp.
DIPS5:
  • runs on Macintosh computers (OS X 10.7 or later preferred)
  • More than 370 Max external objects and abstractions
  • Handling images & movie files (QuickTime, OpenGL)
  • Handling video camera input (video texture)
  • Importing and rendering 3D models (.obj file)
  • Importing Quartz Composer files
  • OpenGL Shading Language (GLSL) programming interface
  • More than 110 visual effect objects (Dfx library, Core Image Filters & OpenGL)
  • A utility library for the easy of programming (prefix Dlib)
  • A comprehensive set of sample patches, and a detailed tutorial
  • Easy integration of visual events using DIPSWindowMixer
  • Enhanced OpenCV functionalities (detecting face, optical flow, etc.)
  • DIPSKinect object (for the use with the Kinect sensor)
  • images in the jit.matrix object can be ported to DIPS window
Since 2000, it has been developed by the DIPS Development Group supervised by Takayuki Rai. Current active group members are Shu Matsuda, Yota Morimoto, Takuto Fukuda, and Keitaro Takahashi. Previously, Chikashi Miyama, Daichi Ando and Takayuki Hamano also contributed to its development.

Multi Video Effector dips-patch

multi Dfx effect sample-1

multi Dfx effect sample-2

flexible line-draw with blur effect

Spectrum and Signal with Dfx effects

DIPS Window Mixer patch example

DIPS Window Mixer sample