Pulse Matrix, Audio Visualization Tool

August 2011, Pulse Matrix, sound visualization application, Independent work, Position: Programmer/Designer for audio and visual .

 

 

Pulse Matrix from Cheng Yang on Vimeo.

Inspired by Daniel Rothaug’s Digital Acoustic Cartography;
Designing,programming,testing by Cheng Yang;
First song <On(Ian O’Brien Mix)> by Rei Harakami;
Second song <I Love the Moonlighting But Even It Ended>;
Third song <Fish> by Cheng Yang;
Video demo directed and composed by Cheng Yang;
Voice-over by Cheng Yang.

We are living in a wave-immersing environment, the sound wave, the radiation, even the light features in wave-particle duality, but the most frequently noticed way of waving is the sound. We all know that the sound wave can be detected in an oscilloscope which drawing the frequency-spectrum (the diagram of relationship between frequency and amplitude) in 2 dimensional area.

However, the instant moment of waving shape is always flushed by the time, thus I tried to figure out a way to retain the shape of sound in 3 dimensional space as the time goes on, in this way, we can have a more” tangible” way to describe and observe the sound and it’s subtlety of changing.

This application is a friendly tool for people to turn there favorite pieces of music or their own voice into visible, colorful and meaningful sound topography, it also provides four-tracks-layered mechanism for the professional musician or learner to envision the physical attributes in composition of the whole song, the amplitude ratio of each tracks, the panorama of instrumental structure.

Pic 4–6 First stage testing, the moving topography of sound

Pic 7–10 Testing of different oscillators such as the sine, triangle, square

Pic 11,Pic 12 the 3D dynamic topography of sound based on FFT analyzer

 

Pic 13–26 Seven different mode of rendering: point, cube, cuboid, value, surface, surface with mesh, mesh only

 

Pic 27 Bouncing controllers of Zoom, top color, bottom color, Amplification

Pic 28 Four-corners-triggering bulletin and buttons

Pic 29 the File-Chooser and File-Filter mechanism from java

 

Pic 30–32 Real-time visualization

Pic 33–37 Four-tracks-layered mechanism of composition

Pic 38 the bouncing-rotating main menu

Leave a Reply

Aquaria Simulation

behind scene1 copy

October 2013, Aquaria Simulation Studying, part of Sony Project, including fish flocking prey-predator algorithm, and fish natural movement algorithm

Cheng’s Music

906135_382644648533202_1413667777_o

Celestia, Vocal Interaction Game

Celestia, a vocal interaction music game, showcase@PAX East 2014, showcase@ E3 2014, a poster at SIGGRAPH 2013, and one of ACM-CHI Game Competition Finalists(May 2013, Paris).

Be A Perfect Green

BAPerfectGreen

April 2015, A simple game made in two weeks, a little game about balance the color, and the lost of yourself.

FL•U, iOS Bio-Surveillance App

FL•U cover

Summer 2013, FL•U, a gamified iOS multi-lingual influenza surveillance and disease prevention app. Position: Graphics Programmer/UIUX Designer (team of 3)

TuneTrain, Music Education iOS App

cover

Spring 2013, TuneTrain(App Store), 100,000+ download with 4-star rating, a music education iOS Application, encourage children to create music by drawing. Position: Programmer for Voice Detection, Midi-to-Notation Algorithm, Sequencer (team of 7)

Fitbit Data Visualization

sleep data

CMU-ETC-Building Virtual World

ETC_LOGO

MaKey MaKey & Happy Birthday

MaKey MaKey little experiment

Herb Ensemble, Interactive Installation

herbEnsemble

Pulse Matrix as Multiple Pulse Sensor

pulseSensor

Announcement: About Me…

profile


Resume         Linkedin

 

Sound Design

midilearning

works with 3Ds Max

fish-素模

Pulse Matrix, Audio Visualization Tool

August 2011, Pulse Matrix, sound visualization application, Independent work, Position: Programmer/Designer for audio and visual .