Soundface building process

Building the structure

Pencils, rubber, ruler, graph paper, goniometer … all is ready to start building our table structure!

tav.1

On a summer sunday afternoon, equipped with glasses and masks, we began sawing pieces of wood, trying to make the pieces all match together, marking points to nail or glue. The goal was: the structure must stand.

During all this turmoil, the cat pacefully roamed peeping around.

babi

tav.2

tav.2

avvitatore

We ended at night, exhausted and covered in dust. But oue goal is reached: the table structure stood magnificently in the middle of the room.

standing

technical notes

The table is made with spruce wood. It’s a cubic structure (each side length is 1 meter).

Setting up the surface and the camera

The next steps involved:

IR2

To provide some diffuse IR illumination within the structure we came down with 4 IR lamps, one for each edge.

Once all components have been set up, we could start assembling and testing the whole structure.

technical notes

The camera is a Sony PS3Eye. We removed its original lens and lens mount.

IR3

First of all, we removed the 4 little rubber caps on the rear. The we unscrewed the 4 screws underneath.

IR4

Opening the camera case has been quite simple. All we had to do was to slightly force the joint.

IR5

Once opened the camera, we extracted the PCB.

IR6

We then substituted the lens and inserted the filter.

We got the new lens mount by hacking a cheap USB camera.

The new lens and the cheap camera have been purchased from DealExtreme online shop.

The IR filter (NIR Optical Filter, 850DF20, 11.5mm painted edge) has been purchased on ebay (omegabob). The filter let only IR light with a wavelength of 850nm to pass through the lens.

IR1

We had to apply some pression to insert the filter; once done it, we simply screwed the support on the board, upon the CCD.

IR8

Here’s a detail of the CCD:

IR7

Eventually, we screwed the lens on the support. And we’re done!

Positioning the elements within the structure

Before the test could begin we had to:

tav

We placed the 4 IR lamps at the four edges on the floor of the structure. As these lamps face upward, they reflect on the plexiglass surface. This is a problem we decided to deal with later.

tav

The camera is secured at a side of the structure, facing toward the plexiglass surface.

tav

As expected, the first images captured showed some nasty reflections of the IR lamps

Testing

The first test were a mess. Nothing worked properly and we had to figure out where to start to fix the whole thing.

tav

The first step we made has been changing the fiducial dimension according the the PS3Eye distance from the surface.

tav

We balanced the fiduacial reshaping with the repositioning of the camera in order to find the right camera, surface, projector setup.

tav

tav

the projector

The choise of the projector has been an important issue we had to deal with.

tav

We opted for a Acer s1210, a projector that can render quite large images at relatively small distances. Our plexiglass surface is amost entirely covered by the projection.

We placed the projector vertically against one side of the table, pointing towards the plexiglass sheet.

test4

test3

We introduced a new element: 4 dimming fabric sheets to prevent external light to interfere with the sensing system within the table.

test7

test7

The plexiglass surface is almost entirely covered with the projection. But there are spots not reached by the projected image. The distance between the projectore end the plexiglass is nearly 50 cm.

test5

This effetc is partly due to the vertical orientation of the projector. We had to angle and re-position the projector in order to center the projected image.

test2

When a satisfying position has been reached, we fixed it with custom wooden tools. One side effect of this workaround is that the image is distorted, so we had counter-distort it via software.

Even if it’s a bit tricky, it works!

test1

test9


First protoypes

On June 9th 2013 we introduced our intercative table prototype at Ohibò during the (Lab)Oratorio Digitale weekly meeting.

Ohibo 1

We based our prototype on the computer vision studies carried out at Pompeu Fabra University in Barcellona. It boils down to a graphical pattern recognizing system that links every images to a specific sound created in real time. The player can create rythm and tempo by placing vary symbols upon the surface.

Details

fiducials

The active surface is a simple stool with one broom grip attached to one leg. At the top of the grip a IR camera / lamp faces downward to enlight and capture the objects on the surface. The markers are pieces of cardboard with a marker image stuck on one side. The capture images is sent from the IR camera to a computer software, Reactivision, that can recognize the markers and obtain information to be sent to a client software. The client software re-elaborate the type and position of every marker to create musical patterns.

calibration

In order for this to work properly, a very careful Reactivision calibration must be applied.

debug

circular crown

rotation test

Ohibo 2


If you find this article useful and you like it, please leave a comment below: let us know what do you think about it, we'd really appreciate it. Thank you very much and, as always, stay tuned for more to come!