beatfix studios

Jeff Mission and Chris Korda performing live with the visual software tools WiiWhorld and Fractice. Fractice is used to create the background layer, while WiiWhorld is being controlled in the foreground – the two layers were lumakeyed together with an Edirol V4 video mixer.

Chris Korda and I will be doing a live performance of WiiWhorld at the Brattle Theater in Cambridge on Friday, March 6th.  The event runs from 10pm – midnight, and also includes performances by Peter Kirn, Joshue Ott, and Morgan Packard.

Complete details of MGFest09 can be found at http://mgfest.com/

The wonderful people (and talented VJs) of Eyewash in New York have been gracious enough to have me out to perform three times over the years.  Eyewash is a performance night where VJs take center stage – literally, you stand in the middle of the room, surrounded by four giant screens and audience members on all sides.  Here are links to my performances, from the Forward Motion theater website:

Eyewash: Fixation

Eyewash: A Good Friday

Eyewash: Boston2NewYork

A GlovePIE script for DJ mixing in the software djDecks.

// djDecks script by Jeff Mission – http://beatfix.com
// Make sure numlock is ON

if wiimote.leds=240 then wiimote.leds=0 // fix led bug

Numpad2=wiimote.one+wiimote.up or wiimote.two+wiimote.up // xfader step left
Numpad4=wiimote.a+wiimote.up // xfader left
Numpad8=wiimote.one+wiimote.down or wiimote.two+wiimote.down // xfader step right
Numpad6=wiimote.a+wiimote.down // xfader right
Numpad5=wiimote.a+wiimote.left // xfader center

ctrl+down=wiimote.home+wiimote.left // playlist scroll down
ctrl+up=wiimote.home+wiimote.right // playlist scroll up
ctrl+left=wiimote.one+wiimote.home // load track Deck A
ctrl+right=wiimote.two+wiimote.home // load track Deck B

A = wiimote.one+wiimote.right // bass up Deck A
Z = wiimote.one+wiimote.left // bass down Deck A
F = wiimote.two+wiimote.right // bass up Deck B
V = wiimote.two+wiimote.left // bass down Deck B

I = wiimote.one+wiimote.Plus // pitch bend up Deck A
U = wiimote.one+wiimote.Minus // pitch bend down Deck A
P = wiimote.two+wiimote.Plus // pitch bend up Deck B
O = wiimote.two+wiimote.Minus // pitch bend down Deck B

ctrl+f10 = wiimote.one+doubleclicked(wiimote.Plus) // pitch up Deck A
ctrl+f9 = wiimote.one+doubleclicked(wiimote.Minus) // pitch down Deck A
ctrl+f12 = wiimote.two+doubleclicked(wiimote.Plus) // pitch up Deck B
ctrl+f11 = wiimote.two+doubleclicked(wiimote.Minus) // pitch down Deck B

f2=wiimote.one+wiimote.A+wiimote.B // play / pause Deck A
f6=wiimote.two+wiimote.A+wiimote.B // play / pause Deck B
f3=wiimote.one+doubleclicked(wiimote.b) // cue Deck A
f7=wiimote.two+doubleclicked(wiimote.b) // cue Deck B
f4=wiimote.one+doubleclicked(wiimote.a) // loop Deck A
f8=wiimote.two+doubleclicked(wiimote.a) // loop Deck B

pageup = wiimote.home+doubleclicked(wiimote.plus) // master volume up
pagedown = wiimote.home+doubleclicked(wiimote.minus) // master volume down

// The following require custom keyboard bindings in djDecks
key.equals = doubleclicked(wiimote.home) // tempo sync (Auto button)
//key.8 = wiimote.home+wiimote.one // cue on/off Deck A
//key.9 = wiimote.home+wiimote.two // cue on/off Deck B

Here are a few notes on how to run multiple instances of Whorld on the same screen, also known as “two-player mode” – I can’t give the exact step-by-step, but this should be a good starting point for people who want to experiment on their own:

The technique is built around FFRend, Chris Korda’s free, open-source software for rendering FreeFrame effects, and the UltraWhorld plugin. Start on the FFRend download page:

Download the “FFRend application” and “Chris Korda’s FreeFrame Plugins” from this page.

Now we need to get UltraWhorld from the Whorld site:
Download the UltraWhorld FreeFrame plugin.

Unpack and install FFRend.

Unpack ultrawhorld-1.1.00-bin.zip into a folder called “WhorldFF”, and place this folder inside your “My Documents” directory. This will enable UltraWhorld to automatically find your patches.

Unpack ckffplugs-1.0.07-bin.zip. Move all of the .dll files into the WhorldFF directory. We will be using “BoolMix.dll”.

Run FFRend. On the left side of the screen, you will see four empty slots for plugins. Right-click the top one, select “load”, and find the “UltraWhorld.dll” plugin. Load “UltraWhorld.dll” into the top slot.

Load a second instance of “UltraWhorld.dll” into the second slot.

Load “BoolMix.dll” into the third slot. In the dropdown next to “BoolMix A” select the first instance of UltraWhorld. You should now see the two UltraWhorld objects in the preview window.

You can change parameters for any loaded plugin by clicking on it, then adjusting the sliders to the right. Try playing with the “patch” sliders in UltraWhorld, and the blend modes in BoolMix.

Every loaded plugin in FFRend is MIDI controllable, using the MIDI section on the bottom of the screen. For multi-player WiiWhorld, you need to map the desired parameters for each instance of UltraWhorld to MIDI data coming from GlovePIE. This involves pairing multiple Wiimotes to your computer, then addressing them in GlovePIE as Wiimote1, Wiimote2, etc. I recommend using separate MIDI channels for each instance of UltraWhorld, to reduce confusion.

Unlike regular Whorld, the MIDI settings for UltraWhorld are not pre-filled, so you have to do some configuration. Also, don’t forget to configure FFRend to receive MIDI on the same port that GlovePIE is sending to. Once that’s all done, you should be off and running.

Now, wasn’t that simple?

All images created by Chris Korda using the geometric visualizer Whorld.

[View with PicLens]

Hardware Requirements

• A computer that runs Windows and has a Bluetooth adapter
• A Nintendo Wiimote controller with Nunchuk

Software Requirements

• MIDI Yoke (download / web site)
• Whorld 1.7.06 (download / web site)
• GlovePIE 0.29 (download / web site)
• The WiiWhorld script (”WiiWhorld.PIE”) (download)

Setting Up

• Install MIDI Yoke.  Set “MIDI Yoke NT: 1″ as your default MIDI playback device in Windows.  (instructions here)
• Unpack the .zip files for the Whorld software, GlovePIE, and the WiiWhorld script.
• Install Whorld.  Run Whorld.  From the menu bar in Whorld, select View -> Options -> MIDI.  From the pulldown list, select “MIDI Yoke NT: 1″.
• Open the GlovePIE folder.  Run GlovePIE.exe (no installation required).  From the menu bar in GlovePIE, open “WiiWhorld.PIE” (File -> Open -> )  Do not click the “Run” button yet.

Pairing the Wiimote

The exact process will vary, depending on your Bluetooth stack.  Here are the key points you need to know:

• The Wiimote must be in discoverable mode throughout the pairing process.  Press and hold the “1″ and “2″ buttons on the Wiimote simultaneously, and continue to hold them until the pairing process is complete.
• If you are pairing your Wiimote for the first time, you may need to add it as a new Bluetooth device.
• The Wiimote is recognized by Bluetooth as a HID (human interface device).
• The Wiimote does not require a passkey.  If you are prompted to enter a passkey, decline or skip it.

If you would like more detailed instructions:
Bluesoleil Bluetooth stack
Built-in Windows Bluetooth stack

And Away We Go!

Once you have successfully paired your Wiimote:

• Go back into GlovePIE.  Click the “Run” button.  You should see numbers moving in the debug box (immediately to the right of the “Run” button).  If you don’t see anything, then your Wiimote is not properly paired, and you need to go through the pairing process again.
• Connect the Nunchuk to the Wiimote, if you haven’t already.
• Go into Whorld.  Shake your Wii.  If everything is working, you should be able to tell right away.
• To put Whorld in fullscreen mode, press F11 on your keyboard.  Have fun!

Notes:

For convenience, I like to associate the .PIE file extension to automatically open with GlovePIE, and then create a desktop shortcut to the WiiWhorld.PIE script.  Do whatever works best for you.

Occasionally the Nunchuk will lose its connection with the Wiimote, and stop responding.  This can usually be fixed by simply unplugging the Nunchuk from the Wiimote, and then plugging it back in.

Excerpt from a live DJ set by Jeff Mission. GREEN is a weekly radio broadcast on WZBC 90.3 FM, hosted by Shwilly B and Jeff Mission, broadcasting throughout the greater Boston area every Monday night from 10pm-2am (EST). The video here was recorded using the Third Eye, a custom-built VJ camera worn on the center of the forehead, giving an accurate first-person perspective as Jeff Mission spins live on the air. Audio was captured live from the sound board. The result is a unique look inside the DJ process.

A live video feedback performance by VJ Jeff Mission. The smooth, colorful waves in this piece were generated by chaining together two pieces of equipment – an Edirol V4 video mixer, and a JVC JX-C7 Video Corrector – in a continuous loop, then making incremental adjustments to the settings on the JX-C7. The result is a digital organism, composed of pure feedback, that can be manipulated at will. The technique used in this piece is one of the core components of my live performances.

This piece was performed live as part of a visual jam session held at Beatfix Studios, Boston, MA. A combination of organic motion and digital technology, ‘Timbale’ is a new twist on a classic lightshow technique. By using an artists’ lightbox and overhead camera, hand movements are isolated and captured. The image is sent in real time to a video mixer and blended into a live feedback loop, where it creates echoes that ripple through the frame.