Transform your iPhone or iPod touch into an intuitive and expressive motion-controlled musical instrument Read more
This project was successfully funded on December 19, 2013.
About this project
Thanks to our backers, the Motion Synth Kickstarter campaign is now nearing successful completion, but if you arrive past the deadline you can still get a Motion Synth: Head over to auug.com for more info and to place an order. All Motion Synth rewards will will be shipped to our Kickstarter backers prior to shipment of any Motion Synth units ordered at auug.com.
As part of standard Kickstarter policy this page will freeze at the end of the campaign (Dec 19, 2013, 7.59 EST) and we will no longer be able to update it.
Thanks once more to all our amazing backers!
See the expressive potential of motion-to-sound control in this 'acoustic' demo, where the Motion Synth is wirelessly controlling violin sound software on a laptop:
What is the Motion Synth?
The AUUG Motion Synth (pronounced ‘aug’ as in ‘augment’) consists of three components; the AUUG grip, the AUUG app, and the AUUG cloud.
Simply install the AUUG app, slip your iPhone or iPod touch into the AUUG grip, and you are ready to play!
All our backers ($68 and up) will receive an AUUG grip, the AUUG app (via the app store), and access to the AUUG cloud.
Get started in seconds:
We have designed the Motion Synth to be as easy to use as possible.
If you can use an app, you can use the Motion Synth!
Watch the video below to see how simple it is to get started - Fit your iPhone or iPod touch and begin sending motion signals to GarageBand in just 25 seconds!
Rich and expressive musical control
A slider on a mixing desk can move in one way only, up or down.
By comparison, your hand can move in six different ways - in location and orientation - all at the same time!
Why not use this incredible freedom of movement as a way to create sounds that are musically rich and expressive?
See the Motion Synth in action with Ableton Live:
Start engaging with music in minutes of practice time, not months
The Motion Synth gives you the freedom to choose how your movements shape sound.
Highly intuitive motion-to-sound connections are built into the app, thereby speeding up how quickly you can learn to play musically-expressive sounds.
In addition, the level of complexity in these motion-to-sound connections is configurable, so you can keep things very simple and engaging to start with, and then increase the level of complexity as soon as you feel ready for the challenge of greater expressive control.
The musical scale assigned to the touch screen buttons is also configurable. You can select a scale to precisely suit whatever your fellow musicians are playing, or whatever music you are listening to, and start improvising along immediately - without any fear of playing a 'wrong' note.
The nuts and bolts:
With the Motion Synth you can:
- Expressively control a vast array of sounds on your iPhone or iPod touch by ‘playing’ other audio apps.
- Intuitively shape vocal harmonies and effects in real time by controlling harmonizer hardware devices or effect apps.
- Wirelessly control software on a laptop or desktop computer.
- Control non-wireless music hardware via MIDI cable.
- Design your own forms of motion-based sound control, and share them with others.
For more details on the above uses please see the FAQ.
The Motion Synth is compatible with iPhone (4S and up) and iPod touch (5th generation and up).
The features and benefits of the AUUG grip, the AUUG app, and the AUUG cloud in more detail:
The AUUG grip positions the screen of an iPhone or iPod touch to be played by the fingers and secures the device to the user’s hand during motion. The AUUG grip design has been developed with these musician needs in mind:
- Playability: We discovered that musicians could play melodies and harmonies far more accurately and comfortably if they did not have to grip their iOS device while playing, so the AUUG grip positions your iOS device in the optimal playing orientation and comfortably keeps it there.
- Learn-ability: We also discovered that a touchscreen overlay could provide the tactile feedback that is essential for accurate note playing while the arm is in motion, and for accelerating practice-improvement.
- Reliability: Touring musicians need super-durable and reliable gear, so the AUUG grip frame is made from a single sheet of aircraft grade aluminum, that is laser-cut, cold CNC-bent, and given a tumble-smoothed, clear-anodized finish. The front face of your iOS device is also protected by a rigid, tough, and super-light aluminum-composite frame.
- Comfort: The unique form and pattern of the AUUG grip frame was designed with ergonomics and skin-breathability in mind, but only weighs a barely-noticeable single ounce (~28 grams)! Once you have adjusted the elastic section of the strap to fit your hand, you can quickly slip the AUUG grip on without further adjustment. The strap achieves both a highly-secure and comfortable fit by anchoring to a small section on the thumb side of the frame (via a super-tough polypropylene connector) and then widening to grip a large area across the back of the hand.
- Upgradability: The durable front section of the AUUG grip allows the iOS device to be quickly and securely inserted or removed. Multiple front sections are available to precisely fit different iOS device sizes, and if you want to change your iOS device you can simply detach the front section from the AUUG grip and re-attach the right-sized replacement (see FAQ for more details).
The AUUG app converts your iOS device’s motion sensor data into signals for shaping sound, and transfers these signals to other iOS sound apps or external devices. The AUUG app does not produce its own sounds, but instead acts to control other iOS audio apps running on the same device (as well as external devices), thereby giving the user the freedom and flexibility to choose from a much larger range of sounds than a single app could provide. The AUUG app can be installed on iPhones (4S and up) and iPod touch devices (5th generation and up).
The AUUG app also includes a variety of windows optimized for playing and configuration:
- Performance window: This window includes 8 button zones, which are aligned precisely with the AUUG grip overlay, and are designed to play diatonic scales (e.g. C Major).
- Notes menu window: Here you can choose the scale you wish to play (e.g. E minor), the scale’s octave, activation of orientation-based octave control, and other musical options.
- Motion menu window: As an option for those who want to dig deeper, this window will include a simple menu system for selecting and combining the unique motion-to-sound translation algorithms we have designed, as well as configuring how these translations are outputted via MIDI.
- Presets menu window: Here you can load or save presets, which include all app settings (as well as user motion-to-sound translation configuration changes). In this window you will also be able to export or import these presets for sharing with other users on the AUUG cloud.
Musicians are best able to hone their craft when they can share and learn from each other. The user-only AUUG cloud will be:
- An online service at www.auug.com that allows AUUG app presets to be shared quickly and easily with other users via your iPhone or iPod touch (no laptop or desktop needed).
- An online forum where users can share and discuss setup ideas and playing techniques.
- An online platform for the core AUUG team to provide the latest product support, user guides, and video tutorials. Where possible ‘matched’ iOS app presets will also be provided: Many iOS audio apps allow the export/import of their own presets, so to make setup easier for our users we will share presets for these ‘target’ iOS apps. Once installed, these target app presets will rapidly configure the target app to be ‘played’ by the AUUG app in a specific way.
As the demonstrations in our Kickstarter video illustrate, the essential features of the AUUG Motion Synth are already working superbly. However, we have identified improvements that we think would significantly improve the device's effectiveness and ease of use. These improvements require funding, and we also need to make a sufficient volume of units (at least one thousand) for them to be affordable for our backers (through the use of relatively high up-front cost manufacturing methods). By using Kickstarter, we can also start incorporating user feedback as earlier in the process as possible to ensure we are meeting their needs. The planned improvements are:
- AUUG grip: Refinement and user testing of the latching mechanism of the screen overlay and adjustable attachment mechanism of the strap, to improve long-term wear aesthetics and comfort. If demand for the AUUG Motion Synth is high we will use manufacturing methods better suited to higher volumes, including casting some of the aluminum parts (rather than die cutting), which will also allow more complex and customized parts to be included. The production timeline we have included (see above) takes into account the amount of time required to utilize these more advanced production techniques.
- AUUG app: A comprehensive set of unique motion-sound translation algorithms have already been developed and tested, and now we plan to extend the AUUG app’s interface to include an easy to use menu system for configuring these translations and how they are outputted to other apps and devices.
- AUUG cloud: The online preset-sharing method we have selected has been shown to work well on other platforms and now we need to implement this method on the AUUG cloud and AUUG app sides of the system.
- 'Videoscrub' and 'Motion visuals' software: This is prototype mac software we developed and demonstrated in the first half of the Kickstarter video ('Videoscrub': 0.34 to 1.00 mins, and 'Motion visuals': 0.00 to 2.04 mins). We need to develop a more user-friendly interface for this software and improve the ease with which it can import content.
We are committed to making the Motion Synth the best device it can be for musicians. Clearly it is early days for the product and we still have to determine what aspects of the Motion Synth have the greatest appeal to musicians. Understanding this will help us best allocate available development resources, and if changes to this development roadmap are in the best interest of our users we are willing to shift priorities in order to best cater to their needs.
Along this development journey a dedicated and diverse team has come together:
- Industrial design and engineering: Working on the project from day one has been SGW Designworks (www.sgwdesignworks.com); a specialist team made famous in the Eric Ries bestseller ‘The Lean Startup” for their capacity to expertly select from a diverse range of manufacturing techniques to rapidly implement, test, and deliver high quality products.
- Software design: Our expert programmers have deep experience in MIDI coding, digital audio, and audio/visual control interfaces (from work at industry-leading interface companies like Fairlight and SmartAV).
- Passionate and determined leadership: Coordinating the team is Dr Joshua Young who created the original design, led initial development, and brings a founder's drive and dedication to the project. The AUUG project has evolved out of TripleThink, a start-up Joshua founded to focus exclusively on new human-computer computer interfaces, specializing in motion-based musical control.
- Expert mentors: We are also extremely lucky to have two legends in music technology innovation providing guidance along the way: Peter Vogel, co-creator of the Fairlight CMI (the first commercially available digital sampler and musical sequencer, see www.petervogelinstruments.com.au ); and Roger Linn, creator of the first digital sample drum machine, designer of the Akai MPC60 and MPC3000, and widely considered to be the father of the modern drum machine (see www.rogerlinndesign.com ).
Inspiration & development:
“….while my spine rattled in front of the bass speaker, for a brief moment I could see past the silhouettes and strobed cigarette smoke to a man onstage staring gravely at his laptop. Was he in the midst of making music, or worried like me that the heaving floor of this makeshift club was going to give way?....”
Long before establishing AUUG, Joshua Young’s neuroscience research led him to Berlin. His love of acoustic music, rooted in the very immediate connection between the musician and their instrument, was abruptly fried upon contact with Berlin’s visceral electronic music scene.
Frustrated that he couldn’t tell if the laptop musicians were generating their music onstage or checking their email, he started tearing apart old music hardware to build interfaces that would give electronic musicians a more physical way of shaping their sounds – a more expressive kind of control that would be compelling for both them and their audience.
Early experiments with the AUUG Motion Synth included using an app only, whereby the player would grip their mobile device in their hand while playing the screen with their fingertips. This forced the player to continuously pay attention to adjusting their grip while changing orientations, and also reduced the dexterity with which they could trigger notes. This led to early prototypes of the AUUG grip that grasped the mobile device at its edges while ergonomically securing it to the hand.
After many prototypes, we also realized that the lack of tactile feedback from the touch screen was reducing the accuracy with which notes could be triggered. Experiments with various means of adding tactile feedback to the screen were made before discerning that a hinged overlay with 'button windows' is both highly effective and convenient.
Many other features of the physical design have gone through multiple iterations, and user feedback has been sought throughout in order to ensure that the system as a whole best serves the primary needs of musicians.
Development of the AUUG app proceeded at the same time as that of the grip, which has helped to ensure that hardware and software features support each other at a deep level, rather than being adapted to each other and providing only superficial compatibility.
Kickstarter video musicians and content:
Introduction soundtrack: The second half of the video (2.12 to 4.17 mins) includes looped sections of ‘Silver Wheel’ (from the ‘Solar Driftwood’ album) by Australian band Cracked Actor.
Video musicians: The video musicians used the backing track as a basis to compose their own parts and performed them live during filming, while simultaneously controlling the motion-reactive visuals behind them (via Wi-Fi MIDI messages sent from the AUUG Motion Synth to laptop software and back-projected onto the screen behind them). Their estimated practice times can be found here.
The musicians and the sounds they played were:
- Sonia Vaikyl: (0.22 to 0.33 mins) ‘Magellan Jnr’ synth app running on same device.
- Video sample: The 'video scrub' demonstration (0.34 to 1.01 mins) by Joshua Young uses a 2 second clip of Evalena Marie from the independent feature film 'Visionary' directed by Ben Proulx.
- Eesha Hunjon: (1.02 to 1.15 mins) ‘Audiobus’ app (hosting Harmony Voice and Garageband apps) running on same device, with mic input via iRig Pre.
- Becki Whitton: (1.16 to 1.31 mins) ‘Audiobus’ app (hosting Magellan Jnr app) running on same device, with mic input via iRig Pre.
- Joshua Young: (0.00 to 0.15 mins) ‘Animoog’ synth app running on same device; (0.34 to 1.01 mins) AUUG ‘video scrub’ software running on laptop; (1.32 to 1.45 mins) Voice Live Touch 2, with MIDI input via iRig MIDI. The backing track (0.00 to 2.03 mins) each musician composed and performed their parts to and the motion-reactive visuals were also created by Joshua Young.
Risks and challenges
Successful Kickstarter projects can run into fulfillment problems when backer numbers exceed the planned production capacity. For this reason we have planned different manufacturing scenarios that can cope with different levels of backer demand. The production timeline we have included is based on manufacturing methods that can produce high unit volumes, but that require a tooling phase prior to beginning production. We have also worked with our planned suppliers to ensure that our fabrication plans are not dependent on any materials or parts that are significantly limited in the speed with which they can be supplied.
Another challenge for Kickstarter projects is finding the right balance between product testing and speed of fulfillment. Insufficient product testing can actually increase effective fulfillment time, because of the time needed to replace flawed product units (i.e. units that include basic design or fabrication faults). We are seeking to get the right balance between product testing and speed of fulfillment by: (1) Having completed testing and refinement of the core features of the AUUG Motion Synth prior to launching on Kickstarter, (2) favoring fabrication methods that can incorporate design changes quickly, and (3) distributing test units early to beta users to rapidly catch any potential problems.
We also recognize that shipping and managing pledge information are big challenges in the Kickstarter fulfillment process. For this reason we are investigating bringing in two experienced partners to the fulfillment phase: Shipwire (shipping) and BackerKit (pledge management).Learn about accountability on Kickstarter
iPhone (4S and up) and iPod touch (5th generation and up).
At this stage we do not plan to create a left-handed version during fulfillment of our Kickstarter campaign rewards. However, assuming there is sufficient interest, one of our earliest priorities will be investing the funding required to develop and manufacture a left-handed version of the AUUG grip, and there are certainly no technical obstacles in the way. We recognize that left-handed people need a device that best suits them, and that some adventurous people want to play two Motion Synths at the same time :-) In the meantime, and without being condescending to left-handers, we do want to emphasize that the Motion Synth is easy to use and people can improve their skill level with it rapidly. See here for estimates that the Kickstarter video performers provided of their total practice and composition time prior to shooting the video: http://www.auug.com/musician-composition-and-practice-time/
Here is a list of apps that we have tested with the AUUG Motion Synth (see www.auug.com/playable-ios-apps). Some of these apps were used in the Kickstarter demo video and are listed in the 'Kickstarter video musicians and content' section in the main description. Any iOS app that can receive ‘virtual MIDI’ and can operate in ‘background audio’ mode is likely to be compatible. These two features are quickly becoming standard for high quality audio apps, and a list of such apps can be found here: http://www.iosmusician.com/app-lists/virtual-midi
Absolutely! You can send note and CC MIDI messages from the Motion Synth to Ableton over WiFi (or via a MIDI cable adaptor). For more details see the answer to the FAQ: WIRELESS LAPTOP CONTROL AND SOFTWARE.
iPhones and iPod touch mobile devices can send musical control signals (coreMIDI protocol) to MacBooks wirelessly (by creating an ‘ad hoc’ Wi-Fi network on your laptop; no Wi-Fi router or additional gear needed). Windows laptops can create a similar wireless setup using free third party software: http://www.tobias-erichsen.de/software/rtpmidi.html (kindly made available by Tobias Erichsen - please consider giving him a donation for his excellent work!). Any software with MIDI functionality can be used with the AUUG Motion Synth (e.g. GarageBand, Ableton Live, Pro Tools, Max, PD, Reaktor, Massive, etc).
We have tested the iRig MIDI and it works very well with the AUUG Motion Synth. iOS devices with a lightning connector will require a lightning adapter. Other iOS MIDI adaptors may work but we have not tested them yet.
No. The AUUG app captures touchscreen and motion sensor input, processes these inputs to produce musically-expressive control signals, and then outputs these signals to other apps running on the same iOS device (or other external devices that produce sound). There are already so many fantastic iOS synths available we think it makes the best use of our development resources to focus on being an amazing controller system for other sounds.
AUUG GRIP CHOICE AND SHIPDATE: If my choice of AUUG grip model (e.g. a model that fits an iPod touch) does not match the iOS device I have when the AUUG grip ships what can I do?
At the end of the Kickstarter campaign we will invite you to a survey asking which iOS device you would like to use the AUUG Motion Synth with when it ships. As we approach the shipping date, we will send out the Kickstarter backer survey to confirm which AUUG grip model you would like. The AUUG grip can also be easily adapted to fit other iOS devices/models (by swapping out the front section for an alternative size) should you wish to switch to using a different device at a later date.
Right now the range of audio apps for android is not as extensive as for iOS, so initially we are focusing on supporting iOS devices only. However, if you would like to see an AUUG Motion Synth for Android in the future please let us know and we will see what we can do!
Cable connections offer high reliability and low latency, but wireless options are continually improving. If a Wi-Fi router (acting as an ‘ad hoc’ Wi-Fi network creator) and the iOS app ‘MIDIBridge’ are used, two iOS devices can exchange wireless MIDI data. Thus a MIDI chain could be created like this: AUUG Motion Synth (via Wi-Fi) to iPod touch (via iRig MIDI) to target device. Manufacturers are looking to make wireless MIDI connections much easier than this however, with products like: www.zivix.net and http://www.iconnectivity.com/iConnectMIDI4plus
If you want to make musical sounds, here some of the apps that we have tested for use with the AUUG Motion Synth: www.auug.com/playable-ios-apps. iPhones and iPod touch units have speakers, but if you want to be heard over other instruments you will need to plug into an amplification system via a standard 3.5mm TRS audio cable. You can also listen to the sounds produced via earbuds or headphones plugged into the iOS device you have integrated into the AUUG Motion Synth.
VOCAL HARMONY AND EFFECTS: What else do I need for creating and controlling vocal harmonies or effects using the AUUG Motion Synth?
A guide for creating and controlling vocal harmonies can be found here: www.auug.com/vocal-harmony-and-effects.
KICKSTARTER VIDEO SOUNDS AND EFFECTS: How were the various sounds being controlled in the demo video?
What is the connection between each performer’s movements and the visuals behind them? Was a green screen used? We’re glad you asked! A detailed description of each section of the demo video can be found here: www.auug.com/auug-demo-video-description
To achieve precise alignment with the screen overlay, the AUUG grip front section fits your iOS device quite snugly. Screen protectors or back surface protectors are compatible, but thicker items (e.g. cases) would need to be removed in order to fit you iOS device into the AUUG grip.
Pledge $10 or more
If you share our vision and just want to help out - We salute you! We'll keep you posted on our progress in helping artists create motion-based sights and sounds!Estimated delivery:
Pledge $68 or more
199 backers All gone!
EARLY BIRD SPECIAL: Get an AUUG Motion Synth (includes the AUUG grip, AUUG app, and AUUG Cloud). To identify your Motion Synth as belonging to the first batch ever made, the aluminum frame of your AUUG grip will include the mark 'KS14' (an abbreviation of Kickstarter, 2014). The AUUG Motion Synth will retail for $110 after all rewards have been shipped to our Kickstarter backers.Estimated delivery:Ships anywhere in the world
Pledge $78 or more
OPPORTUNITY: Get an AUUG Motion Synth (includes the AUUG grip, AUUG app, and AUUG Cloud). To identify your Motion Synth as belonging to the first batch ever made, the aluminum frame of your AUUG grip will include the mark 'KS14' (an abbreviation of Kickstarter, 2014). The AUUG Motion Synth will retail for $110 after all rewards have been shipped to our Kickstarter backers.Estimated delivery:Ships anywhere in the world
Pledge $105 or more
GOLD: Get a gold AUUG Motion Synth (includes the AUUG grip, AUUG app, and AUUG Cloud). The aluminum parts of your AUUG grip will receive a beautiful gold anodized finish (similar in color to the 'gold' iPhone). To identify your Motion Synth as belonging to the first batch ever made, the aluminum frame of your AUUG grip will include the mark 'KS14' (an abbreviation of Kickstarter, 2014).Estimated delivery:Ships anywhere in the world
Pledge $120 or more
DUET: Want to make music with a friend? Get two AUUG Motion Synth units (each including an AUUG grip, AUUG app, and AUUG Cloud access). These units will be identical to those in the $78 reward tier (including the ‘KS14’ mark). Note that both units will be designed to fit the right hand (see FAQ). The retail price for a single AUUG Motion Synth will start at $110.Estimated delivery:Ships anywhere in the world
Pledge $219 or more
10 backers Limited (190 left of 200)
GOLDRUSH: Get one of the first 200 gold anodized units ever made! Get a gold AUUG Motion Synth (includes the AUUG grip, AUUG app, and AUUG Cloud). The aluminum parts of your AUUG grip will receive a beautiful gold anodized finish (similar in color to the 'gold' iPhone). In addition to the 'KS14' mark, the aluminum frame of your AUUG grip will include an engraved serial number between 1 and 200, marking the order in which it rolled off the production line! We will try to ensure that the number between 1-200 that you receive matches your position in the sequence of pledges to this tier. If this is not possible, however, the 200 units will be randomly assigned to the 200 backers within this tier.Estimated delivery:Ships anywhere in the world
Pledge $5,000 or more
6 backers All gone!
PARTNERS & PATRONS: Would you like to work with us? Do you have a complementary product you think could be developed in tandem with the Motion Synth? Alternatively; perhaps you would like to meet the team, get access to early prototypes, have a training session with the founder, or get a customized Motion Synth? Get in touch and let us design a custom reward tailored to you!Estimated delivery:Ships anywhere in the world
- (29 days)