{"id":1017,"date":"2017-04-11T11:52:47","date_gmt":"2017-04-11T02:52:47","guid":{"rendered":"http:\/\/blog.criware.com\/?p=1017"},"modified":"2017-04-11T11:52:47","modified_gmt":"2017-04-11T02:52:47","slug":"composing-adaptive-music-in-atomcraft","status":"publish","type":"post","link":"https:\/\/blog.criware.com\/index.php\/2017\/04\/11\/composing-adaptive-music-in-atomcraft\/","title":{"rendered":"Composing Adaptive Music in AtomCraft"},"content":{"rendered":"

This post explains how to implement interactive music in your game with AtomCraft.<\/em><\/p>\n

 <\/p>\n

Music in Video Games<\/strong><\/span><\/p>\n

In our recent implementation posts we have talked a lot about sound effects. However, a complete interactive audio experience only comes together with music. The music is equally important as it conveys emotion and helps telling a story.
\nUnlike movies, games are a nonlinear media. It means that your game music needs to be adaptive in order to accommodate the interactive nature of the medium. In other words, your game music needs to be fully interactive to follow what is happening in the game due to the player\u2019s actions.
\nFrom the very beginning, the music must be written with game interactivity in mind. Indeed, it is critical for the composer to understand the basics of adaptive music in order to successfully create assets that can be used in the game. Fortunately, AtomCraft provides a set of features that empower the composer and allow him to create interactive music very easily.
\nIn this post, we will explain how to leverage AtomCraft\u2019s features to implement compelling interactive music in your project. Let\u2019s dive into it!<\/p>\n

 <\/p>\n

Adaptive Music Implementation in AtomCraft<\/strong><\/span><\/p>\n

To be able to successfully create interactive music with AtomCraft, there are four key features that you will need to understand: Blocks, Beat-sync, AISACs and Selectors.
\nThis graphic demonstrates a basic interactive music workflow using ADX2. In this example, the composer creates interactive music using these four key features. The integration in AtomCraft can be easily done by the composer himself or any other team members working on the project. At runtime, the game will send data to the ADX2\u2019s engine which will adapt the music in real-time according to the action.<\/p>\n

\"Blog<\/p>\n

 <\/p>\n

Working with Blocks<\/strong><\/span><\/p>\n

\"ADX2_IM_02\"<\/p>\n

There are many powerful ways to implement interactive music with AtomCraft. Let\u2019s start with the Block playback system. Blocks allow you to organize your Cues in vertical sections that can be played in a different order depending on the game context. They are a bit similar to the pattern-based systems you can find in some sequencers.<\/p>\n

Blocks have a lot of benefits:<\/p>\n

\"ADX2<\/p>\n

Step by Step<\/strong><\/p>\n

Step 1:<\/span><\/em>\u00a0Change the display units of the timeline to bars and beats.
\n\u2022 Start by opening your Cue
\nRight-click on the ruler and select [Timebase Settings]\n

\"ADX2_IM_03\"<\/p>\n

\u2022 In the [Timebase Settings] window, choose Bars\/Beat<\/p>\n

\"ADX2_IM_04\"<\/p>\n

Step 2:<\/em><\/span> Create Blocks in a Cue.
\n\u2022 Right-click on the timeline and, in the context menu, select [New Object].<\/p>\n

\"ADX2_IM_05\"<\/p>\n

\u2022 Chose [Create Block].
\nA new Block appears at the top of the time line<\/p>\n

\"ADX2_IM_06\"<\/p>\n

\u2022 Create more Blocks for your music<\/p>\n

\"ADX2_IM_07\"<\/p>\n

Step 3<\/span>:<\/em> If you like, change the color of your Blocks to organize them.
\n\u2022 Right-click on a Block and select [colour settings].<\/p>\n

\"ADX2_IM_08\"<\/p>\n

Step 4<\/span><\/em>: Add your music
\n\u2022 Create a Track per instrument or per type of music loop.<\/p>\n

\"ADX2_IM_09\"<\/p>\n

\u2022 Simply drop the loops on the right tracks in the appropriate Blocks.<\/p>\n

\"ADX2_IM_10\"<\/p>\n

Step 5<\/span><\/em>: Define the Block’s behaviour.
\n\u2022 Double-click on a block to open the properties pane.<\/p>\n

\"ADX2_IM_11\"<\/p>\n

Here we can rename the Block or change its duration.<\/p>\n

\"ADX2_IM_12\"<\/p>\n

The Block destination corresponds to where the playback jumps when the Block has finished playing or has reached a transition point.<\/p>\n

\"ADX2_IM_13\"<\/p>\n

There are 3 types of transitions available:
\nThe first one is [None]. It will stop the playback at the end of the block. The 2nd one is [Next Block]. The Block will transition to the next block. The 3rd one is [Block Destination]. The Block will transition to a block from a list of our choice.
\n\u2022 If you select 3rd option, the [Block Destination Setting] window will appear.<\/p>\n

\"ADX2_IM_14\"<\/p>\n

Here we can add or remove destination Blocks and chose among 4 types of transitions. For instance, if we chose [Sequential] and select a Block as destination, the Block will transition to the selected block at the end of the playback. If we chose [Random] and insert all the available Blocks, it will transition to a random Block at the end of the playback.
\nLet’s go back to the Block properties pane.
\nHere we can define the number of times the block should loop before transitioning. Enter either -1 for an infinite loop or the actual number of loops to perform.<\/p>\n

\"ADX2_IM_15\"<\/p>\n

The [Block number of divisions] setting divides the Block in intervals at which transitions can occur.<\/p>\n

\"ADX2_IM_16\"<\/p>\n

For instance, if we have a 4 bars music loop, set the division number to 4 and select [Division] for the [Block transition timing], the Block will wait until the 1st beat of the next bar before transitioning to the destination Block.<\/p>\n

\"ADX2_IM_17\"<\/p>\n

Step 6<\/span><\/em>: Add transitioning Tracks if needed.
\nIt is possible to play a specific Track only when transitioning (end or beginning of the transition).
\n\u2022 Create a Track and add a transition segment at the end of a Block.<\/p>\n

\"ADX2_IM_18\"<\/p>\n

\u2022 Right-click on the track and in the context menu, select the [Block Transition Playback Type] and chose [Playback Transition].<\/p>\n

\"ADX2_IM_19\"<\/p>\n

The Track now appears differently to indicate that it will only be playing during transitions.<\/p>\n

\"ADX2_IM_20\"<\/p>\n

 <\/p>\n

Working with Selectors and BeatSync<\/span><\/strong><\/p>\n

The second feature in AtomCraft that allows you to easily integrate interactive music in your game is called a Selector. Selectors are variables that can take several predefined values called Selector Labels. At run-time, the Cues will check the value of Selector and only play the tracks that are associated with the appropriate Selector Label. Here, we will use Selectors to make the music change according to the game action. We are also going to introduce the BeatSync feature in this section.<\/p>\n

\"Blog<\/p>\n

There is a Cue type of in AtomCraft, specifically designed for music tracks using Selectors, called “Track transition by selector”. Unlike other Cue types, when the selector label is changed during playback, the Track will transitions and crossfade automatically to the Track with the matching selector label. It means that music tracks can be easily switched depending on the game context and it can be done with minimum resource consumption. It is also possible to change the music tracks in sync and at specific timing (e.g. only on the 1st beat of every measure of a 4-bar loop).
\nA transition by Selector has a lot of benefits:<\/p>\n

\"ADX2<\/p>\n

However, a Cue of type “Track transition by selector” has also many restrictions. Therefore, this Cue type must be specified when it is created and cannot be changed afterwards.
\nRestrictions:
\n\u2022 You cannot register multiple Waveforms to one Track
\n\u2022 You can only place the Waveform at the start time of the Track (00:00:00)
\n\u2022 You cannot use sequence Markers with this type of Cue
\n\u2022 It cannot be used in conjunction with the block feature
\n\u2022 You must set a selector label to each Track (each selector must be different)
\n\u2022 You cannot set random playback timing to a Waveform region
\n\u2022 You cannot use the Subsequence and the CueLink functions
\n\u2022 You must set the Beat-Sync information
\n\u2022 Sampling rate must be the same for each Waveform<\/p>\n

Step by Step<\/strong><\/p>\n

Step 1<\/span><\/em>: Create the Cues
\nRight-Click on a CueSheet, select \u201cNew Object\u201d and click \u201cCreate Cue Track Transition by Selector\u201d.<\/p>\n

\"ADX2_IM_21b\"<\/p>\n

Step 2<\/span><\/em>: Create a Selector and Selector Labels
\nThe first thing we need to create is the Selector. In the Global Settings section of the project tree, right-click on the Selector Folder, select \u201cNew Object\u201d and then click on \u201cCreate Selector\u201d. The Selector will appear and we will rename it \u201cMusic\u201d.<\/p>\n

\"ADX2_IM_22\"<\/p>\n

Now we need to create the Selector Labels. Right-click on the Selector, select \u201cNew Object\u201d and then click on \u201cCreate Selector Label\u201d. A new Selector Label will appear and we will rename it \u201cNavigation\u201d. We need to create one Selector Label for each of our music track (Navigation, combat …)<\/p>\n

\"ADX2_IM_23\"<\/p>\n

Step 3<\/span><\/em>: Assign your Selector Labels
\nTo assign a Selector to a music Track: click on the Selector tab, specify which Selector to use and select a Selector Label.<\/p>\n

\"ADX2_IM_24\"<\/p>\n

Step 4<\/span><\/em>: <\/strong>Add your music
\nSimply drag and drop your music on the right track.<\/p>\n

\"ADX2_IM_25\"<\/p>\n

Step 5<\/span>:\u00a0<\/strong><\/em>Create the Beat Sync Parameter
\nThe BeatSync feature allows for a seamless transition between music tracks, while staying in sync with the tempo and\/or the beat divisions. It is also possible to change the volume in sync with the beat during playback.
\nTo insert a BeatSync Parameter: right-click on the timeline, select \u201cNew Object\u201d and choose \u201cCreate BeatSync Parameter\u201d.<\/p>\n

\"ADX2_IM_26\"<\/p>\n

\"ADX2_IM_27\"<\/p>\n

Finally specify the start time, BPM and select on which beats you want the music to change.<\/p>\n

\"ADX2_IM_28\"<\/p>\n

Step 6<\/span><\/em>: <\/strong>Adjust the crossfading
\nClick on the cue track and set the fade in and fade out time.<\/p>\n

\"ADX2_IM_29\"<\/p>\n

Step 7<\/em><\/span>: Listen to the result and adjust the parameters.
\nIt is possible to test the implementation in the Session Window. To open the Session Window: select your Cue, click on the \u201cView\u201d menu and open the Session Window.<\/p>\n

\"ADX2_IM_30\"<\/p>\n

Click the play button and change the Selector Labels to transition between tracks.<\/p>\n

\"ADX2_IM_31\"<\/p>\n

 <\/p>\n

Working with AISACs<\/strong><\/span><\/p>\n

The last feature in AtomCraft that allows you to implement interactive music in your game is called AISAC.
\nAISAC is a system allowing the control of audio parameters by values coming from the game. This kind of feature is also often called Real-time Parameter Controls (RPC or RTPC) by sound designers. In AtomCraft, it is possible to use this feature to implement interactive music. In that case, the game will send a value to the Cue which will then change the music in real-time in order to make it follow the action. For instance, with AISACs it is possible to fade-in and out music layers depending on what is happening in the game.<\/p>\n

\"ADX2_IM_32\"<\/p>\n

Transitioning with AISAC offers a lot of benefits:<\/p>\n

\"ADX2<\/p>\n

Step by Step<\/strong><\/p>\n

Step 1<\/span><\/em>: Create an AISAC Control
\nFirst we need to create an AISAC Control in order to make the link between the game and the AISACs. An AISAC Control is simply an identification name that allows the programmer to pass a value from the game to ADX2 so that it can be mapped to an AISAC curve.<\/p>\n

\"Blog<\/p>\n

To create an AISAC Control: go in the Global Settings section of the project tree, right-click on the AISAC-Control Folder, select \u201cNew Object\u201d and then click on \u201cCreate AISAC-Control\u201d.<\/p>\n

\"ADX2_IM_33\"<\/p>\n

Let\u2019s simply name it \u201cMusic\u201d.<\/p>\n

Step 2<\/span><\/em>: <\/strong>Create AISACs
\nTo add an AISAC to your first music layer: select the Track, click on the \u201c+\u201d button in the AISAC pane and select \u201cAdd AISAC\u201d.<\/p>\n

\"ADX2_IM_34\"<\/p>\n

A window called \u201cAdd AISAC\u201d will appear, allowing you to associate a parameter with the new AISAC control. Select your AISAC Control \u201cMusic\u201d and choose the \u201cVolume\u201d Graph type.<\/p>\n

\"ADX2_IM_35\"<\/p>\n

Step 3<\/span><\/em>: Once the window closed, the AISAC tab is selected in the FX \/ AISAC panel at the bottom of the main window and a default line is drawn. We can now draw our volume curves. Simply click on the line to add points and drag them to shape the curve (you can also type in the values directly in a pane on the right).<\/p>\n

\"ADX2_IM_36\"<\/p>\n

To change the curve type of your AISAC: simply right-click on a dot.<\/p>\n

\"ADX2_IM_37\"<\/p>\n

Step 4<\/span><\/em>: Repeat the same process for all your music layers.<\/p>\n

\"ADX2_IM_38\"<\/p>\n

Step 5<\/span><\/em>: Listen to the result and fine-tune your AISACs.
\nPlay the Cue and while the music is looping drag the AISAC cursor from left to right in order to hear the AISAC affecting the music. Finally, adjust your volume curves accordingly.<\/p>\n

\"ADX2_IM_39\"<\/p>\n

 <\/p>\n

Demo project<\/span><\/strong><\/p>\n

To listen and look at some examples of interactive music implementations, we have created a small AtomCraft project that you can download below:<\/p>\n

\"\"<\/a><\/p>\n

[This project requires AtomCraft version 2.27 or higher]\n

In this project, we simulate a game with 4 states:<\/p>\n

\"Blog<\/p>\n

The music was made and implemented to accommodate a simple gameplay sequence in which the player has to navigate and fight enemies. First, the navigation music will play and if the player encounters an enemy the music intensity will start to increase.<\/p>\n

You will find 2 Cues named Blocks and AISAC. With these 2 Cues, we demonstrated the implementation of interactive music using the some key features we have explained in this post: Blocks & AISACs.<\/p>\n

Using the AISACs (click on the picture to watch the video)<\/span><\/p>\n

\"ADX2_IM_40\"<\/a><\/p>\n

Using the Blocks (click on the picture to watch the video)<\/span><\/p>\n

\"ADX2_IM_41\"<\/a><\/p>\n

This concludes our post about the ADX2\u2019s interactive music system. Let us know if you want to learn more about a specific ADX2 feature!<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

This post explains how to implement interactive music in your game with AtomCraft.   Music in Video Games In our<\/p>\n","protected":false},"author":2,"featured_media":1060,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"colormag_page_container_layout":"default_layout","colormag_page_sidebar_layout":"default_layout","footnotes":""},"categories":[5,7],"tags":[],"class_list":["post-1017","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-adx","category-tutorials"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/blog.criware.com\/index.php\/wp-json\/wp\/v2\/posts\/1017","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.criware.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.criware.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.criware.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.criware.com\/index.php\/wp-json\/wp\/v2\/comments?post=1017"}],"version-history":[{"count":26,"href":"https:\/\/blog.criware.com\/index.php\/wp-json\/wp\/v2\/posts\/1017\/revisions"}],"predecessor-version":[{"id":1094,"href":"https:\/\/blog.criware.com\/index.php\/wp-json\/wp\/v2\/posts\/1017\/revisions\/1094"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.criware.com\/index.php\/wp-json\/wp\/v2\/media\/1060"}],"wp:attachment":[{"href":"https:\/\/blog.criware.com\/index.php\/wp-json\/wp\/v2\/media?parent=1017"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.criware.com\/index.php\/wp-json\/wp\/v2\/categories?post=1017"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.criware.com\/index.php\/wp-json\/wp\/v2\/tags?post=1017"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}