don't click here

The sound drivers of Sonic the Hedgehog

Discussion in 'General Sonic Discussion' started by Clownacy, Apr 18, 2021.

  1. Clownacy

    Clownacy

    Tech Member
    1,060
    607
    93
    (This is a cross-post of one of my blog posts, where I go over the technical background of the various SMPS drivers used by the Sonic series. I figure this info is relevant enough to belong here rather than left hidden on some random blog.)

    The majority of the ‘classic’ Sonic games use the same generic sound driver, dubbed ‘SMPS‘ by the ROM-hacking community (and ‘Sound-Source’ by ex Mega Drive musicians). These games include…
    • Sonic the Hedgehog
    • Sonic the Hedgehog 2
    • Sonic the Hedgehog CD
    • Sonic the Hedgehog 3
    • Sonic & Knuckles
    • Chaotix
    • Sonic 3D: Flickies' Island
    Even some of the more loosely-related games like Flicky and Sonic the Hedgehog’s Gameworld use SMPS.

    However, these weren’t copy-and-paste jobs: it’s not like these games all used the exact same sound driver unmodified from 1991 through to 1996. Oh no, the majority used heavily modified versions of SMPS, each specifically suited to its respective game.

    SMPS
    But what is SMPS? Well, it was Sega of Japan’s custom in-house sound driver. It was neat, and let you do a bunch of fancy stuff with the hardware. It evolved over the lifespan of the Mega Drive, and, according to ValleyBell, even existed before the Mega Drive, with a primitive version of it being found in old Sega arcade games (particularly Space Harrier). SMPS even made its way to other platforms, such as the Sega Mega CD (utilising its 8-channel PCM sound chip), the Sega 32X (using its PWM sound channels), the Sega Master System, and the Sega Pico.

    To make things even more confusing, two distinct versions of SMPS existed: one for each of the Mega Drive’s CPUs. You see, the Mega Drive features a Motorola 68000 as its main CPU, and a Zilog Z80 as a sound co-processor. Running a sound driver on either CPU has its upsides and downsides, and so, to allow their developers the ability to choose whatever works for them best, Sega maintained two entirely separate versions of SMPS. These versions are commonly known as ‘SMPS 68k’ and ‘SMPS Z80’.

    Sonic the Hedgehog
    Let’s start at the beginning: Sonic 1 used a pretty bog-standard version of SMPS 68k, known as Type 1b. Essentially, it was the second minor revision (b) of the second major revision (1) of the driver.

    Modifications to this particular driver include the removal of unneeded features such as ‘panning animation’, and the addition of custom features such as the ability to play the famous “Se-ga” sound. We know from the game’s prototype that many of these modifications were made late into the game’s development.

    The curious thing about this game’s sound driver is that it’s SMPS 68k, and not SMPS Z80. As I said, each version had its strengths and weaknesses, and Sonic 1 doesn’t make use of SMPS 68k’s strengths at all. If anything, SMPS 68k was a burden: using up 0x5C0 bytes of RAM and costing precious 68k cycles.

    ValleyBell (an expert in all things SMPS) claims that a likely reason for this is that no version of SMPS Z80 existed at the time that could play drums using the Mega Drive's DAC sound channel - a channel which is capable of playing audio clips. Without this, the developers would have been forced to use synthesised FM drums instead. Games using such a version of SMPS Z80 only started appearing after the release of Sonic 1, suggesting that this theory is correct.

    Speaking of the DAC channel, one of this driver’s quainter modifications is that its DAC driver was compressed (the DAC driver is basically a small subprogram that runs on the Z80 and supplies decoded audio data to the DAC channel). Many other games simply leave it uncompressed on the cartridge when there’s no good reason to. This modification saves a considerable amount of cartridge space, especially considering that the DAC driver contains most of the game’s DAC audio samples (DPCM data is massive).

    Sonic the Hedgehog 2
    Now this is where things get interesting. Sonic 2's sound driver is by far my favourite, particularly for the sheer insanity behind its creation. You see, Sonic 2's sound driver runs on the Z80. Did the devs finally get their hands on a brand new version of SMPS Z80 that they supposedly wanted to use in the last game?

    No, no they did not. Instead… they rewrote Sonic 1's sound driver in another assembly language so that it would run on the Z80. Not only that, but in the process they fixed countless bugs and created a driver that was considerably leaner, cleaner, and lighter than even the real SMPS Z80.

    In addition, they modified the driver to support compressed music data – a feature I’ve only seen in one other SMPS game (that being Mega Man: The Wily Wars). They were able to do this, despite the decompressed music data taking up a considerable amount of the limited Z80 RAM, because this converted driver was just so efficient that there was plenty of RAM to spare.

    Safe to say, even to this day, I am beyond impressed with this driver. This was not an automated thing, mind you: this port was done 100% by hand, and whoever did it was nitpicking every little design choice in the original driver and implementing it even better in theirs.

    The only downside to this sound driver is just how specialised it is: like Sonic 1’s driver, features that were unused were removed. This includes the “background SFX” system previously used by Green Hill Zone’s waterfalls. SMPS 68k already lagged behind SMPS Z80 in terms of features, and with even more features being ripped out during the development of both Sonic 1 and 2, I do unfortunately consider Sonic 2’s driver something of an ‘SMPS-lite’.

    Sonic the Hedgehog CD
    This game’s unique because it uses two different versions of SMPS: SMPS PCM for music, and SMPS Z80 for sound effects.

    SMPS PCM is the Mega CD port of SMPS. It’s based on SMPS 68k because the Mega CD only has a 68000 CPU. In lieu of the Mega Drive’s FM, PSG, and DAC sound hardware, SMPS PCM makes use of the Mega CD’s 8-channel PCM chip. This driver is used to play the music of the game’s past levels.

    The PCM chip was not ideal for playing the game’s SFX on, so another sound driver was used to play SFX on the Mega Drive’s sound hardware instead. For this, the developers chose SMPS Z80 Type 1 FM (‘FM’ referring to its inability to use DAC drum samples, instead opting for synthesised FM versions).

    In keeping with tradition, this driver was heavily modified. The largest modifications were to work around a problem specific to Mega CD games: without a cartridge, there was nowhere for the Z80’s data to go… except for RAM, that is. The devs needed to fit, not only the driver (both its variables and code), but also all of the game’s SFX in the Z80’s measly 0x2000 bytes (8KiB) of RAM.

    To address this, they once again began removing features that weren’t needed. In particular, they removed the driver’s ability to play music. As this driver was meant for nothing more than playing SFX anyway, this was fine. But still, it’s a rather major modification to make. Also, since they realised SFX would no longer be competing with music for access to the console’s sound hardware, they extended the SFX from being able to use only 3 of the console’s FM channels to having access to all 6.

    The final modification they made is perhaps the most controversial: in order to save even more RAM, the devs also removed the driver’s ability to use the console’s PSG sound hardware. This limited all of the game’s SFX to FM only. As many of Sonic CD’s SFX are recycled from Sonic 1, this meant that some PSG-specific sounds had to be converted to FM. One such SFX was the jump sound, which has gone on to create something of a rift in the fanbase, with some preferring it to the original, and others hating it.

    The ironic thing is that this modification wasn’t even necessary: in 2018 I made a ROM-hack of Sonic CD that replaced its driver with the one from Sonic & Knuckles, without needing to remove its support for PSG SFX:



    The comment section of this video will be quick to tell me that the FM SFX were better anyway.

    [Update: Apparently the developers actually removed PSG support because the official Mega CD developer manuals claimed that the Z80 could not use the PSG while the console was in CD mode. Personally, I haven't seen any proof of this actually being the case, as my aforementioned ROM-hack works just fine on real hardware. Thanks to MarkeyJester for this information.

    I think part of the reason that the developer manuals advise against the Z80 using the PSG is that the PSG actually exists in the 68k's address space, not the Z80's. Perhaps there is some kind of unknown hardware quirk where the Mega CD hardware can affect the 68k's address space in a way that causes the Z80 to fail to access it. This could be similar to how VDP DMAs can cause the Z80 to stall when it accesses the cartridge window.]

    Sonic the Hedgehog 3, Sonic & Knuckles, and Sonic 3D: Flickies' Island

    These three games all use the same driver, aside from some differing DAC samples and the occasional bug. At this point, I suppose Sonic Team finally got their hands on a suitable version of SMPS Z80 (particularly Type 2 DAC), and replaced their ageing SMPS 68k Type 1b-based setup with it. A shame, really: Sonic 2’s driver really was cool.

    Curiously, Sonic 3D Blast’s ROM contains a little developer message:

    Sound Driver for Sonic Series
    Coded by Y.Kashima & M.Sets.
    Sun Sep 1 1996 17:02​

    It’s interesting that they describe this as ‘Sound Driver for Sonic Series’, suggesting that this was intended to be the driver used by all future Sonic games for the console. Having some developer credits is nice too.

    Once again, this driver was heavily modified, though not quite as much as earlier games. If anything, I’d put it roughly on par with Sonic 1’s driver: some unused features were removed (often poorly, resulting in a bunch of leftovers), a couple of series-staple features were added (such as the ring SFX alternating between the left and right speakers), and a few unique features were implemented (namely the Universal FM Voice Bank and Continuous SFX system), but overall it’s nothing too fancy.

    If anything, I think what this driver is most noteworthy for is just how buggy and poorly-made it is. A large part of this blame rests on SMPS Z80 itself: being the ‘original’ version of SMPS (SMPS 68k started off as a 68k port of SMPS Z80), this driver’s codebase is ancient, and has accumulated numerous poor design decisions over the course of its life.

    The code in general is hideous and bloated, doing completely unnecessary things such as…
    Countless bugs have also accumulated from the many overhauls, upgrades, and downgrades the driver had undergone in the past.

    Frankly, to go from Sonic 2’s driver to this is just depressing. This driver is also so bloated that it genuinely has trouble fitting in the Z80’s RAM. Remember how Sonic 2’s driver was so lean that it had enough spare RAM to fit a music decompression buffer?

    The only real upside to this driver is how many features it has, despite removing a bunch to fit itself in RAM (such as the SFX priority system, pitch-bending, and the music’s ability to use the sixth FM channel).

    Chaotix
    Apparently I’m not the only one who thought the previous driver sucked, because Chaotix starts over from scratch with a brand new one. Using a clean copy of SMPS Z80 Type 2 DAC as a base, a brave developer known as ‘Milpo’ set about righting some of the wrongs of the previous driver. It’s still a little rubbish because it’s SMPS Z80, but I've got to give credit where it’s due.

    What’s notable about this driver is that it started off as a regular Mega Drive sound driver, but was later extended to support the 32X during Chaotix’s development. To my knowledge, this driver is not related to the ‘official’ SMPS 32X driver seen in other games such as Metal Head, as that driver is based on SMPS 68k instead of SMPS Z80.

    Specifically, this driver gained support for an extra four percussion tracks, using four PWM channels on the 32X. As four percussion tracks was pretty overkill, support for the driver’s original percussion track (that being the DAC channel) was removed.

    Another special thing about this driver is that it apparently has a name, according to a little developer comment hidden in its code:

    casablanca version by MILPO​

    [Update: 'Casablanca' actually seems to be the codename for Chaotix, as it apparently appears in the credits sequence of the game's prototypes. Thanks to Black Squirrel for this info.]

    Unfortunately, of the drivers I’ve covered here, this is the one I have by far the least experience with, so there’s not much more I can say about it. I suppose one last bit of trivia I can give is that this driver’s DAC capabilities were enhanced despite them eventually being removed: namely, the “Sonic Crackers” prototype featured automatic bank-switching.

    Closing
    SMPS is fun. Many times, devs seemed to just leave it unmodified, but when they did modify it, oh boy the things they would do with it.

    Honestly, I think modern programmers could learn a thing or two from SMPS – it wasn’t a general-purpose software library that was limited to the features it came with by default, and which you were expected to treat like a black-box: if you wanted a special feature, you could add it yourself. SMPS was simply designed to be played with, being distributed to developers in source code form. It reminds me of the dwm window manager, which, rather than rely on configuration files, requires its users to modify its source code to change its behaviour. Some developers took this to heart, and maintained their own forks of SMPS, such as the SMPS Treasure variant.

    All that rambling aside, the details of Sonic’s history with SMPS don’t seem to be very well documented, so hopefully this post has changed that.
     
    Last edited: May 27, 2022
    • Informative Informative x 16
    • Like Like x 5
    • List
  2. The Joebro64

    The Joebro64

    SAY HELLO TO MY CHOCOLATE BLEND Member
    2,967
    2,593
    93
    This is fantastic research and I give many thanks to you for it. Interesting to know that the jump sound effect change in Sonic CD was unnecessary - it's kind of surreal hearing the normal sound play in Palmtree Panic, heh.
     
  3. Black Squirrel

    Black Squirrel

    no reverse gear Wiki Sysop
    8,585
    2,481
    93
    Northumberland, UK
    steamboat wiki
    Little thing - I am relatively sure "Casablanca" was the codename for Chaotix as a whole, given the name turns up in prototype credits sequences.
     
    • Informative Informative x 6
    • List
  4. Clownacy

    Clownacy

    Tech Member
    1,060
    607
    93
    Ah, okay. I'll amend the blog post with that info, thanks.
     
  5. XCubed

    XCubed

    Will Someday Own a Rent-A-Center Oldbie
    It’s reasons like this why I’ve continued coming here. This was a great read! I learned a lot here. Thank you @Clownacy !
     
    • Agree Agree x 2
    • Like Like x 1
    • List
  6. nineko

    nineko

    I am the Holy Cat Tech Member
    6,308
    486
    63
    italy
    Ha, so it is possibile to use two sound drivers at the same time, now I wonder if one of my dead projects could have stayed alive for a little longer.
     
  7. Aesculapius Piranha

    Aesculapius Piranha

    つづく Oldbie
    4,534
    143
    43
    Unknown
    Diva
    Great post, and didn't know this. Maybe I'll have some fun trying to recreate these sounds in Dexed.
     
  8. MarkeyJester

    MarkeyJester

    Original, No substitute Resident Jester
    2,200
    431
    63
    Japan
    I remember talking with Stealth about the whole PSG thing many years ago, and he seemed to be under the impression the Z80 could not access the PSG portion of the VDP whilst in Mega CD Mode 2.

    Further reading through several manuals I came across this:

    [​IMG]

    I suspect either the emulator you're using in that video is incorrect, or the manual is, unfortunately I don't have a US or Japanese Mega CD to test those ISO changes. But whether it's the manual that's wrong or the emulator, the reason they used FM jump, skid, etc, is because they were led to believe (incorrectly or correctly) that their Z80 was not allowed to access the PSG, so there's no reason as far as they're concerned to keep the code in.

    ---

    With that aside though, it was a very nice read! I didn't know about the casablanca thing, nor did I notice the Cracker's driver had auto-bank switching which is nice to know~
     
  9. Clownacy

    Clownacy

    Tech Member
    1,060
    607
    93
    Good catch. That said, I've tested my custom driver on real hardware, and the PSG works fine. I have no idea why the manual claims the PSG wouldn't work, since all the Mega CD does is add the BIOS, WORD-RAM, PRG-RAM, and a couple of IO ports to the 68k's address space.

    Edit: I've checked the drivers used by the Mega CD BIOSs: the majority of them also remove PSG support, but the Japanese ones don't. Very odd.
     
    Last edited: Apr 22, 2021
  10. Swifthom

    Swifthom

    A Friend Remembers... Member
    165
    51
    28
    This is fantastic - and great to read. I've just been doing a load of reading on why Spinball sounds so different, and learnt about the difference between GEMS and SMPS - so to learn more is fantastic. Thanks for sharing
     
  11. Diablohead

    Diablohead

    Indie dev Oldbie
    1,898
    87
    28
    Near London
    games
    It's often overlooked but the sonic 1 waterfall noise is something I miss in later games.
     
  12. Prototype

    Prototype

    Member
    296
    68
    28
    Absolutely fascinating thread. I do have to say though, I honestly never noticed GHZ in Sonic 1 having special SFX for the waterfall. Neat.

    Also, side-speculation that may be more suited for a Chaotix thread, as for the origins of the Project Casablanca name, given that Casablanca translates to "White House", could it have been a reference to the fact that the 32x was predominately a stateside project? Random thought.
     
  13. I remember Sonic 2 SMTP (a ROM hack) used the waterfall SFX for Emerald Hill's waterfall and that made wonder why Sonic 2 and Sonic 3 never used that originally.
     
  14. ezra

    ezra

    or "Fuzzy" Member
    Great thread/blogpost! It's nice to see SEGA's old sound drivers being discussed in detail.

    Now we combine all of the variants!
     
  15. ValleyBell

    ValleyBell

    Tech Member
    246
    25
    28
    researching PC-98/X68000 sound drivers
    Let me add a bit more trivia regarding Sonic SMPS drivers:

    Sonic CD SMPS
    The SMPS-PCM (the MegaCD driver) is based on SMPS 68k/Type 1, i.e. the version Sonic 1's sound driver is based on as well
    The initial version, used in the JP BIOS, is the most complete one.
    For the US BIOS v1, they removed a few of features, including frequency modulation. (really a pity, IMO) On a positive side, the US BIOS supports a 32-bit sample loop offset, which was 16-bit in the JP BIOS.
    Sonic CD's SMPS-PCM driver is based on the US BIOS one and the driver in SNCBNKB1.BIN is an exact match.

    Sonic's Gameworld (and Sega Pico SMPS)
    Sega Pico games like Sonic Gameworld are based on SMPS 68k/Type 2.
    Of course they removed all features related to FM. But they support 4 PSG channels. PSG drums work in a way similar to 8-bit SMPS.
    The PCM channel, which is used for voice samples most of the game, can be controlled by music as well. And it is used in a few songs in Sonic's Gameworld (J).
    For whatever reason, the US version removed all PCM samples from the music.

    Master System/Game Gear SMPS
    8-bit SMPS is where it gets really interesting.
    My theory for 8-bit SMPS is, that they ported MegaDrive SMPS back to the SMS/GG at some point.
    8-bit SMPS as it is used in Sonic 2/Chaos/Triple Trouble follows the structure of MegaDrive SMPS closely.
    The SMPS header still contains the pointer originally meant for FM instruments and it still has 2 fields for the number of used channels. (remnants of separate FM and PSG channel counts)

    Interesting fact I noticed recently thanks to nineko: In Sonic 2/Chaos/TT, the channel count fields are "PSG, unused". In Rainbow Islands, the fields are "unused, PSG" (similar to MegaDrive SMPS versions, where it is "FM, PSG").

    8-bit SMPS also adds a cool feature where it lets you program ADSR envelopes for the PSG channels directly inside the sequence. (This feature somehow made it back into MegaDrive Castle of Illusion in some modified form.)
    The first chord in Gimmick Mountain Zone that fades in uses such a custom ADSR envelope. The feature is only used sparsely in Sonic games though. (unlike e.g. Rainbow Islands, which uses it almost exclusively for defining PSG instruments)

    Arcade: Sega System C-2 SMPS
    There is a huge lack of research regarding SMPS on arcade systems and so far I only had a look at Waku Waku Sonic Patrol Car.

    Arcade SMPS is a completely different branch. Almost everything is coded differently from MegaDrive SMPS 68k.
    For example frequencies:
    • MegaDrive/MasterSystem SMPS stores the raw FM/PSG frequency value and applies effects like detune and modulation on it.
    • Arcade SMPS stores a note + a 1/32 note fraction, applies detune/modulation and then converts it to the FM/PSG frequency value that is sent to the sound chip
      fun fact: This is close to the behaviour that the 32X devkit manual describes regarding how modulation/detune works.

    Coordination flags use roughly the same IDs as SMPS Z80 on the MegaDrive, but are implemented differently.


    Also, regarding SMPS/Treasure: The SMPS driver on the 68k side is barely different to stock SMPS 68k/Type 2. (aside from a bit of optimized addressing here and there)
    What sets SMPS/Treasure really apart from other SMPS drivers is the DAC driver, which supports buffered 2-channel DPCM mixing.
     
    Last edited: May 1, 2021
    • Informative Informative x 4
    • Like Like x 2
    • List
  16. Chainspike

    Chainspike

    Stealing rings since 1994 Member
    173
    90
    28
    Death Egg Zone
    S3C Delta
    This was quite an interesting and informative read. Nicely done.
    I'm curious about this. What makes the Green Hill Zone waterfalls unique compared to other sound effects?
    This is intriguing. I've always wondered how the SMS/GG sound developers were able to achieve some of those effects with the more limiting hardware.
     
  17. Clownacy

    Clownacy

    Tech Member
    1,060
    607
    93
    Special SFX are a standard feature of SMPS - they weren't invented for Green Hill Zone's waterfalls. In SMPS's source code, they're called 'back(ground) sound effects', which explains their purpose a bit better.

    They can only use one FM channel (FM4) and one PSG channel (PSG3), and I suppose what makes them special compared to regular SFX is that they're not 'erased' when another SFX plays: normally, when one SFX interrupts another, the earlier SFX disappears (or, at least, the parts of it that use the same channels as the new SFX do). Special SFX are merely muted until the SFX ends, and then they resume, similar to music.
     
    Last edited: May 27, 2022
    • Like Like x 2
    • Informative Informative x 1
    • List
  18. Blastfrog

    Blastfrog

    See ya starside. Member
    This is a really cool article, I had no idea how complicated SMPS variants could be! I wonder why they didn't stick with the S2 driver in 3K. One thing I'm curious about is the driver in the Wai build, I've heard it differs from the final in some way.
     
  19. Clownacy

    Clownacy

    Tech Member
    1,060
    607
    93
    The Simon Wai prototype's driver is just a slightly earlier version, so it has a few more similarities to Sonic 1's driver. For instance, it still uses the original song tempo algorithm (which apparently supports a much more limited range of tempos), and it still has support for Marble Zone's block-pushing SFX (it needs special logic to repeat seamlessly without overlapping itself). It also doesn't support compressed music data.
     
    • Informative Informative x 1
    • List
  20. Brainulator

    Brainulator

    Regular garden-variety member Member