Okay maybe we have something here

So I had a weird dream about travelling and the importance of checking that no one is travelling to your location before travelling somewhere else. This has nothing to do with the idea buuuuuut I woke up thinking about the whole procedural music generation.

Here's the thought of the need and where to put it, I'm a DM for a Dnd game that we play online, once a month me and a couple of friends + my wife get together and for a few hours I get to transport them into whatever adventure I have prepared for them, the systems that I use to both prepare and transmit the expirience are really common in the community. Things like dndbeyond for character sheets, Roll20 for map sharing and discord for comms. It is my job to set the tone and describe the adventure to the best of my ability so that my players feel invested and want to interact.

If I had more arms, I would love to be able to help the setting of the mood through music, sometimes one of the players helps me by using a discord bot to play music that fits whatever else is going on in the story BUT it would be really cool if there was a system that could automatically determine music to be played at certain moments based on either my narration or the pace of the campaign!

ALRIGHT

Let's try to explain the levels of how this would work. We either have:

A. A system that recognizes speech patterns and is trained to perceive keywords that would then pick from a selection of music to play the correct track based on the moment.

B. A system that can generate music and procedurally create music that fits the scene based on easy key words that can be served as input (intense dungeon vs calm market)

or C. A combination of the 2? like a system that can recognize speech patterns and is continuously making new music on the spot to adapt to how the narration is going.

In reality I'm not even sure if any of these would be doable in the course of the class but it would definitely help me manage the experiences a lot better.

It would also need to be a system that can either be inplemented as a bot for discord or has a selection of outputs to choose from so that I can select either an auxiliary exit or a different channel to feed it into discord. Worst case scenario it could work offline as well but I think the lack of a microphone picking up everything the DM says as part of the game may difficult the speech recognition process.

Anyways, here's where everything is so far. I'm unsure on what the true scope for this type of project could be but I feel like it could be a cool thing to make.