XMI/MIDI Background music using mp3 files

Discussion in 'General Discussion' started by kicnlag, Sep 9, 2016.

  1. bijaz

    bijaz Member

    Messages:
    58
    Hmm might have been my client zip, at one point I was copying in a bunch of stuff into the resource folder trying to get the sound running.
     
  2. Haynar

    Haynar Administrator

    Messages:
    3,637
    I was trying all sorts of things too. Could be where that zip came from originally. No clue. Was just happy to get music playing and some of area specific sounds going. I was only running around pok. Didnt have time to play with other zones yet.
     
  3. kicnlag

    kicnlag Active Member

    Messages:
    65
    It looks like those missing files fixed some of the wav sounds (the ones located in the pfs files) but not the xmi files.

    I have to admit when I was playing with the xmi stuff and found out the wav files weren't playing as well I was kind of shocked. While converting them to mp3s worked I believe there was something like 3000 of them.

    The good news is that this discovery compliments the xmi->mp3 workaround to bring more sound to the game.
     
  4. Haynar

    Haynar Administrator

    Messages:
    3,637
    I will look at the xmi's closer. And see what the intel client is loading. There may be a format issue. I might grab my ppc build, and see what files are in there and/or what is on original eqmac install cds.
     
  5. Yinn Yang

    Yinn Yang People Like Me

    Messages:
    543
    If it's any help, I started on AK with an old PPC PowerMac (running Tiger OSX), the xmi files didn't play on there either... but they were present in the game directory.
     
  6. kicnlag

    kicnlag Active Member

    Messages:
    65
    Heres an interesting bit from http://www.radgametools.com/msshist.htm
    And this bit:

    The second bullet gives me the feeling that the files (given the presence of mssmixer.mix) might have been sent with the intel mac client at one point.
     
  7. Tudo Bem

    Tudo Bem Member

    Messages:
    27
    Have we got this down to a process where a dummy like me could unzip the files and put them in the correct place or is that still a while off?

    Tudo
     
    Mambo likes this.
  8. Yinn Yang

    Yinn Yang People Like Me

    Messages:
    543
    I believe the devs are working on getting the lost/missing music into both the Mac and PC downloadable game files (from the wiki). I'm going to hold off til they get it all worked out (which sounds like soon). Think it's trial & error right now, but getting very close.

    Our original post was only in reference to the old xmi files not playing on a Mac (but playing on the PC hack version, like Secrets) but if I understand correctly, in the process of looking into that, they have discovered music/sound effects that were also not playing in our PC client. So, they are getting to the point where, not only will missing music appear in the Mac client, the missing sounds on PC client will also re-emerge. Possibly even the long lost Luclin music that Daybreak discovered? Correct me if I'm wrong, but I believe that's the status.

    Pretty exciting to me :) Been curious about this for years! I know not everyone listens to EQ music, but to me, it's like removing the soundtrack from a good movie... just not the same. I always missed it on AK.
     
    Last edited: Sep 14, 2016
  9. drktmplr12

    drktmplr12 Member

    Messages:
    38
    I'm one of the few people that didn't turn off music and I think this is great news. I still remember there being music in so many places that it does not currently play at (pc client). Can't wait for an update.
     
  10. Haynar

    Haynar Administrator

    Messages:
    3,637
    I can tell you. With these fixes, PC client plays music everywhere.

    We have been playing with software based midi synthesizers on PC, and it makes a HUGE difference too.

    There is a release candidate up on the wiki for DL of PC client. Get it. Test it out. See if you find issues. It should be in about its final state. We had people running all over luclin zones, working on getting the mp3s playing.

    I think the mp3's from luclin are included. The ones that DBG "found" recently. So many of the dead silent luclin zones will have music too.

    H
     
  11. robregen

    robregen Administrator Staff Member

    Messages:
    8,384
    Luclin are not included in RC but will be included in RC2. Hope to get them out this week if not today.
     
  12. Haynar

    Haynar Administrator

    Messages:
    3,637
    My bad. I thought RC2 was up already.
     
  13. robregen

    robregen Administrator Staff Member

    Messages:
    8,384
    RC2 is now up on the wiki that includes the luclin music. enjoy
     
  14. Yinn Yang

    Yinn Yang People Like Me

    Messages:
    543
    When I ran around Freeport and Qeynos with the original PC client, I always heard the music and assumed all PC client music was working, guess not.

    On another subject: when/if the Mac client has the xmi music restored, does it look like it will be the xmi playing thru midi synth, or will it be mp3 files which have replaced the xmi's? Am I making sense?
     
  15. Yinn Yang

    Yinn Yang People Like Me

    Messages:
    543
    Thanks Rob! Looking forward to hearing the Luclin stuff!
     
  16. Tudo Bem

    Tudo Bem Member

    Messages:
    27
    YEA !!! music in North Ro now...my fav music....how long to make all these toons to work on the Mac side?
    :) :) :)
     
    Yinn Yang and Oiwon like this.
  17. Haynar

    Haynar Administrator

    Messages:
    3,637
    Macs may require conversion of midi stuff to mp3. I think its doable. May just take more effort. But we are sure going to give it a go.

    H
     
  18. Bum

    Bum I Feel Loved

    Messages:
    2,647
    I nominate Seduce for that task
     
    Yinn Yang likes this.
  19. Yinn Yang

    Yinn Yang People Like Me

    Messages:
    543
    I second that ^^^

    If I'm not mistaken, Seduce had already started doing perfect (if not improved) mp3 renditions of the xmi music files, had done 7 or 8 I think. I also had virtually all converted to mp3 from xmi at some point (a couple of years ago). I don't recall which tool I used, but I may still have them somewhere.

    Sounds like that's what Kicnlag did also, converted to mp3 from xmi:

    "I used XMPlay with the MIDI plugin to playback and encode the audio.
    The MIDI plugin was loaded with 1mgm.sf2 as well as synthusr.sf2 and synthus2.sf2 from the game directory.
    Each subsong was saved as its own mp3 in the format <original xmi>(subsong #).mp3 for example qeytoqrg.xmi(6).mp3, the Sayer house music in Qeynos Hills.

    There is a lot of room to create mp3s that use different soundfonts, software, or methods of capture. I took a relatively easy path that I personally found to be good enough(tm).
    Getting someone with sound expertise to create the mp3s would be another path to explore.
    "
     
    Last edited: Sep 15, 2016
  20. Seduce

    Seduce Member

    Messages:
    49
    Hiya Yinn!

    Yes you are right, was talking to hobbart from Sony online entertainment and was going to do a zone by zone recreation of all the music played by myself. Here were a few examples I did for them from that time.

    https://dl.dropboxusercontent.com/u/46437384/Everquest Mac Sony My playing Music and redo.mp4

    https://dl.dropboxusercontent.com/u/46437384/Everquest Kaladim Theme My Remake played by Seduce.mp4

    Two ways that this could be done here at takp. You could do the music like it done above on my examples or recreate the general midi music (playback using the old sound instruments but get in engineered and mixed proper for the mac client) The one issue with general midi was, everyone had different midi instrument sets. For example, a Yamaha XG sounded different then a microsoft midi soft synth built into windows 98, or a Roland sound canvas. Midi, in its simplest form, is just note data with controller info (vol, pan, pitch etc). With midi you needed a hardware or software based synth to play the music back (at this era of time). Modern sequencers use VST, au and other forms of internal emulated synths.

    On the mac client, all the general midi zones would have to be converted to a mp3 format, which was my original goal before eq mac was sunsetted.

    Hope this helps! And hello again Yinn! :)

    -Seduce
     
  21. Haynar

    Haynar Administrator

    Messages:
    3,637
    I was going to do one zone. And set the mp3's in the .emt file. And see how it did on mac, using regions, fade in, fade out.
     
  22. kicnlag

    kicnlag Active Member

    Messages:
    65
    I tried using an emt file with the mac client recently without success.

    The client has references to .emt in it and when I record the File Activity using Instruments I see the client checks for the emt file when you zone but it doesn't look like it ever opens the file or reads the contents.

    Blindly trying to see what's going on with Hopper only showed that my x86 assembly is too rusty :(

    Edit: Heres some pictures of what I got from the file activity. Going to upload one for each line because they include the call stack.



    Edit2: Going back through it and recording the activity with an eff file doesn't appear to record details about bytes read either. It might be safe to assume my previous assumption is wrong and that the client may actually try to read the file.
     

    Attached Files:

    Last edited: Sep 17, 2016
  23. Haynar

    Haynar Administrator

    Messages:
    3,637
  24. kicnlag

    kicnlag Active Member

    Messages:
    65
    Last edited: Sep 17, 2016
  25. Haynar

    Haynar Administrator

    Messages:
    3,637
    I am using the new set of emt files we have been working on for PC client.
     
  26. Haynar

    Haynar Administrator

    Messages:
    3,637
    I would like to make a single mp3 for a zone, with different tracks. Then see if can use the indexing in the .emt file, to play them. This would make less files, and everything simple for creating alternative sets of .emt files for intel client.

    Thats what I plan to do next with the gfay files, combine into a single mp3, and test that out.

    H
     
  27. kicnlag

    kicnlag Active Member

    Messages:
    65
    Here are some emt/mp3s that can be dropped in /Applications/EverQuest.app/Contents/Resources/ for brave people who can't wait to see where Haynar is taking this and arn't afraid to break their client.

    https://www.dropbox.com/sh/zf9lhykcjmhzwnr/AABg0zXilQ8dV-1q3CKnEGmLa?dl=0

    The emt's are based off the windows RC2 client. Some zone's emt files are missing corresponding mp3s. One example is south ro which didn't have an xmi file to make a mp3 out of.
    cp: beholder.xmi(2).mp3: No such file or directory
    cp: beholder.xmi(3).mp3: No such file or directory
    cp: bothunder.xmi(1).mp3: No such file or directory
    cp: butcher.xmi(3).mp3: No such file or directory
    cp: butcher.xmi(4).mp3: No such file or directory
    cp: butcher.xmi(5).mp3: No such file or directory
    cp: butcher.xmi(6).mp3: No such file or directory
    cp: butcher.xmi(7).mp3: No such file or directory
    cp: butcher.xmi(8).mp3: No such file or directory
    cp: cazicthule.xmi(1).mp3: No such file or directory
    cp: cazicthule.xmi(2).mp3: No such file or directory
    cp: cazicthule.xmi(5).mp3: No such file or directory
    cp: cobaltscar.xmi(1).mp3: No such file or directory
    cp: commons.xmi(2).mp3: No such file or directory
    cp: commons.xmi(3).mp3: No such file or directory
    cp: commons.xmi(4).mp3: No such file or directory
    cp: commons.xmi(5).mp3: No such file or directory
    cp: commons.xmi(6).mp3: No such file or directory
    cp: commons.xmi(7).mp3: No such file or directory
    cp: commons.xmi(8).mp3: No such file or directory
    cp: crystal.xmi(2).mp3: No such file or directory
    cp: crystal.xmi(3).mp3: No such file or directory
    cp: crystal.xmi(4).mp3: No such file or directory
    cp: everfrost.xmi(3).mp3: No such file or directory
    cp: everfrost.xmi(4).mp3: No such file or directory
    cp: everfrost.xmi(7).mp3: No such file or directory
    cp: everfrost.xmi(8).mp3: No such file or directory
    cp: fearplane.xmi(1).mp3: No such file or directory
    cp: fearplane.xmi(2).mp3: No such file or directory
    cp: fearplane.xmi(3).mp3: No such file or directory
    cp: fearplane.xmi(4).mp3: No such file or directory
    cp: fearplane.xmi(6).mp3: No such file or directory
    cp: fearplane.xmi(7).mp3: No such file or directory
    cp: feerrott.xmi(1).mp3: No such file or directory
    cp: feerrott.xmi(2).mp3: No such file or directory
    cp: feerrott.xmi(3).mp3: No such file or directory
    cp: feerrott.xmi(4).mp3: No such file or directory
    cp: feerrott.xmi(6).mp3: No such file or directory
    cp: frozenshadow.xmi(2).mp3: No such file or directory
    cp: frozenshadow.xmi(3).mp3: No such file or directory
    cp: frozenshadow.xmi(4).mp3: No such file or directory
    cp: highkeep.xmi(3).mp3: No such file or directory
    cp: highkeep.xmi(4).mp3: No such file or directory
    cp: highkeep.xmi(5).mp3: No such file or directory
    cp: highpass.xmi(1).mp3: No such file or directory
    cp: highpass.xmi(2).mp3: No such file or directory
    cp: highpass.xmi(5).mp3: No such file or directory
    cp: highpass.xmi(6).mp3: No such file or directory
    cp: highpass.xmi(7).mp3: No such file or directory
    cp: highpass.xmi(8).mp3: No such file or directory
    cp: kael.xmi(1).mp3: No such file or directory
    cp: kael.xmi(2).mp3: No such file or directory
    cp: kael.xmi(3).mp3: No such file or directory
    cp: kael.xmi(4).mp3: No such file or directory
    cp: kaladimb.xmi(3).mp3: No such file or directory
    cp: kaladimb.xmi(4).mp3: No such file or directory
    cp: kaladimb.xmi(8).mp3: No such file or directory
    cp: kithicor.xmi(1).mp3: No such file or directory
    cp: kithicor.xmi(3).mp3: No such file or directory
    cp: kithicor.xmi(5).mp3: No such file or directory
    cp: lakerathe.xmi(1).mp3: No such file or directory
    cp: lakerathe.xmi(2).mp3: No such file or directory
    cp: lakerathe.xmi(4).mp3: No such file or directory
    cp: lakerathe.xmi(5).mp3: No such file or directory
    cp: lakerathe.xmi(6).mp3: No such file or directory
    cp: lakerathe.xmi(7).mp3: No such file or directory
    cp: lfaydark.xmi(2).mp3: No such file or directory
    cp: lfaydark.xmi(3).mp3: No such file or directory
    cp: lfaydark.xmi(4).mp3: No such file or directory
    cp: lfaydark.xmi(5).mp3: No such file or directory
    cp: lfaydark.xmi(6).mp3: No such file or directory
    cp: misty.xmi(1).mp3: No such file or directory
    cp: misty.xmi(2).mp3: No such file or directory
    cp: misty.xmi(5).mp3: No such file or directory
    cp: nektulos.xmi(1).mp3: No such file or directory
    cp: nektulos.xmi(2).mp3: No such file or directory
    cp: oasis.xmi(1).mp3: No such file or directory
    cp: oasis.xmi(2).mp3: No such file or directory
    cp: oasis.xmi(4).mp3: No such file or directory
    cp: oasis.xmi(5).mp3: No such file or directory
    cp: oasis.xmi(7).mp3: No such file or directory
    cp: oasis.xmi(8).mp3: No such file or directory
    cp: oggok.xmi(10).mp3: No such file or directory
    cp: oggok.xmi(2).mp3: No such file or directory
    cp: oggok.xmi(3).mp3: No such file or directory
    cp: oggok.xmi(4).mp3: No such file or directory
    cp: oggok.xmi(5).mp3: No such file or directory
    cp: oggok.xmi(8).mp3: No such file or directory
    cp: oggok.xmi(9).mp3: No such file or directory
    cp: oot.xmi(1).mp3: No such file or directory
    cp: oot.xmi(2).mp3: No such file or directory
    cp: oot.xmi(3).mp3: No such file or directory
    cp: oot.xmi(4).mp3: No such file or directory
    cp: oot.xmi(6).mp3: No such file or directory
    cp: permafrost.xmi(1).mp3: No such file or directory
    cp: permafrost.xmi(2).mp3: No such file or directory
    cp: permafrost.xmi(3).mp3: No such file or directory
    cp: permafrost.xmi(4).mp3: No such file or directory
    cp: permafrost.xmi(6).mp3: No such file or directory
    cp: skyshrine.xmi(1).mp3: No such file or directory
    cp: skyshrine.xmi(3).mp3: No such file or directory
    cp: skyshrine.xmi(4).mp3: No such file or directory
    cp: skyshrine.xmi(7).mp3: No such file or directory
    cp: sro.xmi(1).mp3: No such file or directory
    cp: sro.xmi(2).mp3: No such file or directory
    cp: sro.xmi(3).mp3: No such file or directory
    cp: sro.xmi(4).mp3: No such file or directory
    cp: sro.xmi(5).mp3: No such file or directory
    cp: steamfont.xmi(1).mp3: No such file or directory
    cp: steamfont.xmi(2).mp3: No such file or directory
    cp: steamfont.xmi(3).mp3: No such file or directory
    cp: steamfont.xmi(4).mp3: No such file or directory
    cp: steamfont.xmi(6).mp3: No such file or directory
    cp: steamfont.xmi(7).mp3: No such file or directory
    cp: templeveeshan.xmi(1).mp3: No such file or directory
    cp: templeveeshan.xmi(3).mp3: No such file or directory
    cp: templeveeshan.xmi(4).mp3: No such file or directory
    cp: thurgadina.xmi(4).mp3: No such file or directory
    cp: thurgadina.xmi(5).mp3: No such file or directory
    cp: thurgadina.xmi(6).mp3: No such file or directory
    cp: thurgadinb.xmi(1).mp3: No such file or directory
    cp: thurgadinb.xmi(2).mp3: No such file or directory
    cp: velketor.xmi(1).mp3: No such file or directory
    cp: velketor.xmi(2).mp3: No such file or directory
    cp: wakening.xmi(1).mp3: No such file or directory
    cp: wakening.xmi(2).mp3: No such file or directory

    The commands I used to tweak the emt files and select only the referenced mp3s are below..
    I use gsed (brew install gnu-sed) because bsd sed doesn't support a few features I needed. Fun stuff. I also used xargs J parameter which needs to be changed for linux.

    Code:
    [ Only registered users can see the bbcode. Click Here To Register... ]
    Disclaimer: I have tried a handful of zones but it's very possible that some zones might not work or may even crash the client.

    Bonus: http://xkcd.com/208/
     
    Last edited: Sep 20, 2016
  28. drktmplr12

    drktmplr12 Member

    Messages:
    38
    The PC client on the wiki has the updates? I'm confused =(

    Do I replace all the .emt files?
     
    Last edited: Sep 21, 2016
  29. robregen

    robregen Administrator Staff Member

    Messages:
    8,384
    The one that Kicnlag mentioned is for the intel mac. emt from PC client are different than emt for Mac Client. If you want sounds for PC. you can download the supported pc client from the wiki. The above link will not work with the PC.
     
  30. Haynar

    Haynar Administrator

    Messages:
    3,637
    The emt files from mac and pc are not compatible with each other.