tag:help.beatunes.com,2009-07-24:/discussions/problems/57490-abysmal-performance-on-replaygain-analysisbeaTunes: Discussion 2020-03-29T09:45:21Ztag:help.beatunes.com,2009-07-24:Comment/481766032020-03-23T16:54:53Z2020-03-23T16:54:53ZAbysmal performance on replaygain analysis<div><p>Hi,</p>
<p>What ReplayGain settings did you use?<br>
Track and/or album?<br>
What kind of peak detection?</p>
<p>Thanks,</p>
<p>-hendrik</p></div>hendriktag:help.beatunes.com,2009-07-24:Comment/481766032020-03-23T17:08:01Z2020-03-23T17:08:01ZAbysmal performance on replaygain analysis<div><p>Hi, thanks for the fast reply. It's set to do both track and album with sample peak. I had it on EBU R128 at -23db.</p></div>iandphilliptag:help.beatunes.com,2009-07-24:Comment/481766032020-03-23T17:26:00Z2020-03-23T17:26:00ZAbysmal performance on replaygain analysis<div><p>Hm..</p>
<blockquote>
<p>it's taken an hour to get through just the first few tracks, and says it'll take six days(!) to finish</p>
</blockquote>
<p>The ETA beaTunes is giving you may be inaccurate, especially when calculating album replay gain, because it is actually not a per-track task.</p>
<p>But it should definitely not take an hour for the first few (I assume less than 10) tracks. That is waaaay too long. Are the files locally stored or on some kind of network drive? Can you please upload your logs via <code>Help</code> -> <code>Upload Logs</code>. I'd like to take a closer look.</p>
<p>Thanks,</p>
<p>-hendrik</p></div>hendriktag:help.beatunes.com,2009-07-24:Comment/481766032020-03-23T17:27:20Z2020-03-23T17:27:20ZAbysmal performance on replaygain analysis<div><p>And in any case, if you're unhappy, I can of course offer a <a href="https://www.beatunes.com/en/beatunes-refund.html">refund</a>.</p></div>hendriktag:help.beatunes.com,2009-07-24:Comment/481766032020-03-23T17:55:51Z2020-03-23T17:55:51ZAbysmal performance on replaygain analysis<div><p>Hi Hendrik. The files are on a Synology NAS. I'm trying chunking the process into several albums at a time, rather than hitting the entire library at once. That's certainly progressing better.</p></div>iandphilliptag:help.beatunes.com,2009-07-24:Comment/481766032020-03-23T17:58:31Z2020-03-23T17:58:31ZAbysmal performance on replaygain analysis<div><p>Logs uploaded now. Thanks.</p></div>iandphilliptag:help.beatunes.com,2009-07-24:Comment/481766032020-03-23T19:49:34Z2020-03-23T19:49:34ZAbysmal performance on replaygain analysis<div><p>Yeah, so it's just hanging again…</p></div>iandphilliptag:help.beatunes.com,2009-07-24:Comment/481766032020-03-24T14:22:19Z2020-03-24T14:22:19ZAbysmal performance on replaygain analysis<div><p>Hey Ian,</p>
<p>quick note to let you know, I have received your logs and am working in this.</p>
<p>Thank you for your patience,</p>
<p>-hendrik</p></div>hendriktag:help.beatunes.com,2009-07-24:Comment/481766032020-03-24T14:45:14Z2020-03-24T14:45:14ZAbysmal performance on replaygain analysis<div><p>Thanks Hendrik. I’m currently in the process of copying my library across to an external drive to see if USB might be more successful than trying to do this across a network. Sadly my internal SSD is just way too small to store the files locally.</p></div>iandphilliptag:help.beatunes.com,2009-07-24:Comment/481766032020-03-24T15:13:32Z2020-03-24T15:13:32ZAbysmal performance on replaygain analysis<div><p>Ok, so that's nailed it. Totally different performance. It's still hung on one track, but I'm putting that down to a likely damaged file. I guess I was just being unrealistic about what to expect across a network. Thanks again.</p></div>iandphilliptag:help.beatunes.com,2009-07-24:Comment/481766032020-03-24T15:16:59Z2020-03-24T15:16:59ZAbysmal performance on replaygain analysis<div><p>Yes and no. I believe beaTunes makes too many network calls, which may slow things down additionally. Working on that right now.</p></div>hendriktag:help.beatunes.com,2009-07-24:Comment/481766032020-03-25T11:11:07Z2020-03-25T11:11:07ZAbysmal performance on replaygain analysis<div><p>Hey Ian,</p>
<p>I've made some changes to how data is loaded and also fine tuned some of the decoding and filtering necessary for ReplayGain/EBU.</p>
<p>Could you please download and install <a href="https://www.beatunes.com/download/beaTunes-5-2-7.dmg">https://www.beatunes.com/download/beaTunes-5-2-7.dmg</a> ?</p>
<p>This release is not yet public, but contains all the changes and is of production quality. In my tests, local ReplayGain computation was about 50% faster (measured with an SSD). But I wasn't able to test this on a NAS or on an external HDD. Any chance you could run some analysis on your Synology setup and then upload fresh logs, so that I can see the analysis times?</p>
<p>Just some additional info: Many of your songs are AIFFs, which are very large. Obviously it takes much longer to send those over the network than for example MP3s. This made the issue extra <em>abysmal</em>.</p>
<p>Regarding "hanging": When doing Album ReplayGain analysis, beaTunes will try to find all songs of an album when encountering the first song of an album. At that point, it may look as if beaTunes is <em>hanging</em>, when it's actually processing all those other tracks belonging to the same album. Just leave it running...</p>
<p>Thanks for pointing me to this,</p>
<p>-hendrik</p></div>hendriktag:help.beatunes.com,2009-07-24:Comment/481766032020-03-25T21:57:48Z2020-03-25T21:57:48ZAbysmal performance on replaygain analysis<div><p>Hi Hendrik</p>
<p>I've downloaded 5.2.7 and run a couple of albums through it across the network. Whatever you've done, I can confirm it does appear significantly quicker. I've uploaded the logs as requested.</p>
<p>I got my full library analysed yesterday using a USB3 HD and the process went fairly quickly and entirely smoothly. I'm sure an SSD would've been much faster, but the spinning disc did the job fine.</p>
<p>I need to thank you for your help with this. I feel bad about 'abysmal' — I should explain that I wasn't feeling at all well at the time, and shouldn't have been playing around with my music library at all. I think the frustration just all got the better of me. I offer that as an explanation, not an excuse. Sick or not, it's still a dick term to use.</p>
<p>If you're happy that you've got to the bottom of the issue, and there's nothing more you need from my end, please feel free to delete this thread. No developer needs a post with 'abysmal' in the heading littering up their support system.</p>
<p>Thanks again.</p>
<p>— Ian</p></div>iandphilliptag:help.beatunes.com,2009-07-24:Comment/481766032020-03-26T07:30:33Z2020-03-26T07:30:33ZAbysmal performance on replaygain analysis<div><p>Hi Ian,</p>
<blockquote>
<p>I've downloaded 5.2.7 and run a couple of albums through it across the network. Whatever you've done, I can confirm it does appear significantly quicker. I've uploaded the logs as requested.</p>
</blockquote>
<p>I hate to contradict, but according to the logs it does not seem faster at all, which makes me think that the bottleneck is indeed the network, not beaTunes.</p>
<blockquote>
<p>I got my full library analysed yesterday using a USB3 HD and the process went fairly quickly and entirely smoothly. I'm sure an SSD would've been much faster, but the spinning disc did the job fine.</p>
</blockquote>
<p>I guess this supports the network-bottleneck theory.</p>
<p>I've noticed that you are using AFP as protocol. Synology NASs usually also support SMB—perhaps that has better performance (there are plenty of discussion of SMB vs AFP on the Synology board, e.g. <a href="https://community.synology.com/enu/forum/1/post/123910">here</a>). You could also try to reduce the number of parallel tasks (currently 8, I believe) to reduce network congestion.</p>
<blockquote>
<p>I need to thank you for your help with this. I feel bad about 'abysmal' — I should explain that I wasn't feeling at all well at the time, and shouldn't have been playing around with my music library at all. I think the frustration just all got the better of me. I offer that as an explanation, not an excuse. Sick or not, it's still a dick term to use.</p>
<p>If you're happy that you've got to the bottom of the issue, and there's nothing more you need from my end, please feel free to delete this thread. No developer needs a post with 'abysmal' in the heading littering up their support system.</p>
</blockquote>
<p>Software that does not do what you want it to do is a source of great frustration. You are certainly not alone with the need to vent every now and then. I have read much worse. That said, I really appreciate your explanation, especially as it wasn't strictly necessary. Users, developers, and those providing support—we all deserve to be treated with respect. Explaining your emotional situation does show me that respect. Thank you.</p>
<p>Unless you insist, I'm not going to delete this discussion. Other people may have the same problem and can benefit from the information.</p>
<p>Cheers,</p>
<p>-hendrik</p></div>hendriktag:help.beatunes.com,2009-07-24:Comment/481766032020-03-26T08:10:24Z2020-03-26T08:10:24ZAbysmal performance on replaygain analysis<div><blockquote>
<p>Unless you insist, I'm not going to delete this discussion. Other people may have the same problem and can benefit from the information.</p>
</blockquote>
<p>Entirely your call.</p>
<p>Thanks again.</p></div>iandphilliptag:help.beatunes.com,2009-07-24:Comment/481766032020-03-26T10:13:29Z2020-03-26T10:13:29ZAbysmal performance on replaygain analysis<div><p>Should you ever try out SMB instead of AFP, please let me know, how that goes.<br>
For the more general issue, I have posted a <a href="http://web.mac.com/iandphillip">StackOverflow question</a>. Perhaps somebody knows the answer to this...</p></div>hendriktag:help.beatunes.com,2009-07-24:Comment/481766032020-03-26T14:32:10Z2020-03-26T14:32:10ZAbysmal performance on replaygain analysis<div><p>Hi. I turned off AFP and tried connecting over SMB. It might be a little quicker (although we've established I'm not a great judge of that). I've run a few passes over tracks in a folder on the same NAS and sent the logs if that helps.</p></div>iandphilliptag:help.beatunes.com,2009-07-24:Comment/481766032020-03-26T15:31:40Z2020-03-26T15:31:40ZAbysmal performance on replaygain analysis<div><p>Thanks for doing this!</p>
<p>The logs says, SMB is about 10x faster.</p>
<p>Here are some analysis times for AFP:</p>
<pre>
<code>2020-03-25 21:45:08,345 [182016] [DEBUG][AnalysisQueueWorker-2] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 47613ms
2020-03-25 21:45:08,459 [182130] [DEBUG][AudioMetaData] com.tagtraum.core.FileId: Unsupported path store type: afpfs
2020-03-25 21:45:08,629 [182300] [DEBUG][AudioMetaData] com.tagtraum.core.FileId: Unsupported path store type: afpfs
2020-03-25 21:45:14,905 [188576] [DEBUG][AnalysisQueueWorker-1] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 42550ms
2020-03-25 21:45:15,165 [188836] [DEBUG][AudioMetaData] com.tagtraum.core.FileId: Unsupported path store type: afpfs
2020-03-25 21:45:15,334 [189005] [DEBUG][AudioMetaData] com.tagtraum.core.FileId: Unsupported path store type: afpfs
2020-03-25 21:45:22,272 [195943] [DEBUG][AnalysisQueueWorker-7] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 62970ms
2020-03-25 21:45:22,386 [196057] [DEBUG][AudioMetaData] com.tagtraum.core.FileId: Unsupported path store type: afpfs
2020-03-25 21:45:22,541 [196212] [DEBUG][AudioMetaData] com.tagtraum.core.FileId: Unsupported path store type: afpfs
2020-03-25 21:45:47,556 [221227] [DEBUG][AnalysisQueueWorker-2] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 38872ms
2020-03-25 21:45:47,701 [221372] [DEBUG][AudioMetaData] com.tagtraum.core.FileId: Unsupported path store type: afpfs
2020-03-25 21:45:47,830 [221501] [DEBUG][AudioMetaData] com.tagtraum.core.FileId: Unsupported path store type: afpfs
2020-03-25 21:45:50,906 [224577] [DEBUG][AnalysisQueueWorker-5] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 49479ms
2020-03-25 21:45:51,005 [224676] [DEBUG][AudioMetaData] com.tagtraum.core.FileId: Unsupported path store type: afpfs
2020-03-25 21:45:51,153 [224824] [DEBUG][AudioMetaData] com.tagtraum.core.FileId: Unsupported path store type: afpfs
2020-03-25 21:45:51,344 [225015] [DEBUG][AnalysisQueueWorker-4] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 49145ms</code>
</pre>
<p>Here are some for SMB:</p>
<pre>
<code>2020-03-26 14:28:46,850 [ 91720] [DEBUG][AnalysisQueueWorker-1] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 2570ms
2020-03-26 14:28:48,010 [ 92880] [DEBUG][AnalysisQueueWorker-2] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 3743ms
2020-03-26 14:28:48,168 [ 93038] [DEBUG][AnalysisQueueWorker-0] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 3899ms
2020-03-26 14:28:48,560 [ 93430] [DEBUG][AnalysisQueueWorker-3] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 4286ms
2020-03-26 14:28:50,455 [ 95325] [DEBUG][AnalysisQueueWorker-0] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 2275ms
2020-03-26 14:28:50,859 [ 95729] [DEBUG][AnalysisQueueWorker-3] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 2233ms
2020-03-26 14:28:51,246 [ 96116] [DEBUG][AnalysisQueueWorker-2] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 3201ms
2020-03-26 14:28:52,181 [ 97051] [DEBUG][AnalysisQueueWorker-3] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 1297ms
2020-03-26 14:28:53,044 [ 97914] [DEBUG][AnalysisQueueWorker-2] com.tagtraum.beatunes.analysis.AudioPumpAnalysisTask: Pump took 1515ms</code>
</pre>
<p>So unless we are seeing some caching effects, SMB wins this hands down.</p></div>hendriktag:help.beatunes.com,2009-07-24:Comment/481766032020-03-26T21:02:07Z2020-03-26T21:02:07ZAbysmal performance on replaygain analysis<div><p>Well, I'd say that identifies the bottleneck. I'll keep AFP well and truly off from now on.</p></div>iandphillip