BPM not always calculating

Richard's Avatar

Richard

26 Nov, 2018 02:41 AM

Hello Hendrik,

I've been having a problem for the past few weeks. When I add new tracks (synchronize to pick up the new tracks, then analyze to derive the fingerprint and calculate BPM), it is kind of hit or miss if the BPM actually gets assigned. I'm estimating it "misses" about 20% of the new tracks. If I then go back to the library and manually queue the missing BPM tracks to be analyzed again, it will calculate and assign the values as it should. When I reanalyze, I turn off the fingerprint analysis, figuring that doesn't need to be done again. Needless to say, this problem is an annoyance. FYI, I'm not talking about huge numbers of new tracks at a time. Sometimes just a dozen or two. Sometimes 100 or more, which for me isn't that many.

By the way, thanks for the 1/2 star rating increment. Much appreciated.

Richard

  1. 1 Posted by Richard on 26 Nov, 2018 02:52 AM

    Richard's Avatar

    I forgot to include this in the above message:
    I'm running a folder-based library.
    I have 361923 tracks on a single internal HDD.
    I'm on beaTunes 5.1.11-snapshot, built on Oct 11 2018
    JVM: JavaHotSpot 64-bit server VM Verison 1.8.0_181 (25.181-b13)
    OS: Windows 8.1.6.3, amd64
    Memory: 92m-4096m, currently 1931m (47%) which fluctuates as you know

  2. Support Staff 2 Posted by hendrik on 26 Nov, 2018 01:39 PM

    hendrik's Avatar

    What are the exact options for BPM and Fingerprint analysis?

    Thanks.

  3. 3 Posted by Richard on 26 Nov, 2018 03:27 PM

    Richard's Avatar

    When I analyze a group of new tracks, for fingerprints, both the boxes are checked ("Take fingerprint" and "Submit fingerprint"). For BPM, only the "Estimate BPM" box is checked, and the Range is "Automatic". Also, no other Analysis boxes are checked (no "danceability", no "mood", etc.).

    When I re-analyze a group of tracks that didn't get a BPM value written to them, the only difference is I uncheck the "Take fingerprint" box. Every time I've done this so far, every track that didn't get a BPM the first time around, gets one the second time around.
    And these are, definitely, tracks that were subjected to analysis the first time. Typically, I'll download one or more CDs worth of tunes, scan them into my other player's database, (sometimes) clean up the tags there to my satisfaction*, (usually) run a Replay Gain analysis there on the new tracks**, scan the tracks into beaTunes for the first time, skip the "Inspect" step, and do the Analyze step with the options as described above. When the analysis is done [and there is virtually never an error], I go back into my other player, rescan the music folders to bring in the BPM values. That is when I see that some tracks got a BPM added and some didn't. Then I go back into beaTunes and see, yes, those same tracks don't have a BPM in beaTunes for whatever reason. Then I re-analyze the selected tracks as described above.

    These are almost always mp3 files. In fact, I think every file I've had this problem with is mp3. I seldom deal with other music file types (m4a, flac, ogg, ape, etc).

    Thanks!

    *- Sometimes I clean up the tags before the initial scan. "Clean up" to me means fixing or adding the song title, artist name, album artist name, album name, track number, year, composer, and genre. Sometimes it gets done much later. Sometimes (often) it gets done in pieces. Tag clean-up/enhancement is a never-ending process, it seems.

    **- I know beaTunes can do the Replay Gain analysis also. For consistency, I always do the volume analysis in my other player (MediaMonkey) because I've used that same player for years. That player, however, doesn't have a BPM analysis module, nor does it have some of the other great beaTunes features. Yes, it does take some self-discipline to make sure the two apps don't mess things up for each other or in the underlying tracks themselves. I believe I am duly careful.

          From: hendrik <[email blocked]>
     To: [email blocked]
     Sent: Monday, November 26, 2018 7:39 AM
     Subject: Re: BPM not always calculating [Problems #48802]

     #yiv2153568655 pre {width:92%;margin:10px 2%;padding:5px 2%;background:#efefef;border:1px solid #d6d6d6;}#yiv2153568655 blockquote {margin-left:0;padding-left:1em;border-left:5px solid #ccc;}

  4. 4 Posted by Richard on 16 Dec, 2018 03:10 AM

    Richard's Avatar

    Hendrik,

    I just uploaded my logs. I Synchronized my collection, adding about 250 tracks (and there might have been a very few deletions). beaTunes came back as it always does and asked if I want to Inspect my new tracks (I said "no") and do I want to Analyze my new tracks ("yes")? It gave me the list, I said "continue", and selected my usual options: Take Fingerprint (submit to database), and Derive BPM (do not overwrite, do not use online resources), and that's it.

    >>> I thought I noticed it said "adding 100 tasks to queue". That message doesn't stay up very long. It should have added about 250.

    When it finished analyzing, I went to look at some of my new albums. Sure enough, on one album, it only wrote BPM for 1 track (out of 9). On another, 2 tracks out of 13. Other albums were similarly impacted, although they had a higher percentage of tracks that got analyzed (4 out of 11 on another one I'm looking at right now).

    So maybe the problem isn't that it isn't calculating BPM on a hit or miss basis. Maybe the problem is that not all of the new tracks are being sent to the task queue after the synchronization.

    Yesterday, I also added a small number of new tracks (around 25?), and it had no problem on those when I followed the identical steps as i did on the larger group today.

    I'll attach a screen cap of 2 of the albums that had the problem today. If I turn around and manually select the missing BPM tracks for analysis (again), it does them, no problem. That's why I'm thinking they're just not getting submitted in the first place after the synchronization.

  5. Support Staff 5 Posted by hendrik on 23 Dec, 2018 02:09 PM

    hendrik's Avatar

    Hey Richard,

    sorry it took me so long to react to this.

    I looked at your logs and indeed 100 tracks where sent to analysis. What the logs don't tell me is how many songs you selected or how many songs were shown. So I cannot really say what's exactly the issue here.

    The lastest dev-snapshot has some added debug messages that should clarify what's going on. Please install this latest snapshot and send me a fresh set of logs once this happened again. Hopefully this will help us getting to the bottom of it.

    Thanks so much and happy holidays!

    -hendrik

    PS: You can get the snapshot from http://www.beatunes.com/download/https://www.beatunes.com/download/...

  6. 6 Posted by Richard on 23 Dec, 2018 03:08 PM

    Richard's Avatar

    I will do as you ask. What I can tell you verbally is that the synchronization picked up about 250 tracks, and I said "yes" when it offered to analyze all the new tracks it found. I don't know how many tracks were actually presented to me in the next box that pops up that shows the tracks it is about to analyze. I suspect it only presented 100 tracks to me there, but that is only a guess. The reason I know that the synchronization picked up all 250-ish new tracks is that after the analysis was done, and I went and looked at the new tracks, they were all there in the library, those that got a BPM and those that didn't.

          From: hendrik <[email blocked]>
     To: [email blocked]
     Sent: Sunday, December 23, 2018 8:09 AM
     Subject: Re: BPM not always calculating [Problems #48802]
       
     #yiv9067641381 pre {width:92%;margin:10px 2%;padding:5px 2%;background:#efefef;border:1px solid #d6d6d6;}#yiv9067641381 blockquote {margin-left:0;padding-left:1em;border-left:5px solid #ccc;}

  7. Support Staff 7 Posted by hendrik on 23 Dec, 2018 04:03 PM

    hendrik's Avatar

    I have no doubt that what you say happened exactly like you describe it. But did you know, that only selected tracks in that window get sent to analysis? beaTunes should select all the songs presented to you, but who knows what happened. Getting some log statements is usually the best way to deal with this kind of situation.

    Thanks!

  8. 8 Posted by Richard on 23 Dec, 2018 05:16 PM

    Richard's Avatar

    It appeared that all the tracks were selected, but I didn't scroll through the list so I don't know for sure.
    You and I are on the same page regarding logs providing much more definitive information. I am happy to send them and should be able to do so soon.

          From: hendrik <[email blocked]>
     To: [email blocked]
     Sent: Sunday, December 23, 2018 10:03 AM
     Subject: Re: BPM not always calculating [Problems #48802]
       
     #yiv5116306412 pre {width:92%;margin:10px 2%;padding:5px 2%;background:#efefef;border:1px solid #d6d6d6;}#yiv5116306412 blockquote {margin-left:0;padding-left:1em;border-left:5px solid #ccc;}

  9. 9 Posted by Richard on 25 Dec, 2018 12:08 AM

    Richard's Avatar

    I just sent a set of logs. I was watching more closely this time. I can see what is wrong. I synchronized anew, knowing that I had added 188 tracks to my folders (and deleted a handful of songs) since the last time I synchronized.
    Unlike v 5.1.11, it didn't ask if I wanted to Inspect the new tracks, but it did ask if I wanted to Analyze. I did, and then it presented me with the window of new tracks. It is helpful that they are numbered, so I could quickly see by scrolling down that beaTunes only presented exactly 100 tracks, and not the 188 tracks it should have offered. I went ahead and let it analyze the 100. Then I pulled up one of the artists I added tracks for. Sure enough, the library has all the new tracks, not just the 100 that got sent to analysis, but only the 100 got BPM added.

    I know from past experience that I can manually select the tracks that didn't get analyzed before and analyze them successfully, but that's tedious.

          From: Richard Patton <[email blocked]>
     To: hendrik <[email blocked]>
     Sent: Sunday, December 23, 2018 11:16 AM
     Subject: Re: BPM not always calculating [Problems #48802]
       
    It appeared that all the tracks were selected, but I didn't scroll through the list so I don't know for sure.
    You and I are on the same page regarding logs providing much more definitive information. I am happy to send them and should be able to do so soon.

          From: hendrik <[email blocked]>
     To: [email blocked]
     Sent: Sunday, December 23, 2018 10:03 AM
     Subject: Re: BPM not always calculating [Problems #48802]
      
     #yiv6373376892 pre {width:92%;margin:10px 2%;padding:5px 2%;background:#efefef;border:1px solid #d6d6d6;}#yiv6373376892 blockquote {margin-left:0;padding-left:1em;border-left:5px solid #ccc;}

  10. 10 Posted by Richard on 25 Dec, 2018 05:10 AM

    Richard's Avatar

    Basically, it seems like beaTunes is limiting itself to sending 100 tracks to Analysis after it Synchronizes and finds more than 100 new tracks. This limitation must have crept in a few point releases ago. If it Synchronizes and finds 100 or fewer new tracks... no problem. It sends them all.

          From: Richard Patton <[email blocked]>
     To: hendrik <[email blocked]>
     Sent: Monday, December 24, 2018 6:07 PM
     Subject: Re: BPM not always calculating [Problems #48802]
       
    I just sent a set of logs. I was watching more closely this time. I can see what is wrong. I synchronized anew, knowing that I had added 188 tracks to my folders (and deleted a handful of songs) since the last time I synchronized.
    Unlike v 5.1.11, it didn't ask if I wanted to Inspect the new tracks, but it did ask if I wanted to Analyze. I did, and then it presented me with the window of new tracks. It is helpful that they are numbered, so I could quickly see by scrolling down that beaTunes only presented exactly 100 tracks, and not the 188 tracks it should have offered. I went ahead and let it analyze the 100. Then I pulled up one of the artists I added tracks for. Sure enough, the library has all the new tracks, not just the 100 that got sent to analysis, but only the 100 got BPM added.

    I know from past experience that I can manually select the tracks that didn't get analyzed before and analyze them successfully, but that's tedious.

          From: Richard Patton <[email blocked]>
     To: hendrik <[email blocked]>
     Sent: Sunday, December 23, 2018 11:16 AM
     Subject: Re: BPM not always calculating [Problems #48802]
      
    It appeared that all the tracks were selected, but I didn't scroll through the list so I don't know for sure.
    You and I are on the same page regarding logs providing much more definitive information. I am happy to send them and should be able to do so soon.

          From: hendrik <[email blocked]>
     To: [email blocked]
     Sent: Sunday, December 23, 2018 10:03 AM
     Subject: Re: BPM not always calculating [Problems #48802]
      
     #yiv6738699333 pre {width:92%;margin:10px 2%;padding:5px 2%;background:#efefef;border:1px solid #d6d6d6;}#yiv6738699333 blockquote {margin-left:0;padding-left:1em;border-left:5px solid #ccc;}

  11. Support Staff 11 Posted by hendrik on 26 Dec, 2018 09:35 PM

    hendrik's Avatar

    Thanks for the logs. They helped me understand the issue—it has to do with a timeout, that only has negative side effects in large collections.

    I believe it's fixed in the latest snapshot: https://www.beatunes.com/download/beaTunes-5-1-12-SNAPSHOT-x64.exe (this is the same URL as last time, but by now a different file).

    Thanks for reporting this!!

  12. 12 Posted by Richard on 28 Dec, 2018 07:19 AM

    Richard's Avatar

    It's looking good now. I added 253 tracks to the library, and it picked up all 253 for analysis. The "Inspect" question came back, too. Thanks!

          From: hendrik <[email blocked]>
     To: [email blocked]
     Sent: Wednesday, December 26, 2018 3:35 PM
     Subject: Re: BPM not always calculating [Problems #48802]
       
     #yiv2809806657 pre {width:92%;margin:10px 2%;padding:5px 2%;background:#efefef;border:1px solid #d6d6d6;}#yiv2809806657 blockquote {margin-left:0;padding-left:1em;border-left:5px solid #ccc;}

  13. Support Staff 13 Posted by hendrik on 28 Dec, 2018 08:17 AM

    hendrik's Avatar

    It's looking good now. I added 253 tracks to the library, and it picked up all 253 for analysis.

    Thanks for the accurate reporting and trying out the fix. Please keep an eye on this and let me know, should it not be fixed entirely. Because the issue had to do with a timeout, it may be intermittent.

  14. 14 Posted by Richard on 28 Dec, 2018 03:46 PM

    Richard's Avatar

    Just to put a wrap on this thread, as it turns out, this wasn't an Analysis issue at all, but rather an issue with Synchronize queuing up tracks to send to Analysis (and maybe for Inspection, too). I saw it as a BPM issue because that is the main analysis module I'm using right now (other than Fingerprint which doesn't have any visible indication whether or not it worked).

  15. Support Staff 15 Posted by hendrik on 28 Dec, 2018 03:48 PM

    hendrik's Avatar

    (other than Fingerprint which doesn't have any visible indication whether or not it worked).

    Just FYI: Fingerprinted tracks have a little "thumb print" icon on their Get Info dialog summary page.

  16. 16 Posted by Richard on 28 Dec, 2018 03:57 PM

    Richard's Avatar

    Ah. Didn't know that.
    But is there any way to know (i.e., through a filter or sort or something) which tracks do or do not have a fingerprint?

          From: hendrik <[email blocked]>
     To: [email blocked]
     Sent: Friday, December 28, 2018 9:48 AM
     Subject: Re: BPM not always calculating [Problems #48802]

     #yiv0056110006 pre {width:92%;margin:10px 2%;padding:5px 2%;background:#efefef;border:1px solid #d6d6d6;}#yiv0056110006 blockquote {margin-left:0;padding-left:1em;border-left:5px solid #ccc;}

  17. Support Staff 17 Posted by hendrik on 28 Dec, 2018 03:59 PM

    hendrik's Avatar

    But is there any way to know (i.e., through a filter or sort or something) which tracks do or do not have a fingerprint?

    No, there isn't.

Reply to this discussion

Internal reply

Formatting help / Preview (switch to plain text) No formatting (switch to Markdown)

Attaching KB article:

»

Attached Files

You can attach files up to 10MB

If you don't have an account yet, we need to confirm you're human and not a machine trying to post spam.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac