Avoid resending data when restarting analysis task

ErikL's Avatar

ErikL

03 Jun, 2017 08:46 AM

Analysis starts by sending data to the server. When there are a lot of files this can take quite some time.
When analysis is resumed after a program restart, the data for the files in the task queue needs to be resend.
When analysis is paused this is not the case.

Would it be possible (desirable?) to keep the sent data available/alive through a program restart(even for a limited amount of time)? This could save time with lengthy analysis tasks.

  1. Support Staff 1 Posted by hendrik on 04 Jun, 2017 10:45 AM

    hendrik's Avatar

    Analysis starts by sending data to the server.

    It only does that, if you have selected a task that uses online resources.

    When there are a lot of files this can take quite some time.

    Processing results from the server may actually start before all data is sent to the server.

    When analysis is resumed after a program restart, the data for the files in the task queue needs to be resend.

    Indeed.

    When analysis is paused this is not the case.

    Correct, because the connection to the server is kept alive. If it gets lost, some data from the server may simply be dropped.

    Would it be possible (desirable?) to keep the sent data available/alive through a program restart(even for a limited amount of time)?

    You mean, produce the data that is going to be sent to the server, save it to a file and re-use that same data, if the analysis is resumed?

    How would we know, whether the data is still "fresh"?

    Also, the issue may not be sending... it may be processing on the server side. I.e. how fast can the server actually send reasonable answers?

    You can help the server a little by using Submit Library to Server under Tools. beaTunes will then send your song data to the server and connect your data to reference data, which is a big step of what's happening on the server side. Any subsequent analysis won't have to do this anymore. The connection is id-based, i.e. your username, name, email address etc. cannot be connected to this link.

    I can understand the desire to speed up this part of analysis, but believe it's a little too late in the dev cycle to change something so fundamental. Also, I'm not sure how I'd want to change it.

    Perhaps not using tasks with online resources is something you want to try?

  2. 2 Posted by ErikL on 05 Jun, 2017 07:56 PM

    ErikL's Avatar

    Thanks for clarifying. Not a practical idea for the reasons you point out.

    How would we know, whether the data is still "fresh"?

    Indeed.

    You can help the server a little by using Submit Library to Server under Tools. beaTunes will then send your song data to the server and connect your data to reference data, which is a big step of what's happening on the server side. Any subsequent analysis won't have to do this anymore.

    Good to know, I submitted library to the server.

    How about these msgs: "beaTunes was unable to identify the track xyz, because it is not yet in the database."
    I'd expect them not to occur anymore after submitting the library to the server, or is this something different?

  3. Support Staff 3 Posted by hendrik on 05 Jun, 2017 08:48 PM

    hendrik's Avatar

    How about these msgs: "beaTunes was unable to identify the track xyz, because it is not yet in the database." I'd expect them not to occur anymore after submitting the library to the server, or is this something different?

    Not all of your songs may have been processed yet. That said, the error message is shown, when you are trying to import data from the central database. Even if you submit your data to the database, it may still return that message, if there is no reliable reference data for your song. This can happen, when it is not in certain reference database yet and hasn't been submitted by multiple beaTunes user's yet.

Reply to this discussion

Internal reply

Formatting help / Preview (switch to plain text) No formatting (switch to Markdown)

Attaching KB article:

»

Attached Files

You can attach files up to 10MB

If you don't have an account yet, we need to confirm you're human and not a machine trying to post spam.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac