Backup time

General Discussion of the Nord Stage (EX), Nord Stage 2 (EX), Nord Stage 3, and Nord Stage 4 Synths, FAQ, Troubleshooting etc.
User avatar
cphollis
Posts: 1595
Joined: 01 Mar 2013, 20:56
11
Your Nord Gear #1: Nord Stage 4
Your Nord Gear #2: Nord Piano 5
Location: Vero Beach, Fl
Has thanked: 58 times
Been thanked: 708 times

Re: Backup time

Post by cphollis »

Well, as requested I did a full backup on my slowest, oldest Mac device (2016) but a flash drive. Plugged in the USB, hit "backup". About one minute, thirty seconds to create a brand new 2.54 GB image, so a full backup. I would guess data was moving at about ~30-35 MB/sec, gated by my older computer and storage. On a new M1, it would likely be under a minute.
These users thanked the author cphollis for the post:
WannitBBBad
I think I have gear issues ....
Valpurgis
Posts: 256
Joined: 17 Sep 2011, 18:24
12
Your Nord Gear #1: Nord Stage 4
Has thanked: 12 times
Been thanked: 60 times

Re: Backup time

Post by Valpurgis »

See my post, you are confused by the difference between initial/virgin backup and the ones after that. Also check whats written about this here: https://www.soundtech.co.uk/music-retai ... r-software

«Back Up on the other hand will back up the entire keyboard and all its contents in one big file. This will create the largest file out of the three back up methods and so will take the longest time to do. A fully loaded Stage 3 could take up to an hour to do a first time back-up - but this will be quicker on subsequent back-ups as we'll explain in a moment.»
Last edited by Valpurgis on 08 Apr 2022, 06:26, edited 1 time in total.
User avatar
cphollis
Posts: 1595
Joined: 01 Mar 2013, 20:56
11
Your Nord Gear #1: Nord Stage 4
Your Nord Gear #2: Nord Piano 5
Location: Vero Beach, Fl
Has thanked: 58 times
Been thanked: 708 times

Re: Backup time

Post by cphollis »

Valpurgis wrote:See my post, you are confused by the difference between initial/virgin backup and the ones after that. Also check whats written about this here: https://www.soundtech.co.uk/music-retai ... r-software

«Back Up on the other hand will back up the entire keyboard and all its contents in one big file. This will create the largest file out of the three back up methods and so will take the longest time to do. A fully loaded Stage 3 could take up to an hour to do a first time back-up - but this will be quicker on subsequent back-ups as we'll explain in a moment.»
You are confused on how computers and backups work.

If I have a keyboard device with 2.48 GB in total storage capacity, and I back up its entire contents creating a 2.48 GB disk image, this is called a "full backup" as it contains all the files and other metadata required to restore the backup up object to its initial state. On a reasonably fast computer, using the USB 2 protocol, this can take about a minute as data will be transferred at ~40MB/sec, maybe a bit faster if the storage can do fast writes.

Storage write speed is the most important variable here, and is highly variable depending whether it's modern flash or ancient rotating rust.

Also, FY, an "incremental backup" is a copy of what has changed since the last full or incremental backup. That means if no data has changed, there is nothing to back up. Using your incorrect explanation, why is Backup Manager creating 2.48 GB backup objects when no data has changed?

Answer: when it's a full backup :)

If you don't believe me, please get your hands on a modern computer, and please give it a try. It does not take "hours" unless you have a crippled setup.
Last edited by cphollis on 08 Apr 2022, 14:42, edited 3 times in total.
I think I have gear issues ....
ajstan
Donator
Posts: 624
Joined: 12 Sep 2017, 14:16
6
Your Nord Gear #1: Nord Stage 3
Your Nord Gear #2: Nord Stage 3
Has thanked: 169 times
Been thanked: 311 times

Re: Backup time

Post by ajstan »

I ran this test myself and noticed that when the status bar shows "Backing up Piano partition (cached)", the system creates a new 2GB+ in less than two minutes, but if I use a drive that has never been connected to the computer, I do not get the "cached" message (the status bar just reads "Backing up Piano partition") and creating the new file takes over an hour. After the first backup to the new drive, I get the "cached" message on subsequent backups and can create completely new 2GB+ full backups in under two minutes.

My guess would be that the quick new file creation has something to do with cache, and that the computer is just copying data that already exists within its file system to the new file and is not being transferred from the Nord to the computer via USB.
These users thanked the author ajstan for the post (total 2):
FZiegler, WannitBBBad
NS3-88, NS3C, Casio CT-S1, Radial Key Largo, Westone AM Pro 30 IEMs, Rolls PM55P Headphone Mixer, K&M 18880 Keyboard Stand with 18881 Second Tier, Bose S1 Pro, JBL 305p MKII Monitors, Zoom Q2n-4K Gig Camera, Behringer XR18 Mixer
Valpurgis
Posts: 256
Joined: 17 Sep 2011, 18:24
12
Your Nord Gear #1: Nord Stage 4
Has thanked: 12 times
Been thanked: 60 times

Re: Backup time

Post by Valpurgis »

Sorry cphollis to have triigered bad feelings. But if you had taken the time to read my link you would have learned that what ajstan also confirm is correct:
« Nord Sound Manager also uses a cache system to speed things up. Files that have already been “seen” by Nord Sound Manager, i.e. downloaded or uploaded once, are placed in the cache folder. This means that when creating a backup next time, those do not need to be uploaded from the instrument, but can be copied from the cache instead saving a lot of time.»
Been introduced to the IBM PC in 1982 I feel I have used more than enough time on «modern computers» during my life in the computer and communication support to upgrade my Windows laptop from 2017 and Mac Mini from 2019 :-)
User avatar
cphollis
Posts: 1595
Joined: 01 Mar 2013, 20:56
11
Your Nord Gear #1: Nord Stage 4
Your Nord Gear #2: Nord Piano 5
Location: Vero Beach, Fl
Has thanked: 58 times
Been thanked: 708 times

Re: Backup time

Post by cphollis »

Respectfully disagree. I saw ~35-42MB/sec going over the wire from the keyboard to the computer during the entire backup event. Regardless of how anything thinks it might work, this means there is no effective caching happening on the computer side. Unless anyone can convince me that watching 2.48 GB of data being moved over the wire and resulting in a 2.48 GB object being created might be something else? You are welcome to try this for yourself.

I used to do large scale IT architectures, systems, etc for some big names. I learned that people will tell you one thing, but it always helps to check the important bits. Transfer rates, storage speeds, supposed caching and compression effects, etc. all of that can become important when there's a lot of data involved and not a lot of time.
Last edited by cphollis on 08 Apr 2022, 23:05, edited 1 time in total.
I think I have gear issues ....
Valpurgis
Posts: 256
Joined: 17 Sep 2011, 18:24
12
Your Nord Gear #1: Nord Stage 4
Has thanked: 12 times
Been thanked: 60 times

Re: Backup time

Post by Valpurgis »

To much prestige involved, relax and rethink. Its simply a question about if the samples in the keyboard are changed since the last backup. Backup time is directly related to how many of the samples are new related to the previous backup. The transfer rate between the keyboard and computer is controlled by the process between the Nord Sound Manager and NS3 firmware. Its not a raw memory dump depending on the capacity of the transmission channel, and the transferred volume is related to whats really needed to download compared to changes in samples. I rest my case.
Last edited by Valpurgis on 09 Apr 2022, 13:46, edited 2 times in total.
User avatar
WannitBBBad
Patch Creator
Posts: 1816
Joined: 25 Jul 2011, 03:36
12
Your Nord Gear #1: Nord Stage 3
Has thanked: 1052 times
Been thanked: 1536 times

Re: Backup time

Post by WannitBBBad »

ajstan wrote:I ran this test myself and noticed that when the status bar shows "Backing up Piano partition (cached)", the system creates a new 2GB+ in less than two minutes, but if I use a drive that has never been connected to the computer, I do not get the "cached" message (the status bar just reads "Backing up Piano partition") and creating the new file takes over an hour. After the first backup to the new drive, I get the "cached" message on subsequent backups and can create completely new 2GB+ full backups in under two minutes...
Exact same results here using two laptops, both with SSDs and one which I haven't ever used for backing up my NS3. I'm not sure where the cache file exists or what it might be named, as a search on the laptop that only took about 2 minutes with the "cached" message didn't have another ns3b backup file on it. For the other laptop without the "cached" message, Nord Sound Manager estimated the time at 71 minutes.
Nord Stage 3 | SC Prophet T8 | Korg X50... In the past: Nord Stage EX, 2, 2EX | SC Prophet 5, 10 | MiniMoog | Hammond B3 & 122 Leslie | Yamaha DX7IIFD, EX5, CP60 | Hohner D6 | Fender Rhodes | Roland S-50, D-50, XP-50...
Valpurgis
Posts: 256
Joined: 17 Sep 2011, 18:24
12
Your Nord Gear #1: Nord Stage 4
Has thanked: 12 times
Been thanked: 60 times

Re: Backup time

Post by Valpurgis »

There is no hidden cache file. The samples are all in the NSM backup file which always are about 2.5Gb. Your initial backup downloads all samples from the NS3 and takes about 1 hour. The next backup just download changes in samples since the previous. If no samples are added or substituted the backup takes about 1 minute. Program, song and configuration takes a tiny part of the backup. A backup file can be exported to any other computer to restore to another NS3 since it contains a copy of everything.

PS The assumption that a backup file always is about 2.5Gb reflects a Nord Stage 3 fully loaded with samples.
Last edited by Valpurgis on 10 Apr 2022, 15:28, edited 1 time in total.
User avatar
WannitBBBad
Patch Creator
Posts: 1816
Joined: 25 Jul 2011, 03:36
12
Your Nord Gear #1: Nord Stage 3
Has thanked: 1052 times
Been thanked: 1536 times

Re: Backup time

Post by WannitBBBad »

Valpurgis wrote:There is no hidden cache file. The samples are all in the NSM backup file which always are about 2.5Gb. Your initial backup downloads all samples from the NS3 and takes about 1 hour. The next backup just download changes in samples since the previous. If no samples are added or substituted the backup takes about 1 minute. Program, song and configuration takes a tiny part of the backup. A backup file can be exported to any other computer to restore to another NS3 since it contains a copy of everything.

PS The assumption that a backup file always is about 2.5Gb reflects a Nord Stage 3 fully loaded with samples.
What you state makes sense, however NSM indicated the pianos were cached even though no other ns3b backup existed on my laptop when I created my backup yesterday. The laptop has been used extensively to upload and download individual pianos in the past.

UPDATE: I deleted the backup file on the second laptop that wasn't ever used to make a backup until yesterday (took over an hour). I deleted the file from my recycle bin (trash folder), restarted my laptop, and then opened Nord Sound Manager to make a new backup. The backup message included "cached" and the new (and only) backup file took about 2 minutes to create.
Last edited by WannitBBBad on 10 Apr 2022, 18:23, edited 1 time in total.
Nord Stage 3 | SC Prophet T8 | Korg X50... In the past: Nord Stage EX, 2, 2EX | SC Prophet 5, 10 | MiniMoog | Hammond B3 & 122 Leslie | Yamaha DX7IIFD, EX5, CP60 | Hohner D6 | Fender Rhodes | Roland S-50, D-50, XP-50...
Post Reply