Links, for those who would like them: * Look everybody, we made a new thing with Electron! * Oops. * We’re sorry, we wrote a new native version.
There are tons of points of iCloud, but backing up your entire Mac is not one of them.
Also moving your home folder to iCloud would not be a backup anyways, because any changes/deletions made would be mirrored in iCloud. A backup like Time Machine uses versioning to save multiple copies and versions of file.
I recommend something like Arq in addition to a local Time Machine backup. See: https://www.arqbackup.com/
Amazon Cloud Drive with ARQ
I've used Crashplan and personally the upload and restore speeds are booty. I have switched to ACD with ARQ and I love having full 100% control of my data.
Boy do I ever have a treat for you then! While unable to specify an encryption method, you can specify the key and connect it to ACD.
I bought it this fall and have been praising it ever since. Awesome team doing gods work as far as I'm concerned.
It depends. The Red and Red Pros (i.e. the ones you mentioned) are not the same--the former being closer to wD Green. See: Understanding the WD Rainbow
I'd first classify the data into "tiers".
Critical - I have my personal/family stuff -- e.g. personal records, photos, etc. This is stuff I don't want to lose (and that I also backup to The Cloud, e.g. Arq).
Media/etc - For this, I run ZFS using consumer drives. You could do the same with the 8-bay expansion bay on the Synology, but that's quite expensive (albeit requiring generally less technical overhead).
I generally view this as expendable.
> The best you can do is to spread retrieval over several 4-hour periods and/or over several days in order to lower the retrieval cost
Arq seems to do this automagically and you can even set a target budget per month... I guess I'll have to try it
It would be pretty cool if Glacier offered the option to get a HDD with your data for a fixed price (like, I don't know, 200$ to get a 4TB drive shipped to your home with your data on it) like some others providers seem to do
Time Machine will be tricky. I don't know of any way to do what you're looking for.
However, Arq will let you do backups to Amazon cloud storage, for a one-time purchase of $40.
I use Arq backup https://www.arqbackup.com/ to encrypt my backups, including photos. Everything gets encrypted client-side and then uploaded to my choice of cloud storage provider. The cloud storage provider has no way to decrypt the file.
It's only good for backup (so no cloud sharing or access) but I have no concerns about a cloud provider using my photos or other files for some type of analysis.
Backblaze is a consumer product with shiny easy to use GUIs anyone can use. It doesn't have an API and isn't well used around here due to its lack of Linux support. You pay a fixed monthly fee for unlimited backup.
B2 is an API and you need to use third party software to interface with it. Since you're on Mac, Arq is a popular option. B2 charges you $/GB rather than a fixed monthly fee. It's $5/TB right now.
I've been using https://www.arqbackup.com/ for some time. It supports just about all the big cloud storage providers as well as local/SFTP options. It has everything you might need, except for linux support.
It’s the same with OneDrive: if their algorithm makes a mistake they can close your account (OneDrive, office, Skype, email, EVERYTHING) and there is no practical way to appeal to reverse their decision: Microsoft's account suspensions and the OneDrive 'nude' photos
If you already have the space (office 365 subscription with 1TB OneDrive space) it’s a good idea to use an app like Arq backup 7 to backup your files there with encryption. It also works with google, Dropbox, AWS, B2 and other providers
I love that it gives you full control of what happens to your backups, down to you have to pay for your own cloud storage fees. The developer has been continually adding support for new providers as they become available and fast to respond to changes. Backups are encrypted locally before they are uploaded anywhere. I've used it for several years successfully. I've successfully restored from a hard drive failure (from a local NAS backup), and recovered individual files as well. That said, it does appear to be a lone developer, with the good and the bad that comes with that. Recently he was very transparent about a very serious bug involving lost backup data. Overall I think it's the best solution out there, half-way between roll your own backups and using something like backblaze.
https://www.arqbackup.com/ - I am trying this out now for local backups (NAS and USB). It does pretty good but I miss the email reports that crashplan had. You can setup email options if it is supported by your email provider.
As a cloud option you could try this https://wasabi.com/ I have not used it but others have and claim it is fairly cheap and easy to setup with ARQ.
Don't use any cloud storage as is. Condoleeza Rice is on Dropbox' board, 🤪, and most cloud services won't encrypt your data before it leaves the machine.
Use Arq Backup (https://www.arqbackup.com) with the cloud service of your choice.
There are a couple of things that I do that would probably meet your needs.
I have an unlimited Spideroak account (they have a deal running right now), and with that they keep a version of all your files, plus if you delete the file on your computer it is still saved with them. Note: They have "Zero-knowledge" privacy which means that they can't see any of your files.
I also use Arq Backup that'll do pretty much the same thing as I am doing with Spideroak, except I'm not tied to a specific vendor. I have an unlimited EDU GSuite (that'll probably run out when I am no longer a student), and I also have an ACD account. I backup the same folders to both of these services using Arq. My only wish is that Arq would support B2, however I contacted Arq support and they said they have no plans to support B2 (hopefully that changes).
Both of these pieces of software run as a daemon on your computer and handle moving and backing up files.
As others have said, if there is only one copy of a file it's not a backup, which is why I'd recommend using multiple services so that there are multiple copies of your files.
Best of luck.
Edit: According to Arq's twitter supposedly B2 is being worked on so that's some good news (source: https://twitter.com/arqbackup/status/865958913988014081 )
I’m a bit confused and can’t quite tell if there’s a bug. The release notes for 7.1.3 has a single item
> Fixed display issues in the preferences window when a "lifetime" license code is in use.
Now I’m also seeing what you are. My upgrade however was not consistent with either the 5 or 6 upgrade documented here, where it’d add a year with a 6 license (it hasn’t as I’m seeing expired 2020, or I’d be asked to go buy a new license if I had v5. That page doesn’t seem to mention lifetime licenses at all. I don’t know if there’s a site issue, but clicking “renew license” in the preference pane also results in an error page for me, not a renewal page.
Crossing my fingers those are being retained and grandfathered in, and there’s still just some display issues.
This might help answer some of your questions:
https://www.arqbackup.com/blog/next-up-arq-7/
Quite a bit of information in there (and a quick glance, it seems to answer your questions). I've been on Arq 7-PR since it was released and I'm very happy. It reminds me of Arq 5 (reliability) with a modern UI. Under the hood, there are many improvements, so I wouldn't necessarily compare it to Arq 5, if that makes sense.
It's nothing like Arq 6, which was arguably built during, and after, a bad LSD trip. (joking of course).
> Back up your stuff
I recommend a combination of:
For a small price ($10+/yr*), you get offsite backups with file versioning/history.
* depending on usage and provider. You have to pay for Arq separately. Maybe get it during one of their sales.
I am sure Duplicati and Duplicacy would be good tools, still have to evaluate those. But I'd highly recommend having a look at Arqbackup (https://www.arqbackup.com) as well. I have been using it for quite some time, very stable and does the job well.
I use Arq with Backblaze B2.
I also use the CrashPlan small business plan since I get a year of it at 75% off. I’ll probably cancel once the discount expires.
This. Most NAS devices can do time machine, and are much easier to upgrade. A RAID 1 mirror would be extra safe, but you may want to also consider an offsite backup as well. Either cloud (I like ARQ) or just an external you hook up occasionally and store someplace secure (work, family, friend, bank), to protect from fire, theft, etc.
> proprietary encryption
Arq's storage is documented and there are two open source utilities for restoring backups
https://www.arqbackup.com/ Just installed this and using it to backup locally. I have a network drive and a local USB drive. One thing I will miss is the email reports. It was convenient to know if my computer didn't backup for 3 days.
As a cloud option with ARQ https://wasabi.com/
Recently the cost of standard storage (0.023/GB in us-east-1) is cheaper than RRS (0.024/GB). Since it's moved to it's own page like magnetic storage, I'd look at using a policy based on standard storage, infrequent access, and then glacier.
Personally for this use case, I'd look at tool that has integration to S3 natively such as Arq. That handles the storage aspects and metadata/mapping for restores.
Or Backblaze. :) When I did my initial seed from my desktop (approx 600GB), it took about a month on DSL, but then the delta was easily handled.
Data is encrypted before even reaching destination, and also locked with a password of your choice; and yes, you can backup SMB shares. There's no linux support.
Also oops on /u/cgimusic and to you /u/ndboost. I meant to say with Amazon Prime you have the opportunity for Amazon Unlimited which gives you unlimited space for $59.99 a year... though unsure if you need to be a prime member or not.
Check out the thread I made the other day.
Currently what I'm doing is using Arq5 to backup to Amazon Cloud Drive from my laptop (~2GB backed up) and desktop (~300GB backed up), then using Resilio Sync (Formerly BitTorrent sync) on my NAS, laptop and desktop to synchronize files I'm currently working on between computers (Sub 100MB, just a bunch of office documents).
Can I ask how much data you're backing up, how much you're syncing, and why you need the synchronization in the cloud?
I use Arq on my Mac and love it. Haven't used the Windows client.
It supports various backend storage types. I first used S3, then switched to Glacier to save money. The four hour retrieval delay dissuaded me from that, though, so now I'm using Google Nearline. I've been using it for a year or so now and just get a bill every month for less than $3 for my 250+ GB of data. Every couple of months I'll need a file I know I've deleted and restore it. Haven't had any issues.
I wouldn't recommend it for a non-techie but otherwise it was easy enough to set up.
I have a philosophical disagreement with "unlimited" providers for stuff like this. If Google can price the storage that cheap, I'd rather just pay for what I use than have to figure out what strings are attached to "unlimited" (and track when/if that changes).
I just started using ARQ https://www.arqbackup.com/, it's an amazing program, acts similar to Apple's Time Machine where it creates versioned backups so you can grab files from different dates. It also fully encrypts your files.
From a technical perspective, once you have your big server you could use CrashPlan for free between computers (I don't know if that would extend to commercial use... check the EULA). Arq Backup would be a good option and offers a one-time purchase and easy configuration. You could also use something as simple as rsync or sftp, but you need to ensure files are encrypted before being transmitted and that you don't keep encryption keys on the same server - or at all, preferably.
When you're selling this to clients make sure you're clear the data is being stored at your office and may be damaged in the case of fire / flood / burglary. You might want to check with your insurance company and make sure you don't need to carry extra coverage. Obviously you'll need a pretty beefy UPS, and maybe a backup generator and redundant internet connection if you're supporting more than a handful of clients.
You might find after running the numbers that this is less cost-effective than you think.
To quote from here: https://www.arqbackup.com/blog/amazon-cloud-drive-backup/ "Your backups are de-duplicated, compressed and encrypted"
One of my machines has 137GB of data selected for backup and it takes up 110GB on ACD, thats after a few weeks of backing up as well. I think its safe to say some measures are being taken to minimize space on the cloud side.
I use Arq - it works fairly well. It works with ACD, encrypts file contents and obfuscates filenames, but does not fit your last consideration (encryption outside of the backup software). There are Mac OSX and Windows versions, but no Linux version.
What are your OS requirements? The Windows landscape for ACD software is especially sad - there are no free/libre solutions, and some of the popular paid solutions that do exist do not support encryption (ExpanDrive and NetDrive, for example).
If you're on a Mac, I highly recommend Arq. It'll manage backing up to S3, enabling the lifecycle rules to push the data into Glacier, and has open source tools to extract your backups so you're always able to retrieve your data, even if Arq is no longer available.
Like check this out:
Arq 6: More power, more security, more storage savings
April 7th, 2020
https://www.arqbackup.com/blog/arq-6-more-power-more-security-more-storage-savings/
>More secure
Arq 6 has a new password feature. You can set a password to prevent others from opening Arq and deleting backups.
It also switches to using SHA256 for checksums instead of SHA1 which is less secure.
Anyway, just a thought. Thats usually one of the reasons to consider bumping some software up at least a version before the latest. Knowing the developer is still keeping tabs on at least 1 version before the latest.
You may wanna check out Arq.
This checks everything on your wishlist, except bootable backups. Which you can achieve with SuperDuper.
You can use Arq backup 7 to copy your files to your multiple OneDrive accounts.
It has the additional benefit that it encrypts your files before uploading so Microsoft cannot scan them for content and block your account if their algorithm mistakenly decides that your files are objectionable: in such case MS blocks everything (OD, Office Apps, email) and there is no practical way to appeal. See: Microsoft's account suspensions and the OneDrive 'nude' photos
You need to use a backup program that will sync what you have in hd1 to hd2. I suggest you get a (two week trial) of Chronosync
Suppose hd1 has all the correct files that the LrC catalog refers to. (You can use the menu command “Library / find all missing photos” to check that there aren’t any photos that LrC cannot find.)
You will create a “mirror” job which will copy all the file structures from the left (hd1) to the right (hd2) and will delete from hd2 whatever is not present In hd1. So you will have an identical folder hierarchy in both drives. Additionally, you can set chronosync to actually save the “deleted” files in a special folder (Archived items) in hd2 instead of moving them to the recycle bin.
In case you have some files in hd2 that for some reason are not in hd1, you will find them in this Archived items folder and can import them to Lightroom from there(if you want). Inside LrC, from the folders panel, you can move them to hd1. The next run of the chronosync job will put them to the same corresponding place in hd2.
As for cloud backup you can look at Arq backup. They offer a plan which they provide cloud space or you can get just the app and backup to different cloud providers. So if you use office 365 (which comes with 1TB OneDrive) you can backup, with encryption, your files there.
Another option is Backblaze personal backup which is more automatic and backups everything for a flat yearly fee
Arq is exceptional.
If you want to do something similar to the Windows method, you’ll need to get into launchd
. I can’t recommend Launch Control enough.
Seems to have been fixed: https://www.arqbackup.com/download/arqbackup/arq7windows_release_notes.html
>Fixed Issues
> Fixed an issue that could cause a crash when opening the preferences window for some license types.
>The dev has fixed this in version 7.1.5 on windows:
>
>https://www.arqbackup.com/download/arqbackup/arq7windows_release_notes.html
The dev has fixed this in version 7.1.5 on windows: https://www.arqbackup.com/download/arqbackup/arq7windows_release_notes.html
A couple corrections on the docs:
^/Users/Alice/.
is said to match files starting with ".", but in that case the .
would have to be escaped; the RE as-is would match effectively any file/folder name, except possibly those that start with a newline.Additionally, I think it'd be nice if the glossary mentioned Validation. I believe we're still waiting for that explanation on how it works!
Arq will back up to a folder on a NAS. I use Arq to back up my Mac to Backblaze B2 and it's great for this, although I've never used my Synology as a backup destination for Arq so I can't comment on how well it works. But I would imagine it works fine.
Edit: Arq also support encryption. Since other commenters seem to be pointing out how important this is (and I agree).
Still running 5 but watching this page update frequently which makes me happy:
https://www.arqbackup.com/download/arqbackup/arq6_release_notes.html
I have faith that 6 will be the new 5. YOU GOT THIS
Arq can back up to any folder, including those mounted on your NAS, or with SFTP. You may actually find SFTP is easier as I'm not sure if Arq will try to mount a share if it's unmounted.
For that matter, once you have Arq, you can back up to a variety of cloud storage services (I use B2) which may be more reliable for people with laptops who are often out of the office.
Are you looking for an OS-level backup or file-level? For file level if you just want drag-drop type of stuff S3 Browser is a whole $30. For something that can handle incremental backups and has a lot of flexibility overall I like Arq Backup.
For OS level I haven't worked with anything for a bit but there are options. Usually they're fairly pricey for ones that work on Windows Server.
Any chance you can just ship a USB drive to someone and have them plug it in? That's the simplest method...
Rclone is probably the most widely used software for this purpose, but it's limited to how good your coding is. Lots of windows users use Stablebit too. You should cross-shop Arq too.
I agree with /u/bryantech - Arqbackup will work very well for your requirements.
> Arq makes incremental versioned backups of your files as compressed, encrypted, de-duplicated data.
It is also easy to understand how to restore with Arqbackup: https://www.arqbackup.com/docs/pages/restoring.html
You paid $40 for backvp2. Spending $50 for Arqbackup would be well worth it if only for the ease of use. But there's more! You can also back up to clouds: Amazon, Google, Wasabi, Backblaze and OneDrive. If you are not backing up to the cloud (or offsite), your company is not safe.
See also: https://www.reddit.com/r/Arqbackup
Take a look at https://www.arqbackup.com/
I use it to keep 2 backups of my files, one in Backblaze B2 and one on a local folder (which is an external HDD mounted to my PC). It works similar to Git, so it will enable versioning and verification
The bad and stupid part of Arq is that it stores files differently from each "destination", therefor the local files cannot be compared to the files in B2 or any other place. Maybe only if you pick 2 destinations of the same type (backup to 2 external hdds or something)
I'm still thinking on how to improve my strategy.
I noticed this in my logs just now too. But actually got an update today to 5.11.4 which apparently fixes it...
https://www.arqbackup.com/download/arq5windows_release_notes.html
> Fixed an issue that could cause 'Illegal characters: [?] in path' errors when reading in-use files.
Seems to have done the trick, and looking more closely I'd say 5.11.3 caused the problem.
I use SVN as it has better support for large file versioning and keep my graphics source files (Photoshop PSDs etc) separate from the repository. I then run a journal backup of the graphic source files which saves to my NAS.
My current backup software of choice is ARQ.
Neither am I. Especially after this blip back in May (which to be fair they handle really well - transparent and lots of good comms)
I view ARQ as useful for catastrophic failure (like Crashplan was) whereas I loved having a Amazon Drive / Google Drive through rclone as essentially external drives which could be accessed easily.
Thanks a lot for the detailed explanation.
Actually, I started using Arq (https://www.arqbackup.com/) to backup my macbook to ACD. Although, that works fine to have a 2nd backup (the primary is an external hard-drive using Timemachine) of my macbook files, it doesn't work for my photos, because I don't have space on my macbook to keep everything.
Also, Arq is a cool backup solution (that offers encryption), but it doesn't work if we want to arquive something on ACD, for example. Do you know another software that also offers encryption but allows you to do that? The idea is to have something where I can have my arquive destinations configured to automate the process and arquive something with confidence.
"Do you know about the 3-2-1 rule? if not, google it." - No, I don't know. I will google it :)
Amazon Cloud Drive is $60/year unlimited. It's not as fully featured as some others, but some third party backup software will seamlessly support it. I use Arq Backup with it, works extremely well.
From here:
> At the most basic level, Arq stores "blobs" using the SHA1 hash of the contents as the name, much like git. Because of this, each unique blob is only stored once. If 2 files on your system have the same contents, only 1 copy of the contents will be stored. If the contents of a file change, the SHA1 hash is different and the file is stored as a different blob.
> Files are blobs, and commits and trees are blobs as well.
> (It's not quite that simple actually. To make the names less susceptible to lookup tables, Arq actually calculates the SHA1 hash of the computerUUID concatenated with the blob's data. But we'll use "SHA1" as shorthand throughout this document for this SHA1-derived identifier.)
So take the unencrypted file you want to find, paste the the backup ID (taken from the root remote folder name) at the start and save. Then look for the resulting file's SHA-1 hash in the remote objects folder.
Example: You can see the hash of AmazonDriveSetup.exe matches the path/file name on the right. At no point was the decryption key needed.
It would be more complicated when Arq splits larger files into smaller blobs, but I guess it would work the same way.
I'm in the same situation and have come up with a (less than ideal) temporary solution.
One of my machines is a Mac OS X laptop of Arq backup software installed. The OS X box has Synology folders mounted and backs-up to Glacier periodically. Arq handles local encryption before uploading to the cloud. I presume could use a similar strategy with something like Carbonite for non-OSX machines.
I use Arq, encrypts with a clean GUI, love it! License is per user, so all machines you use are under your one license. Only possible issue for you may be OS support. Windows and Mac have good clients, but no plans from the dev for Linux.
My backup solution is a combination of two otherwise-unconnected products:
The idea, simply, is to pay for your all you can eat plan via Amazon, then after buying Arq backup, set it up to back up whatever you want to that Amazon Cloud Drive account. The reason I like this setup most is because Arq will strongly encrypt the data BEFORE sending it to Amazon, so the information that makes it to the cloud is legitimately, from Amazon's perspective, "zero-knowledge", meaning there's no way they can decrypt it. So if the government ordered them to hand over all your data, all the bad guys would get would be some encrypted crap that they have no idea what to do with or how to get at it.
It's not like I'm storing/backing up anything illegal and I'm sure Uncle Sam would get bored real quick with backups of my bills, letters, spreadsheets, budgets and code I've written, but hey - it's the principle of the thing, ya know?
Anyway, I suggest that. :)
Be aware that it's 5% per month, prorated daily. Arq has good documentation on how restore pricing works. The nice thing about Arq is that they allow you to limit your retrieval rate and it has a nice calculator to show you how much it affects your costs. From their docs:
> For example, if you’ve backed up 100GB of files to Glacier, you can restore 5GB for free each month — 160MB each day.
Once you start increasing the rate of retrieval, it quickly gets expensive.
I use Amazon Cloud Drive to back up 2 Macs with the help of Arq. It's very similar to Backblaze but you basically choose where you store your data (Google Drive, Amazon S3, Dropbox etc.). It only uploads the changes to the files and encrypts everything beforehand. Have 200GB+ up there, couple of successful restores, pretty happy with it for now (started in August 2015). Arq is $40 but there's a trial. https://www.arqbackup.com/
You can see the various pricing options in a table here: https://www.arqbackup.com/features/
Basically a terabyte of storage can be between $6.99 (OneDrive) to $10.24 per month (Amazon Glacier, Google Nearline). Or higher for S3.
On OS X, ARQ ($40/client or $10/mo). Support for Glacier and setting cost thresholds.Fire-and-forget for my $HOME directory and other bits on my laptop.
For Linux, Duplicity is my goto. With lifecycle policies, it rolls to Glacier too, but any restores would need to be manual by first getting the objects temporarily back into S3.
We are an MSP that supports a bunch of Mac shops and Mac Mini servers.
We use Western Digital Elements USB drives for Time Machine, or in some cases the customer has a Time Machine server hanging off of a Mac Mini with Western Digital Thunderbolt disk attached, or a QNAP NAS.
Don't be fooled into buying WD Passport drives, because you are just going to format the drive with Disk Utility and use it for Time Machine, so you don't need to pay for the Western Digital backup software that is the basic difference between the Elements and Passport models.
We then use ARQ Backup to push offsite backups to Google Cloud Storage or Amazon S3.
Arq and Bvckup 2 are also good options.
I haven't tried Arq on my Windows machine, but I do use it on my Mac (along with Time Machine) for offsite backups. I have it backing up to my dedicated server via SFTP, but you can have it back up to numerous other cloud storage providers (Amazon AWS, Google Drive, Dropbox, etc...).
I use Bvckup 2 to back up select folders to a network drive. The program works really great (lots of features and configurations you can run) and is very well designed.
For offsite backups, I use Backblaze. Seems pretty good, I haven't had to use any restore features just yet though. You pay the same amount for any amount of data stored and I have about 500gb backed up there.
Just a tip - some people here have suggested using Dropbox to back up data - DROPBOX IS NOT A BACKUP SOLUTION. One 'delete' instruction sent from the wrong place and your mistake gets replicated across your devices.
I highly recommend using something like Arq (https://www.arqbackup.com/) and using your own encryption on S3. Something you control, and can define your server location and number of backup revisions.
So you need real time one way sync or just some sort of backups of windows folders to your unraid server like daily ?
For backups, you could use Aqcbackup. It's paid but it's one of the best. You can create a job to run daily which backup folders from your Windows machines to a SMB share provided by your unraid server.
Natively connects to B2. You control the encryption keys, and does everything you mention.
If you really wanted to, you can also use the S3 API with Arq Backup for backup immunity.
Basically. It's a multi endpoint backup solution for Mac and windows, I've never tried the Win version though. It does have a 30 day trial so can't hurt to try it. Has built in cost monitoring too if you are using a paid backup location ( like aws/glacier that charges per GB) https://www.arqbackup.com
If you have some technical ability, I would set up minio in a docker container on the Synology.
Then use arq on the Mac to backup to the synology.
Here is an article from a few years ago: https://www.arqbackup.com/blog/synology-backup-guide/
Time machine backups are Ok, but not as your only backup. There have been too many issues where TM backups fail or become corrupt, especially over a network connection.
Sorry, I guess I don't understand what you mean by "upgrade". Maybe our pricing FAQ would help: https://www.arqbackup.com/documentation/arq7/English.lproj/arq7Pricing.html
This seems to be an issue with the keychain, not with Arq specifically. If you're upgrading from Arq 5 to Arq 7, Arq 7 tries to read your settings from your user keychain.
To avoid it, delete ~/Library/Arq (the Arq 5 settings); install Arq 7; add your storage location; adopt your backup set. Here's the help doc on adopting: https://www.arqbackup.com/documentation/arq7/English.lproj/movingToNewComputer.html
Here's Arq's documention for adopting backup sets.
I think immutable backups have to be done with a new bucket though. But I'd contact Arq support via email with your scenario to make sure.
You're welcome.
There are some options for this. Disabling thinning and budget would keep everything as mentioned in the other post. At some point this might get expensive. I never tried that.
Another option would be to choose a long hourly thinning retention, like 11160 hours (365 days). This way, everything backup up will be available at least for 1 year. If you inadvertently delete something now, you would have 1 year to notice, before any thinning kicks in, which would only then remove those objects from Wasabi.
Given that you can't be sure to notice however, the option you want is to keep any deleted files, which can be set in the options tab. Edit your backup selection and go to the right tab as shown in this screenshot.
Arq's documentation on this states that this will…
>instruct Arq to keep deleted files in subsequent backup records, so that a file deleted in the past is easily found in the latest backup record
This way, you can enable thinning without worries. Only prior versions will be thinned like this, not deleted files.
Since you pay for 90 days of minimum storage with Wasabi, I would set the immutability to 90 days, with a 7 day refresh interval. This means you could set the hourly thinning to 2328 hours (97 days) and leave the rest as it is (30 days, 52 weeks, 60 months).
About the other question. Arq won't upload anything that has been uploaded already, even when jobs are interrupted. The status shown with the 6G is just relative, probably the amount after you started the backup again.
In the settings you can also change variables like upload speed. The network tab has options to limit bandwidth at times.
And as seen in the earlier screenshot, the options tab has a setting for threads. I set this to 15 for the fastest possible uploads.
Once again, thank you for your help.
I found a solution, with some one from the Dark Side.. :)
https://www.arqbackup.com/blog/how-to-fix-error-1202-on-mac-os-x-prior-to-10-12-1/
After this, I was able to reinstall the BackBlaze software and solve the starting point of my problem. The BackBlaze control panel was showing a message about maintenance issue with servers. So, no backup was happening. At that time, I didn't know the reason for that was the outdated certificate.
Ich kann Arq als Software für das Backup empfehlen https://www.arqbackup.com/
Das Backup wird vor Upload verschlüsselt. So kann einem fast egal sein welche Cloud man Nutz. Man kann dann einfach nach Geschwindigkeit und Preis die Cloud wählen.
Für iPhone Backups kann ich https://imazing.com/ empfehlen.
I am getting this error every time Arq attempts to backup. Thus, I am not getting any successful backups. I updated to the latest version 7.7.7.0, and restarted my computer. I noticed their latest release notes theoretically fixes this. Hopefully, they are working on a new fix. Any ideas...
16-Aug-2021 15:27:04 -07:00 Backup activity started
16-Aug-2021 15:27:04 -07:00 Arq version 7.7.7.0
16-Aug-2021 15:27:04 -07:00 Storage location: 01_Documents_Backup (Local:a29e0723-####-41b#-ac21-cb0e4880dd77:/08_Backup_Drivers/01_Documents_Backup)
16-Aug-2021 15:27:04 -07:00 Backup plan: Laptop-External (8551236-c3d12-4a##-b487-7cg8ba45269b)
16-Aug-2021 15:27:07 -07:00 Creating VSS snapshot for D:\
16-Aug-2021 15:27:10 -07:00 Created VSS volume for D:\
16-Aug-2021 15:27:25 -07:00 Error: Unexpected exception occurred during backup: Object reference not set to an instance of an object.
16-Aug-2021 15:27:26 -07:00 Deleted VSS filesystem snapshot for D:\
16-Aug-2021 15:27:26 -07:00 Backup activity ended
Apps that offer backup to both Cloud (their Cloud space) and physical drives:
i think the answer is here: https://www.arqbackup.com/blog/immutable-backups-with-arq-7/
Storage options that support object lock include AWS S3, Minio, Backblaze B2 and soon Wasabi.
so wasabi may not be supported yet.
> And B2 also needs for me to backup the files only once right ?
With B2, you have to choose one of the 100 programs listed here, depending on your needs: https://www.backblaze.com/b2/integrations.html
For backup, if you don't have any strong opinions you might start by evaluating Arq from that list: https://www.arqbackup.com/ which supports B2 as a "back end". But other people like other things.
One of the most interesting ways to use Backblaze B2 with a NAS drive is that some popular NAS drives come BUILT IN with software that will back them up to B2, no external computer needed! For example, Synology just comes with backup built in that pushes your files to Backblaze B2. No installation required! Also "TruNAS" does also. You can watch a YouTube video of that from a totally random external reviewer here (we didn't create this, we thought it was a nice independent review): https://www.youtube.com/watch?v=jc7bUFBl4RQ
In each case, it is up to the backup application, but yes, it is VERY unusual to require a full backup each hour of each day to the cloud. I've never heard of it. All the backup software knows how to do "incrementals".
May not be exactly what you're looking or but we use ARQ5 to backup to Wasabi and local storage; it has native support.. You can probably map Wasabi as a drive letter and do the backup to local this way.. It's cheap and works in the background with minimal maintenance. https://www.arqbackup.com/
Recalling from past posts and tweets: Arq 5 had slightly different storage formats between location services. If you had the wrong format, Arq simply wouldn't work — the software assumed every storage location had the proper storage format for its type.
Arq 6 onwards changed that — new data is created in a unified format. So, I guess it should work. If you're moving between two locations of the same type (e.g. both S3-compatible, or both SFTP) I'd assume it's pretty safe.
Worth noting this line from the changelog for version 7.1.6:
> * Fixed an issue where restoring from an older backup record (created by Arq 5) within a backup set adopted by Arq 7 that was moved/copied from a different storage location type could result in object not found errors.
They said that, upgrade to Arq 7 will not modify the original backups:
" we now just read that data, and reuse it for subsequent backup records where possible. "
. You can ask them how to use Arq 5 again after upgrading.
Personally I'm not using Arq 7 yet, feel this product is also a little bit rush. They have promises are not fulfilled, for example, a data format document.
In case someone else has similar issues, here is my solution.
​
Just wanted to give it another try and luckily stumbled upon a section in the Arq7 docs about deleting Arq via the following script:
https://www.arqbackup.com/documentation/arq7/English.lproj/troubleshooting.html
#!/bin/bash
killall Arq launchctl unload /Library/LaunchAgents/com.haystacksoftware.ArqMonitor.plist /bin/rm -f /Library/LaunchAgents/com.haystacksoftware.ArqMonitor.plist sudo launchctl unload /Library/LaunchDaemons/com.haystacksoftware.arqagent.plist sudo /bin/rm -f /Library/LaunchDaemons/com.haystacksoftware.arqagent.plist /bin/rm -rf /Applications/Arq.app /bin/rm -rf /Library/Logs/ArqAgent /bin/rm -rf "~/Library/Application Support/Arq" /bin/rm -rf "/Library/Application Support/ArqAgent"
this did the trick and after reinstalling v7 it works now!
Got this from support:
There is a list of snapshots under the 'Restore' tab. If you look at the latest snapshot it shows added/modified/deleted for items that are, so you can look at what's changed that way.
Also, it's possible to include the list of the uploaded files in logs/email reports in Arq 7: https://www.arqbackup.com/blog/next-up-arq-7/
https://www.arqbackup.com/download/arqbackup/arq7_release_notes.html
There is progress in and since about 7.0.0.40 most critical stuff is ironed out. Edge cases are still getting found. turnarround time for bug reports is great mostly it is in the next release...
You might wan't to wait for the release if not brave to run betas...
1/
Arq6 is a backup software that is simple and cheap and it can backup to many different locations: local, SFTP servers, dropbox, onedrive, gdrive, Backblaze, Wasabi, Amazon... It's just install, set up a backup and forget: https://www.arqbackup.com/
2/
Backblaze is simple, cheap and straight forward: $20/month for 4Tb.
3/
Any type of disk is ok for your type of usage. Avoid Seagate's and get two WD Elements and shuck the drives, put them in the NAS and start copying.
This just started happening to me today, too. Running version 5.17.1
Looks like this is still the version released in early October.
Yes! Appreciate the feedback. I was observing how icloud works and at the end I concluded that it is not a backup service but provides some functions.
Either way, I have been using wasabi cloud storage and bought arq backup software. End to End encryption before it leaves your network.
Arq and Wasabi have saved me a few times. I get to kick back from either but do like the service. $6/ month for 1TB - not bad at all.
Arq has a similar service if you do their subscription
Also, why not just use Arq cloud? I use cloud storage for several different things so wasabi gives me more flexibility.
Oh, I didn't realize an automator flow isn't the same as a script. I followed the instructions here: https://www.arqbackup.com/blog/nas-backup/
​
And it worked correctly.
​
Well, should have looked for that 2 years ago.
Hi,
there is an advance for the Mac version. You may study this in the release notes of the former Arq versions and you see it just recently with the Arq 7 beta version (Mac version available, Windows version is not), see: https://www.arqbackup.com/blog/next-up-arq-7/.
I am running version 5 because my test runs with version 6 yielded issues:
- with VSS not working correctly
- backups got stuck after the initial backup
- restore did not work on some files
- slow backup speed
- sluggish GUI
That’s an interesting problem. I have never heard of someone using Time Machine over VPN connection. I know that recent versions of Mac OS include the ability to be used as Time Machine servers for macOS clients on same network. I would recommend taking a look at Arq Backup. https://www.arqbackup.com/ This app is designed to backup to remote servers or local servers. I have been using this for years and its excellent. I back up to my Amazon Drive account for offsite storage. I don’t work for or rep this app. Just really like this product.
Arq 5.19.2 is out. From the release notes:
>Changes
>
>• Added a workaround for Google Drive's new 500,000-item per-folder limit.
I run 2 instances, one at home, one in the cloud, and use it with Arq Backup on all my home systems for an easy backup solution. Been running it for years, restored a few deleted files here and there, been great for me without the huge expense of commercial Cloud backup providers.
Besides the Arq backup folder (which might cause problems?) I only have a few folders and files that should all be named ‘normal‘. The files and folders I recently added for test purposes were named like ‘test’ or ‘123’… 😉
I have not seen anything specifically stating it is the same, but it would require a completely separate backup format and the accompanying code.
Here's a writeup of the format (not sure if it's completely up to date with Arq 6): https://www.arqbackup.com/docs/arqcloudbackup/English.lproj/dataFormat.html
New build (6.2.16) was just released - https://www.arqbackup.com/download/arqbackup/arq6_release_notes.html
(I went back to Arq 5 after losing prior backups by "upgrading" to 6.)
If you’re on a Mac and want to back up to the cloud, rather than buying a monthly service, try https://www.arqbackup.com which is a one-time fee of $50. You can then point it to one of a ton of Cloud providers (Google Drive, AWS S3, onedrive, DropBox, backblaze) to do the actual storage. With some of these having free storage (Google Drive is 15GB) plus the ability to combine with others (back up to both free Google Drive and free DropBox) you can typically string together enough free storage to back up your essential files to the cloud for free. Need more space space? Use Backblaze (or even S3) which is typically way cheaper per GB than a monthly service. Oh and everything is encrypted locally before being sent to the cloud.
Not affiliated with Arq, just a happy user. Saved me a ton of $$$ and thought it fit the parameters of this post... everybody should back up and it should be cheap.
I recently tried this and found GB&S was a huge resource hog that was also surprisingly slow and inefficient at sync on my MacBook. A friend recommended Arq which can backup to your Google Drive storage as well. It can even encrypt the backup. So far it is working much better for me than GB&S ever did.
OS X isn't easier. Unlike Arq 5 which was an app bundle you drag to /Applications, Arq 6 uses an installer and puts stuff in all kinds of places when it installs.
I used a combination of UninstallPKG, ForkLift, and Lingon-X to fully get rid of all of it. Make sure not to delete Arq 5 stuff (for some things it's not immediately obvious which ~/Library items are Arq 5 vs Arq 6).
The Arq developer provides the following below at the bottom of their homepage, but I still preferred using my UninstallPKG utility to get rid of all traces of the Arq 6 package installation.
From https://www.arqbackup.com -
How do I uninstall Arq 6 for Mac?On Mac, click the Settings tab. Then click the Uninstall button.
To manually uninstall Arq 6 on Mac:
We haven't seen that particular problem, but we shipped 6.2.4 with fixes for things that might be related.
Please click Settings and check your version number.
If it's not 6.2.4, please install the latest (you won't lose any settings):
Go to Add or Remove Programs, remove Arq 6, download https://www.arqbackup.com/download/arqbackup/Arq6.2.4.msi and double-click it to install.
If that doesn't resolve it, please email [email protected]. We're about 3 days behind on email, but working to catch up. We brought on extra staff to help.
We wrote a blog post after the announcement post explaining that there were problems, and apologizing for it, and explaining what we're going to do about it moving forward. https://www.arqbackup.com/blog/arq-6-next-steps/