Minio (https://minio.io) is an AWS S3 compatible object storage service. I moved my objects from AWS to a locally running minio server and hosted the data on my own.
The minio client makes those kinda of migrations easy.
There's a wide gap between "actual company with employees and bills", and "has the facilities and ops staff necessary to guarantee an SLA better than you'd get by just throwing things in 'the cloud'."
Or, to put that another way—which would you trust more to not lose your data? Amazon S3, or a minio instance running on a box in your office?
Google Photos is probably the best free solution.
If you're looking for a privately hosted solution, maybe if you're a professional photographer and need to handle things like large RAW photos give Minio a gander.
You can easily setup NAS as a personal Google Photos which you entirely control which will allow you to create compartmental storage for your "clients" to share their photos directly to them without having to deal with BS.
Pretty cool to play with, too.
Minio: https://minio.io/ Exposes local storage using S3-compatible APIs. This means your users can use any S3-compatible application or SDK to upload data (and there's lots of them - my favorite GUI one is Cyberduck)
If you're willing to run a front-end server, Minio can provide you with an S3 interface and use B2 on the back-end. I don't have it deployed myself, but I'm staying aware for the day when we'll have use for it at my work.
BackBlaze should suit just fine. Another suitable option for cost-effective storage should be Wasabi. As for the local copy and the software, Synology would do just fine, and you can also install Minio to it as a software solution.
It's a high performance, open source, and fully compatible implementation of Amazon S3 server, written in GoLang. Check out https://minio.io and https://docs.minio.io/docs/minio-erasure-code-quickstart-guide
Since crashplan has gone away I use Cloudberry with a local backup going to a USB drive and then a second copy going to a self hosted Minio S3 Compatialbe storage server I put at my parents house 30 miles away.. They have 150/150 internet and its been flawless for off-site backups with 0 fees.
> https://minio.io/ is an object storage server built for cloud application developers and devops.
That is a direct quote from their website. It offers an s3 compatible api for a host-you-own style object store.
This is exactly why open hardware & open software is the only viable solution for backup strategies. With software the most important part.
I have lost files due to: - controller broken, no replacement available anymore. (No longer being produced with the version I had) - broken MoBo (motherboard / main board), that had a rpm module that held my decryption keys (soldered on). - software beding “hyjacked” that corrupted my files (it was a type of malware like crypto locker before crypto lockers were mainstream. And was supposed to target a different version than my system was.) - people deleting files “accidentally”.
In short I have been burned so many times that now I prefer open source/ hardware and only use software solutions for things like RAID. Except for the master key, for those I prefer to use a set of smartcards.
Some systems I have used successfully (with some failure and recovery):
For most people I would recommend Nextcloud. As it’s the easiest to maintain and easiest to use.
MinIO is a good alternative for AWS S3 storage (object stores)
FreeNas is good if you just need a NAS / SAN (acces point) but does require more corporate like setups.
Using Linux is for people liking full control.
And as always. For a good backup follow a strategy like this: - have atleast 3 copies of the files, 1 original, 1 on a backup location, 1 at a geographic other location. (Like 1 on your machine, 1 on your ‘Nas’ and 1 on a backup disk in a vault @ the bank)
a backup is only a backup after you have restored from it successfully.
backups should be as automated as possible. The more human steps involved the weaker it is.
keep an eye on the logs of your backup solution. A broken backup is no backup
I hope these tips can help anyone with there backups
Sounds like you're looking for an object storage server, like Minio. Much lighter (it's a tiny Go app), it's open source, and it's very fast. It exposes your data using the S3 APIs, so you can use it with any app that supports S3...
Love the setup, I use to use Crashplan and when that went corp only I looked hard for a self hosted solution. Ill list what I did to fill the void ( maybe it will help someone ) I run /r/Xpenology which is Synology OS on my own hardware ( XEON w/32GB Ram ) which has WD Reds & SSD for apps. That has 3 drives in SHR that backups locally to an 8TB External, Then offsite to a self hosted Amazon S3 Block Level Storage Server ( minio.io ). On my Desktop and Laptop they also backup to a share on the local External HD that the NAS also backs up to, It then also goes out to the S3 server at my parents house out of state. This is free and only required me to purchase an awesome license for /r/cloudberrylab software ( $25 ) and put a computer under a desk at my parents that runs minio.io. & has a Dynamic DNS name setup to reach it.
I linked the doc just for reference to beginners with NFS. We're still using soft mounts in production, and due to some other characteristics (multi path, dual data mover controllers, etc.) that make our server side very reliable, we don't have an issue with them and they behaved well during short upgrade windows (very much unlike hard mounts). That being said, a proper distributed file system would be closer to my liking, however all the implementations have various constraints that don't work for us.
The concern we have about migrating NFS to something else is a large amount of legacy code which uses file system syscalls directly and doesn't really give us a nice way to perform this migration, mostly on account of cca. 15 years of development. Go is a brilliant language with all the io.Reader/Writer etc. interfaces, that allow you to implement a S3 or something like https://minio.io client, and just fixing some imports around your code. That's brilliant. I'd be a happy kitten if I could move everything in PHP to several HTTP file service endpoints and call it a day. In Go, it's at least realistic to do this.
Edit: Edited for clarity/words.
I'm using Arq (Mac) and Duplicati (Windows service) as backup clients.
The remote backup storage servers are running Minio (https://minio.io/).
Using ZeroTier (https://www.zerotier.com/) to allow everything to talk to each without having to deal with NAT, firewall holes, etc.
My fallback would have been SFTP over VPN, but the Minio+ZeroTier solution feels nicer so far! :-)
I would recommend to check out Minio. Every time it comes to FTP alternatives, Minio is the first thing that comes to mind. Check out this article for more info.
Regarding the BackBlaze, it may work well with some third-party tools that are good in doing an incremental backup. I could also advise to check out Wasabi, for their pricing is marvelous. If you are still going to get a NAS and place it inside a fireproof safe, you may want to consider installing Minio on it.
That depends on what do you mean under the private cloud server. You could use something like Minio or any other self-hosted storage solution. However, AFAIK, the game saves usually don't weigh that much, so unless it is not for the private use, something like Google Drive should be more than enough.
> Is there anything like this?
Yes and no.
From what you've described, it seems like something any good web programmer could write in 5 minutes. Ideally, you would replace the polling with websockets. But I suspect you're not really fully specifying what you want (and all the fun race conditions/failure modes that can happen.)
But I think [https://minio.io/](minio) might do what you want without programming. It's a web server where you can PUT data into URLs, and later GET it. With security.