howdy decepere,
i presume this is the one you are talking about. [grin] i remember playing with it - and it was pretty nice! also, it seems to be still getting developer attention.
FastCopy
— https://fastcopy.jp/en/
take care,
lee
Of course the files may be damaged in some way but try a different program and see if it has the same issue with the same files. Fastcopy and Unstoppable Copier are two good alternatives.
I would not suggest using Windows copy/paste, that routine is brain dead. If it comes across an error it just stops, giving no indication of what was copied and what wasn't. Instead there are several utilities that are better, including Unstoppable Copier and Fastcopy. If these come across a file they can't copy they just move on to the next one and you'll be able to see which ones had issues.
Filezilla would work for ftp.
if you can access the server via cifs/smb then fast copy might be useful. It will copy acls whereas ftp will not. It's fast and it's free, and it dont care a bit about long filenames. and it can log erros, and resume etc..
That usually happened to me, when the drive was transferring small files.
I'd suggest looking into Fast Copy.
I set the cache / buffer setting to 8 gigs, on my rig that has 64 gigs, and the files transfer very smoothly.
If you're copying multiple files once Windows explorer hits an error it just stops with no indication what file was the problem.
There are other programs like Teracopy, Fastcopy and Unstoppable Copier that will copy everything they can and give you a report of any they couldn't copy.
FastCopy is awesome. When I was gainfully employed with a Global Engineering Co., we used it in the server team to move a shit ton (2.8PB+) of files when we migrated from On-premise to cloud based storage. The Boss fell in love with it...
Grab the installer package BUT when it starts select the portable version setup. it will drop a portable executable (no installs/reg crap) in a folder you choose. Can then copy it anywhere you want and run it.
Make sure to "Run as Administrator" to make sure it can see everything.
It will sync the timestamps of your files and keep everything happy. It has a lot of options and a no frills GUI so no friggin command line crap. If you WANT command line, it supports that as well but for home use you probably don't want to write scripts / mess with a prompt if you don't need to.
I know you said you are more curious about it than actively trying to delete it but in the past I've had success with this tool for deleting previously undeletable files (despite the name it has a delete option):
FastCopy. Simple but FAST. I use it to do any mass copy/sync on Windows. Basically rsync but for Windows.
I use almost everyday TreeSize. I used FreeFileSync, should be okay too.
To find duplicate files I use DupeGuru.
Why would using a backup program on Synology be more secure? As long as you don't connect to the internet. you won't have troubles. ;)
By the way, what you describe isn't a back-up but (one-way?) syncing or mirroring. The fastest way to copy stuff to your Synology from PC is to use the very simple and free software by Shirouzu Hiroaki, FastCopy. It used to be open source, but for unknown reasons it's now freeware. It can be found here: https://fastcopy.jp/en/
If you check 'estimate' you will get that with increasing accuracy.
​
Create a new folder on the PC/drive where you want the videos. Let's call it "Videos2020" Now use an app like Fastcopy setting "Videos2020" as the desination folder (DestDir)
i don't believe that there is an in-built way to do that.
however you can use a third party utility like Fast copy and it's differential mode to compare files and copy only the changed ones.
Well, the number of files will affect that also. A single 5 GB file will transfer faster than 200 small files that add up to 5GB. Because of the way Windows transfers files each one adds more overhead.
There are utilities that will speed that up, Fastcopy is one. See if that makes a difference.
i can send it to you in email. what is yours? mine is
my script uses this program as the core for file verification https://www.exactfile.com/exf/
my script also relies on this program to perform the file transfers. i like this program more than robocopy and other options out there https://fastcopy.jp/help/fastcopy_eng.htm#history
i placed the exf.exe in my system32 folder and the program works great.
As other have said, you're limited by the drives and the connection. In this case the HDDs are the weak link. You may have an SSD internally but the HDDs can only read/write so fast, and that's much slower than the SSD.
An external SSD would solve that issue (I'm assuming the external HDDs are USB 3. If they're USB 2 then that's the limiting factor).
Another factor is Windows copy routines. If you're transferring a single large file it's ok. If however you're transferring a lot of small files then Windows itself is slowing things down. It reads one file, then writes it. Then comes back for the next file, reads it, writes it. That introduces a lot of overhead as it switches back and forth.
There are utilities like Fastcopy and Teracopy that do it more intelligently, reading in multiple files before switching over to write them. They also handle a write failure better. Windows just gives up and stops the entire process, they'll just skip the problem file and continue.
Another
I use FastCopy but it’s only for Windows, it’s great though.
https://fastcopy.jp/help/fastcopy_eng.htm#mode
“Copy if size or date is different, or it does not exist. In addition, delete all destination files/directories that do not exist in Source.”
Something I don't get...why didn't you restore the backup directly to the Plex drive?
Anyway, for the move, I personally like FastCopy, https://fastcopy.jp/en/.
It's not as shiny as Teracopy, but it's been reliable and...fast.
On the Windows side, you can try the program FastCopy to do the copying. There's other programs like it, but the gist is, it uses its own copy routines and avoids the ones built into Windows Explorer.
Website: https://fastcopy.jp/en/
Download link: https://dforest.watch.impress.co.jp/library/f/fastcopy/11574/FastCopy386_installer.exe
I've been using fast copy for my 15Tb transfer. It checks hashes before and verifies they match after. If one fails it adds .fc_verify_err to the end of the new file.
It also lists failed files so you can just re-attempt a transfer after your main transfer has completed. It's a nice, free, and super easy to use app.
NTFS is pretty horrible with small files. On Win7 I used to just create a FAT32 VHD and mount is as a directory for those games with 20,000+ files. It was a major improvement.
Also for copying stuff fast try: https://fastcopy.jp/en/
If we are talking about Windows for the future you can use something like FastCopy (https://fastcopy.jp/en/) and check the verify box when copy pasting. It will verify every file when it is done copying.
Now for your case I would recommend you to get RapidCRC (https://www.ov2.eu/programs/rapidcrc-unicode), create a sha256 or something of your local copy and then run it on your 4tb drive to see if all the hashes match.
Also there's fastcopy made by a Japanese. You can choose verify
to checksum your copy process and ensure the source and dest are bit identical. I never used verify function but I use fastcopy extensively.
That's the Windows overhead getting in the way. Instead of reading many files at once, filling memory, then writing them all at once, it does the one at a time thing. There are utilities that do a better job if you do that kind of thing often. Fastcopy is one, here's a list of others.
I would never, ever trust Windows' built in file transfers for making a copy of everything. Especially not 1TB of everything.
I live and die by that shit right there. Has the option to xxHash verify any file transfers, and it has cascading shell integration, so you get an additional "Fastcopy" entry when you right click or right-click & drag, and it allows you to copy, or move (copy+delete).
Works fine over a network as well. Used it to copy ~8 TB of stuff, albeit at nearly twice that speed. Only a few files had verification errors, which I chalked up to the USB3 driver for my desktop being absolute ass. Repeated those same files over a motherboard controlled USB port and then dumped everything off into the server, also using Fastcopy.
I've tried multiple ways to move data from a Windows file share to a Synology NAS. Here's what I've found to be most efficient and error free.
​
-Map both drives (Windows Share & Synology)
-Download FastCopy (https://fastcopy.jp/en/)
-Choose Source / Dest and make sure you check "Nonstop", "Verify", "Estimate"
-Change your speed control (defaults to "Full Speed") to 80%
-If you have permissions that you want to transfer over, check "ACL"
-Click "Execute" to begin
A lot of these are "register-ware" - ie. they work, but they ask you politely to pay for them. I am slowly working my way through buying them all (one/month) because they're all amazing.
WizTree - as the link states, it finds the files and folders using the most disk space on your hard drive. It's remarkable because it uses some NTFS fuckery to do things like show you all of the files on an 8TB drive in like a minute. It's great.
7-Zip - needs no introduction
FastCopy - It copies files, fast. It's more reliable than copying in Windows Explorer (and similar apps, like TeraCopy which just crashes on my machine) and it verifies everything after copying files. Very versatile.
MakeMKV - completely free Blu-Ray ripping
x264/x265 - it's amusing that even though AVC and HEVC (H.264, H.265) are "proprietary" formats with patents and license fees, the best encoders for both are FOSS.
CrystalDiskInfo and CrystalDiskMark - because of course I need anime girls in my hard drive utilities.
Both. Use acronis true image to make partition backup. Use program fastcopy to get off wanted data. https://fastcopy.jp/en/
With the partition backup you can just image the new ssd and you don't have to start over from scatch
Are you used to a different OS? afaik you can literally just copy and paste conventionally. If you have tons of stuff I would consider using a program such as FastCopy to move them.
I guess you were trying to change the location of your Videos and Documents etc. folders? I believe this simply makes it so that future files saved to those folders will be found in Videos, Documents, etc. on your second hard drive.
I have the same backup strategy as you and I personnaly use FastCopy in "Sync" mode : you won't end with folders that have both old filenames AND new filenames.
Plus it properly handles all NTFS links, NTFS stream and NTFS rights.
And more important : it can verify files it has copyied
Ah and it is free (GLP) and continuously maintained for several years.