https://www.video-comparer.com/
Pricy for the full version but worth it to me. Can analyze infinite number of video files across all formats, provide percentage matching, thumbnails, etc. helps keep my ever-changing and growing 50+ TB collection of … Linux ISOs trimmed.
I run it in smaller batches, can easily run for weeks with 100,000+ files and highest quality analysis.
For finding duplicate videos, not by file size or hash, I highly recommend Video Comparer https://www.video-comparer.com . It scans the videos on your drives and shows the percentage of duplicate scenes regardless of video length or format. To be safe, only delete those that are a 100% match.
The free version is limited to 500 videos. So if you have more than that, you may have to run it multiple times. Still it's not fully guaranteed to catch all the dupes since it's not doing a full comparison of everything at once. I paid for the Pro version that checks up to 5000 videos at once.
If you have windows, I can recommend
https://www.video-comparer.com/
It is a commercial software but worth each cent. Haven't seen anything better yet.
It also works in a Windows VM under Linux. Unfortunately GUI only.
Video Comparer for Windows. Paid software, but I can confidently say I've tried almost every duplicate video program out there and nothing even comes close. Different resolutions, different lengths, watermarks - doesn't matter - it will find them. Takes awhile, but scans the entire video so you don't get any false positives.
For videos, I use and highly recommend Video-Comparer. The Home or Expert edition should be enough for most users. I use the Pro Edition because I have over 5000 videos.
There's a few points to know.
It takes a long time, days when comparing thousands of videos, especially in the through mode.
It compares videos regardless of most codecs, video resolution, file size or cropping.
Be very careful when deleting a duplicate. Be sure to check the filesize and quality.
It's very accurate, I think down to 10 seconds or less of duplicate scenes.
Which leads the major issue with certain content. If there background is similar or the same like a newsroom set, it will flag those scenes as duplicate with or without anyone on set.
Because of this, never auto delete anything less than 100%. Always doublecheck before deleting.
Videocomparer is great for videos. There's a 30 day trial and the Home version should be enough for most users.
It takes a while to scan, especially in thorough mode, but it can detect even a few seconds of duplicate video, show the duplicate scenes, the file size and the percentage of duplication.
There's a couple of things you have to careful about. since will show all the videos that have duplicate scenes, it's easy to loose track and delete the wrong video. And, especially in thorough mode, it will tag scenes that are close, but not exact duplicates. For example, a newsdesk scene will likely be tagged as a dup even if there are different people since the percentage of the duplication on the set is high.
Not sure about organize by date, but Video Comparer is great for comparing videos. I've been using it for years and have the Pro Version since I have over 5000 files, but the free or lower cost versions should be fine for most users.
It will tag down to a single duplicate scene and list % of duplication. In general a 98-99% match is safe to delete, but always double-check before deleting anything. This is because of the ability to tag down to a single duplicate scene. For example, if the scene is a news set, it will likely tag it as a dupe whether the same two people are sitting there or not. Also, the 1-2% difference may be an additional scene or two.
The good thing is that unless the two or more videos are extremely different in quality, the program is still able to do very accurate matching.
This is the only thing ive found for actually deduplicating video.
https://www.video-comparer.com
It is slow, it is resource intensive, its not 100%, but its the only thing ive found over the years that actually works at all.
Pro editions a waste over the expert though, its an NP problem, so trying to compare more than 5000 things easily winds up taking weeks if you try pointing it at an entire drive...