Your computer has it built in too. It's just not commonly available.
EDIT:
Disclaimer: It's been years since I've used any of these features. Not sure if the articles are actually accurate.
Sorry probably not. The clipboard stores only the most current copy of anything that you put on there and forgets everything else.
Microsoft never implemented this because not many people need a clipboard history and there are literally dozens of freeware applications that can do it since the inception of the clipboard in Windows. Here's a free for non commercial use application I just found doing a quick google search:
http://clipdiary.com/download.php
Here are more: http://windowsreport.com/clipboard-managers-windows-10/
I use Clipdiary. I guess all the managers would be pretty similar, but I love this one. Easy as to recall last clips, ctrl+shft+up arrow, when you release the combo it pastes it straight in.
http://clipdiary.com/ - I have used this software for a long time and it really is useful. You can save clips, choose what to paste, set custom hotkeys and more.
Edit: /u/saturn_v is way more spot on what OP asked for (I just checked it out and it's awesome too)