What about KVM? Proxmox VE is a great distro for all-in-one install of KVM with a web interface that is really easy to use. As a bonus, you can use lightweight containers to host any linux servers, also managed through the Proxmox web interface. Also, it's free, so you really have nothing to lose at least giving it a test tryout.
I set up an ESXi system at my last job (like 50 hosts), but for smaller deployments I use Proxmox. If I was to do my work's system over again, for larger deployments (say over 5 hosts and with SAN backend), then I would probably try out oVirt first.
Proxmox doesn't appear to be free, at least from their website:
https://www.proxmox.com/proxmox-ve/pricing
> Subscriptions are licensed per physical server and CPU socket.
Basic level is €4,16 (US$4.90)/ CPU & month. That makes it pretty expensive.
Agreed. Linux vServers and OpenVZ have been around for years and both could be argued as more mature than even LXC. I ran Proxmox (Linux-based ESXi-like system using OpenVZ and KVM) for awhile as my primary virtualization system and it was great. However, none of those platforms ever provided the ease of use or an ecosystem around containerization. Also, having LXC in the mainline kernel is what has made Docker successful..
/r/homelab
Also, if vmware isn't working suitably, you might try out ProxMox VE. Its free(ish) and has been very stable for my use. Not the industry standard though but it will allow you to setup a full environment to tinker with.