Others have made very valid points here. You’re still very young and early into your drumming journey. Most of us eventually run into this situation. Unfortunately, drums are loud and your neighbors have a right to some quiet (especially considering you have a shared wall, which makes a huge difference).
Here are my suggestions:
Set up an agreed upon 1 hour allotted time per day that you can practice on your acoustic kit. That’s pretty reasonable, and your neighbor can plan to do errands while this is happening, or at least he won’t be caught unawares that you’re going to be loud.
Keep a drum pad or your e-kit set up if you want to play outside of your agreed upon time. I know that they don’t feel the same, but we’re compromising like adults here, and that is a sacrifice that you should be willing to make.
Focus your playing time on your dynamics. Playing quietly isn’t always as fun, but if you’re serious about drumming, it is an invaluable skill that you will be called upon to use in many live situations.
Outfit your kit with silent cymbals and mesh heads. This is obviously a budget thing and I’m not sure what your price range would be, but look into these:
Zildjian L80’s and Remo Silent Stokes
Those will make your acoustic kit incredibly quiet while retaining a (mostly) realistic feel. The Silent Stroke heads are a big springy, but they can be tamed a bit.
I hope that helps. Don’t hate your neighbor. They’re well within reason. As a musician playing an incredibly loud instrument (especially someone who is still learning, which can be very aggravating to be around to be honest), it’s your responsibility to make sure you’re keeping the peace. So, do the adult thing and take responsibility and try to come to a compromise.