Don't use a template, your box is the template you want to follow. Get a rabbeting bit with a top bearing (i.e., the bearing is on the end, opposite the shank with the cutter in between; here's a Freud set on Amazon). The bearing will ride on the inside of your box's recess, following it all the way around.
The width of the rabbet is determined by how much larger the diameter of the cutter is than the diameter of the bearing. The depth depends on how much you "plunge" the bit using the router's depth settings. Flip the router upside down with the rabbeting bit installed, and raise/lower the bit until the cutter is flush with a piece of your acrylic that's resting on the bottom of the router.