Oh hardly. REUs would be useless otherwise. I got my first one (reading Yeh and Pedrotti^3 to study optical semiconductors) right after I finished Physics 3/diff eq. 1 out of Young and Freedman.
OP, apply for an REU. You probably won’t get it, but it’s a good start. Also, talk to your undergraduate research professors to see if they need any assistants.