That's because your speaker has an integrated antenna, they're usually pretty crappy. You can try getting something like this, instead of buying a new speaker.
Balun One Nine v1 - Tiny Low-Cost 1:9 HF Antenna Balun and Unun with Antenna Input Protection for Ham It Up, RTL-SDR, HackRF and Other HF-Capable Radios. Great for DIY Dipole and Longwire Antennas