I was concerned too so I dug around and found it. This is not from a public speech, it's from page 328 of Harry Belafonte's memoir "My Song". You can see it if you use the "Look inside" feature on amazon: https://www.amazon.com/My-Song-Memoir-Race-Defiance/dp/0307473422