Ok, seems like this is a issue with ubuntu as a whole, not only me. You will need to build pyaudio yourself, it's not hard.
Download this: http://www.portaudio.com/archives/pa_stable_v190600_20161030.tgz
Unpack it to any folder
cd yourself into the folder you unpacked it
./configure&&make
sudo make install
sudo pip install pyaudio --upgrade
Now get back to the cloned repository and do the python3 /install.py , you might want to do it with sudo