This app was mentioned in 6 comments, with an average of 1.33 upvotes
related resources: https://www.reddit.com/r/raspberry_pi/comments/4bb3im/figured_out_how_to_get_bluetooth_controllers_to/
hmmm... linux support: https://play.google.com/store/apps/details?id=com.allinoneremote
https://play.google.com/store/apps/details?id=com.allinoneremote -> like browse and double click
You will have to use an app that connects via bluetooth or wifi. Try this one for example: https://play.google.com/store/apps/details?id=com.allinoneremote
AIO Remote might work for you.