This app was mentioned in 4 comments, with an average of 2.50 upvotes
Mappit will do this
https://play.google.com/store/apps/details?id=com.osedok.gisdatacollector&hl=en_US
​
Hey /u/failuremode!
I'm a "GIS newbie" as well, but I think I could help you!
So what might work the best, is using your phone for your GPS unit. It's not extremely accurate, but will provide information accurate enough for pictures I believe.
Now, depending on what you use as a GIS (Esri, QGIS, or other), that's when things can get sticky.
If you have an android phone, I suggest Map It - GIS Data Collector. Using this application, this will allow you to create simple polygons, lines, and points with associated pictures in the field.
I've been told you can also use Collector for ArcGIS as well to attach field information including photos, but I have not had much experience with it outside of using it for field verification.
What you'll have to do is once these pictures are associated with vector points, you will have to host them onto an online server so they're accessible to your layer (I've used Dropbox before, but check around).
After they're into a dedicated server with a direct URL link, you should be good to go.
On ArcGIS Pro, I know you can format pop-ups whenever you click on a vector point. Here you will insert the image URL and that should be it. I believe the CSV (from Map It) kept the image source files, so you just information in the field.
I might be missing some steps, but I just did a relatively similar project during my internship about two months ago.
Let me know if this helped or if I can help anymore!
ANDROID Has several free or nearly free apps
https://mapitgis.com/ https://play.google.com/store/apps/details?id=com.osedok.gisdatacollector
https://spatial.mapitgis.com/ https://play.google.com/store/apps/details?id=com.mapitgis.spatial
SMASH is good and it's open source (it's FLUTTER cross platform)
https://github.com/geopaparazzi/smash
QFIELD is good but requires QGIS Project
Depends on the accuracy you require. Your phone and something like Mapit GIS would be a super cheap option.
https://play.google.com/store/apps/details?id=com.osedok.gisdatacollector&hl=en