I figured it out. Here's how I did it for those who may have the same problem:
Remove the door panel. This is pretty straight forward, and there are several DIY's available. Then remove the speaker. Stock speakers are riveted it, so I drilled them out with an 1/8th inch bit. Now the speaker will just pop out. I had to pry it with a small flathead and a bit of force. Now there is a hole big enough to reach my little hand up in there. There is a square nut on the back of all the bolts that secure the door hinges, and mine had come loose. I was able to grab the square nut in the door with a pliers, and tighten the bolt on the exterior with a ratchet and the appropriate triple square bit.
Currently, I reassembled the car by just placing the speaker back in there over the rivets with no heads. It is secured by the door card and speaker grill, but if I have any rattles I will hammer the rivets out all the way and replace them with screws and clips.