The trunk key hole has a manual lock/unlock mechanism.
It sounds like someone used the key prior to you buying the car and manually locked the trunk. You have to use the metal key and turn the keyhole so it will be in the unlocked position...
Using WD-40 like Slammed C said should do the trick to get your key inside the hole.