Some of the methods I have read about are supergluing a toothpick to your SIM card, but it looked way to easy to accidentally get some on the plastic around the tray so I didn't feel comfortable doing this. Needle nose pliers would have only been able to latch on if I pulled the phone apart and removed the SIM card tray. And the last one I came across was easing it out by pushing it with a paperclip, but there is no bottom access in the SIM holder tray.
So here is what I did.
Using a small thumbtack (or any small object with a sharp point) I applied enough pressure to jab into the SIM card a little bit through the little hole located on top of the SIM tray, this gave plenty of grip to move the SIM a millimetre at a time till the SIM card just popped out. No damage was done to my SIM tray using this method.
Hope this little guide helps others with the same problem I encountered.