Try to get a copy of one of those spam emails sent from your account and inspect the headers. Someone could be making it seem as if the email were coming from your address (that's pretty easy to fake), this is called
email spoofing. In this case, you shouldn't be worried about your account being compromised, and there's not much you can do about it.