This may seem like a dumb question, but do you say anyways with a s or anyway without a s?

Also, if you'd like to answer an additional question, most likely getting 10 extra points, would you say with a s, or with an s? I know an is used before words starting with vowels, but are there exceptions?