Check out this recipe from McCormick's for Cinnamon Vanilla Coffee.
I have done it with other things too, using allspice, cloves, apple pie spice, pumpkin pie spice, and for the sweetener, adding maple syrup or honey to the filter basket instead of brown sugar. Why not? Just use your imagination and experiment until you achieve the right taste.
Today I used allspice and maple syrup, just put it in the basket with the coffee. I used probably about 1/2 tsp. of allspice and maybe 1/4 cup of maple syrup. It makes the whole pot all flavored and ready to drink. It tastes mild and sweet. It came out great. I never measure, just experiment with different combinations.
Don't bother with expensive coffees and/or creamers. Just try this!
I think this would work great with tea too!