Most of us start out just by getting certain things that tickle our fancy, and living with that for a year or two. With me, I started buying the candles and incense, which I got whenever I was lucky enough to be dragged by my brother to his favorite occult store. Candles and incense is how most of us start, it's cheap, incense smells nice, and candles are just cool.
Well candles mean certain things mattering on what the color is. No, doesn't matter on what kind, unless it's one of those xmas candles that are in the shape of Santa. Sorry those don't work. Though, the cheap candles that are only a certain color on the outside, where the inside is like say white, don't work that well either. It sort of mixes with the meaning.
Most occult stores carry tapers, and the glass candles, which are decently cheep unless you go to a bad store. I get large glass candles for about $1.35 or something, so don't let a place charge you $4 for one. Just find a different store. The occult stores also have the list of the meanings of each color posted so you can pick.