Whining when turning wheel

Whenever I turn my steering wheel I hear a sort-of high pitched whining sound. I'm not sure how else to explain it but the sound comes from what seems to be the inside of the car. I only hear it when my music isn't on but Its a little annoying. It happens when I turn the wheel both clockwise and counter-clockwise.

On a totally unrelated little side question, if my alternator belt was grooved or messed up somehow is it reasonable that it would make a very loud grinding/scraping noise every time I start the car? It sounds like that's where it's coming from.

that sir is your power steering pump.. check under the hood for the cap and check the fluid level in there... You might have a leak also!