You can do this stuff for free in R, it's open source, but the interface is a lot more like Linux than windows.
Then there is SPSS is made by IBM, its more like Windows - not as customizable, but works more easily and has a nicer GUI. Costs as much the down payment on a car though.