I can't comment on the lore or rules (I really only know 40k), but GW sells several different starter kits and has a condensed version of the core AoS rules for free (known as the "Core Rules", as opposed to the full-length "Core Book").
The Storm Strike box comes with 2 teams of models, some dice, a ruler, a game mat, and a printed version of the condensed rules
They also sell a box called Tempest of Souls, which seems to be an upgraded version of the Storm Strike box. They have a bundle that includes a paint and tool set for 40$ more. It's a pretty good price if you don't have tools and paint already and don't live near a game shop where you can get them easily.
If you want to start smaller, they have the Stormcast Eternal and Nighthaunt starter sets which come with models for a single faction, paint for that faction, and a brush (but no clippers).
If you want to go all-out, the Soul Wars box set comes with 2 full armies, the full rule book, and various sundry other stuff. No paint or tools, though.
All of GW's stuff can be bought online, so not living near a store isn't an issue.
However you get models and rule, you'll need a set of clippers to remove models from their sprue, plastic glue to stick them together (unless you're using Push-fit models, which all but the Soul Wars box use), something to serve as a moldline remover (an exacto-knife will work fine), and paint (including something to prime your models with) and brushes. You don't need to buy GW's tools and paints if you don't want to.
Personally, I use Army Painter tools, Krylon to basecoat my models, and GW paints. However, plenty of people use other makers for their paint.