I use Athena backend & Superset (an open source dashboard tool). Start by setting up Cost & Usage reports for all accounts into a centralized bucket in Parquet format, which makes it faster/cheaper to query in Athena. This is easy to set up, offers very good visualization tools, and is very flexible. This is a robust solution for very little cost.
> What do you want all those dev servers for anyway?
I think the best way to answer you is a little story:
Hope that explains things.
> I had a quick look at your code and am guessing you're trying to figure out how to scale something like flask.
Nope.
> So when you launch your flask app with gunicorn, the WSGI server handles creating and managing all the processes (whereas your shell script just launches hundreds).
Isnt the Python community scary? I remember the days when mod_perl
was all the rage. Now Pythonistas have their own web servers.
> Perhaps I've misunderstood the question, and you were just using Flask as an example of a process to run?
You did but thanks for your efforts. I've added a README that should clarify things.
Did you follow the instructions for Superset installation and initialization at the Installation & Configuration guide?
Have you looked at Apache Superset yet? I've only given it a quick look, but it might have some of the features you need, with both the ability to build dashboards and do some interactive analysis. It seems to be a little rough around the edges still, being an apache incubator project, but I find it interesting.
What do you guys think about Superset. It’s open source (initially made by AirBnB) and looks super slick.
Together with Presto on top of Cassandra or an efficient Postgres this should be a nice (cheap) alternative to any proprietary stack.
But that’s on paper. CMV :-)