ELK, splunk, graylog, and others. I’ve been playing around with Humio and it’s been fast as hell. Like others, they offer a free version but they will host it for you in the cloud https://www.humio.com/getting-started/community-edition/
Hey u/xCogito ! Im not sure how far you got with this but Humio's offering may be worth checking out. I am a technical marketing engineer for them and we have a free tier that gives you unlimited access to kick the tires.
​
You can find out more using the link below. Hope this helps!
Humio Community Edition
Whats going on u/Info_Broker_? My name is Key! Im a TME for Humio which is a Log Management tool that offers a free tier that could be helpful. This tier offers up to 16GB of ingestion per day and 7 day retention.
I would recommend kicking the tires! You can find out more details and sign up using the link below. If you need any additional help, feel free to connect.
​
Humio Community Edition
I wish someone had told me more about how to manage the abundance of log data that you have to go through. I have been searching for things and found some good resources to learn log management for those in the same boat as me. Here is one to check out that I am thinking about participating in to help me learn. Does anyone have any other recommendations?
https://www.humio.com/advanced-log-management-course-strategies-techniques-and-tactic
Meget! I bund og grund handler det faktisk om at gøre så lidt som muligt. Det de tidligere løsninger gør meget i, er at forsøge at indeksere dataen på kryds og tværs, men det er utroligt dyrt i tid og plads. Med Humio, så bliver dataen bare kategoriseret efter tid og et par andre ting, og så ellers komprimeret. Og når brugeren søger efter noget, så bliver alle logs inden for de rigtige kategorier bruteforced gennem.
Der står lidt mere om det her, hvis nogen er interesserede: https://www.humio.com/whats-new/blog/how-humios-index-free-log-management-searches-1pb-in-under-a-second
Out of curiosity, why are you looking for Rust-based alternatives? Is it because you want faster performance in a logging setup? Because performance-wise, the ELK stack is designed around indexed logging, which can really hamper performance. Full disclaimer, I work for Humio, which works on index-free logging, but not having an index is actually an advantage in the logging world; there you ingest data much more than you search it, compared to traditional databases (and Elastic Search) where you search your data more than you change it. So I don't think you're likely to see great gains in performance by switching to Rust-based ELK alternatives, if they are designed around the same principles (the performance divide is described in more detail here if you're interested).