Logstash

Logstash

DevOps / Monitoring / Log Management
Needs advice
on
GolangGolangGrafanaGrafana
and
LogstashLogstash

Hi everyone. I'm trying to create my personal syslog monitoring.

  1. To get the logs, I have uncertainty to choose the way: 1.1 Use Logstash like a TCP server. 1.2 Implement a Go TCP server.

  2. To store and plot data. 2.1 Use Elasticsearch tools. 2.2 Use InfluxDB and Grafana.

I would like to know... Which is a cheaper and scalable solution?

Or even if there is a better way to do it.

READ MORE
10 upvotes·198.8K views
Replies (3)
Recommends
on
Grafana
Loki

Hi Juan

A very simple and cheap (resource usage) option here would be to use promtail to send syslog data to Loki and visualise Loki with Grafana using the native Grafana Loki data source. I have recently put together this set up and promtail and Loki are less resource intensive than Logstash/ES and it is a simple set up and configuration and works very nicely.

READ MORE
4 upvotes·2 comments·4.5K views
Sunil Chaudhari
Sunil Chaudhari
·
October 27th 2021 at 1:23AM

Hi,

Does promtel available for PCF?

·
Reply
Gary Wilson
Gary Wilson
·
October 27th 2021 at 1:38PM

Hi @sunilmchaudhari I do not know. I assume by PCF you are refering to Pivot Cloud Foundry, which I have no knowledge of sorry. Promtail is a go binary so if you can add log data to a syslog, then you can process it with Promtail.

·
Reply
Principal Software Architect at Breu Inc.·
Recommends
on
M3
Prometheus

Take a look at Prometheus or m3 as a storage engine.

READ MORE
3 upvotes·3.2K views
View all (3)
Needs advice
on
BugfenderBugfenderBugsnagBugsnag
and
CrashlyticsCrashlytics

I am also considering Logstash.

I want to add a remote debugging tool for my application, and my application is currently live in 10 countries. So, the scale is quite big. Can you help me choose the best client-side debugging tool? Also, are there any tools available in the market that provide 3rd party server integration too?

READ MORE
6 upvotes·131.6K views
Replies (2)
Recommends
on
Bugfender

Bugfender is mainly focused on getting the application logs, which is very useful for debugging and reproducing errors reported by users. Also has a "user feedback" option, that lets you get feedback from your users and get the application logs alongside it. Bugsnag and Crashlytics are more focused on "error analytics", mostly crashes, and they're more advanced in terms of analytics and detection of trends in crashes. I hope I helped! Disclaimer: I'm one of the founders of Bugfender.

READ MORE
6 upvotes·6.9K views
Management Advisor at artkonekt·
Recommends
on
Bugsnag
in

Bugsnag is one of my favorite tools. I must admit that I can't compare with the other two variants, because I only have experience with Sentry and Bugsnag. Both are fine, but I lean towards Bugsnag. With the help of Bugsnag I'm able to see quite clearly what went wrong, and it shows the affected users (and in my case even the tenant as we're operating a multi-tenant application).

Regarding Logstash: I've been using Bugsnag as a complementary tool with Logging + APM platforms like NewRelic or Datadog. What I mean is, go for Logstash if that's the log monitoring tool you like, but Bugsnag and Logstash are not interchangeable, and it perfectly makes sense to use both.

READ MORE
3 upvotes·4.1K views