Need advice about which tool to choose?Ask the StackShare community!

osquery

28
61
+ 1
0
Prometheus

4.3K
3.8K
+ 1
239
Add tool

Prometheus vs osquery: What are the differences?

Key Differences between Prometheus and osquery

1. Data Collection and Monitoring Capabilities: Prometheus is primarily designed for monitoring and alerting in a time-series manner, collecting data via pull-based model where clients periodically scrape metrics from service endpoints. On the other hand, osquery is an agent-based tool that enables querying of the underlying operating system, collecting information about system configuration, security settings, and other operational data.

2. Purpose and Scope: Prometheus is specifically built for monitoring distributed systems and microservices, providing robust support for metrics, alerts, and recording rules. In contrast, osquery is more focused on providing visibility and monitoring of individual hosts or machines, allowing detailed querying capabilities for system-level information and threat hunting.

3. Use Case and Flexibility: Prometheus excels in monitoring dynamic environments with auto-discovery capabilities, making it well-suited for cloud-native applications and containerized infrastructures. It offers extensive support for scaling and handling high cardinality data. Conversely, osquery's strength lies in its ability to inspect and monitor a wide range of system attributes across different operating systems, making it more adaptable to varied host-based use cases.

4. Query Language and Data Models: Prometheus Query Language (PromQL) is specifically tailored for time-series data, allowing aggregation, filtering, and transformation of metrics over time. It provides functions to analyze and visualize data for monitoring purposes. In contrast, osquery employs SQL-like syntax with a schema, enabling users to query the system state and log data efficiently, facilitating security investigations and operational insights.

5. Ecosystem and Integrations: Prometheus has a vast ecosystem, with numerous exporters, dashboards, and alerting solutions available, making it easy to integrate with different frameworks and platforms. It also supports exporters that collect data from third-party systems. On the contrary, osquery offers a smaller but growing ecosystem of extensions and integrations, primarily focusing on security-related tools and use cases.

6. Operational Overhead and Resource Consumption: Prometheus requires dedicated resources for data storage and retention, as it keeps a compact, on-disk, and efficient time-series database. It also requires periodic maintenance and management for data compaction and purging. Conversely, osquery's resource consumption is comparatively lower, as it leverages system resources for data collection and presents a smaller operational footprint.

In summary, Prometheus is a powerful monitoring tool designed for time-series data collection in dynamic environments, while osquery specializes in querying and monitoring the state of individual hosts across different operating systems, offering extensive visibility and threat-hunting capabilities.

Advice on osquery and Prometheus
Susmita Meher
Senior SRE at African Bank · | 4 upvotes · 828.5K views
Needs advice
on
GrafanaGrafanaGraphiteGraphite
and
PrometheusPrometheus

Looking for a tool which can be used for mainly dashboard purposes, but here are the main requirements:

  • Must be able to get custom data from AS400,
  • Able to display automation test results,
  • System monitoring / Nginx API,
  • Able to get data from 3rd parties DB.

Grafana is almost solving all the problems, except AS400 and no database to get automation test results.

See more
Replies (1)
Sakti Behera
Technical Specialist, Software Engineering at AT&T · | 3 upvotes · 614.1K views
Recommends
on
GrafanaGrafanaPrometheusPrometheus

You can look out for Prometheus Instrumentation (https://prometheus.io/docs/practices/instrumentation/) Client Library available in various languages https://prometheus.io/docs/instrumenting/clientlibs/ to create the custom metric you need for AS4000 and then Grafana can query the newly instrumented metric to show on the dashboard.

See more
Sunil Chaudhari
Needs advice
on
MetricbeatMetricbeat
and
PrometheusPrometheus

Hi, We have a situation, where we are using Prometheus to get system metrics from PCF (Pivotal Cloud Foundry) platform. We send that as time-series data to Cortex via a Prometheus server and built a dashboard using Grafana. There is another pipeline where we need to read metrics from a Linux server using Metricbeat, CPU, memory, and Disk. That will be sent to Elasticsearch and Grafana will pull and show the data in a dashboard.

Is it OK to use Metricbeat for Linux server or can we use Prometheus?

What is the difference in system metrics sent by Metricbeat and Prometheus node exporters?

Regards, Sunil.

See more
Replies (2)
Matthew Rothstein
Recommends
on
PrometheusPrometheus

If you're already using Prometheus for your system metrics, then it seems like standing up Elasticsearch just for Linux host monitoring is excessive. The node_exporter is probably sufficient if you'e looking for standard system metrics.

Another thing to consider is that Metricbeat / ELK use a push model for metrics delivery, whereas Prometheus pulls metrics from each node it is monitoring. Depending on how you manage your network security, opting for one solution over two may make things simpler.

See more
Recommends
on
InstanaInstana

Hi Sunil! Unfortunately, I don´t have much experience with Metricbeat so I can´t advise on the diffs with Prometheus...for Linux server, I encourage you to use Prometheus node exporter and for PCF, I would recommend using the instana tile (https://www.instana.com/supported-technologies/pivotal-cloud-foundry/). Let me know if you have further questions! Regards Jose

See more
Mat Jovanovic
Head of Cloud at Mats Cloud · | 3 upvotes · 756.4K views
Needs advice
on
DatadogDatadogGrafanaGrafana
and
PrometheusPrometheus

We're looking for a Monitoring and Logging tool. It has to support AWS (mostly 100% serverless, Lambdas, SNS, SQS, API GW, CloudFront, Autora, etc.), as well as Azure and GCP (for now mostly used as pure IaaS, with a lot of cognitive services, and mostly managed DB). Hopefully, something not as expensive as Datadog or New relic, as our SRE team could support the tool inhouse. At the moment, we primarily use CloudWatch for AWS and Pandora for most on-prem.

See more
Replies (2)
Recommends
on
DatadogDatadog

I worked with Datadog at least one year and my position is that commercial tools like Datadog are the best option to consolidate and analyze your metrics. Obviously, if you can't pay the tool, the best free options are the mix of Prometheus with their Alert Manager and Grafana to visualize (that are complementary not substitutable). But I think that no use a good tool it's finally more expensive that use a not really good implementation of free tools and you will pay also to maintain its.

See more
Lucas Rincon
Recommends
on
InstanaInstana

this is quite affordable and provides what you seem to be looking for. you can see a whole thing about the APM space here https://www.apmexperts.com/observability/ranking-the-observability-offerings/

See more
Manage your open source components, licenses, and vulnerabilities
Learn More
Pros of osquery
Pros of Prometheus
    Be the first to leave a pro
    • 47
      Powerful easy to use monitoring
    • 38
      Flexible query language
    • 32
      Dimensional data model
    • 27
      Alerts
    • 23
      Active and responsive community
    • 22
      Extensive integrations
    • 19
      Easy to setup
    • 12
      Beautiful Model and Query language
    • 7
      Easy to extend
    • 6
      Nice
    • 3
      Written in Go
    • 2
      Good for experimentation
    • 1
      Easy for monitoring

    Sign up to add or upvote prosMake informed product decisions

    Cons of osquery
    Cons of Prometheus
      Be the first to leave a con
      • 12
        Just for metrics
      • 6
        Bad UI
      • 6
        Needs monitoring to access metrics endpoints
      • 4
        Not easy to configure and use
      • 3
        Supports only active agents
      • 2
        Written in Go
      • 2
        TLS is quite difficult to understand
      • 2
        Requires multiple applications and tools
      • 1
        Single point of failure

      Sign up to add or upvote consMake informed product decisions

      - No public GitHub repository available -

      What is osquery?

      osquery exposes an operating system as a high-performance relational database. This allows you to write SQL-based queries to explore operating system data. With osquery, SQL tables represent abstract concepts such as running processes, loaded kernel modules, open network connections, browser plugins, hardware events or file hashes.

      What is Prometheus?

      Prometheus is a systems and service monitoring system. It collects metrics from configured targets at given intervals, evaluates rule expressions, displays the results, and can trigger alerts if some condition is observed to be true.

      Need advice about which tool to choose?Ask the StackShare community!

      What companies use osquery?
      What companies use Prometheus?
      Manage your open source components, licenses, and vulnerabilities
      Learn More

      Sign up to get full access to all the companiesMake informed product decisions

      What tools integrate with osquery?
      What tools integrate with Prometheus?
        No integrations found

        Sign up to get full access to all the tool integrationsMake informed product decisions

        Blog Posts

        Dec 8 2020 at 5:50PM

        DigitalOcean

        GitHubMySQLPostgreSQL+11
        2
        2438
        May 21 2020 at 12:02AM

        Rancher Labs

        KubernetesAmazon EC2Grafana+12
        5
        1529
        PythonDockerKubernetes+14
        12
        2651
        Node.jsnpmKubernetes+6
        1
        1481
        What are some alternatives to osquery and Prometheus?
        Ossec
        It is a free, open-source host-based intrusion detection system. It performs log analysis, integrity checking, registry monitoring, rootkit detection, time-based alerting, and active response.
        ELK
        It is the acronym for three open source projects: Elasticsearch, Logstash, and Kibana. Elasticsearch is a search and analytics engine. Logstash is a server‑side data processing pipeline that ingests data from multiple sources simultaneously, transforms it, and then sends it to a "stash" like Elasticsearch. Kibana lets users visualize data with charts and graphs in Elasticsearch.
        Wazuh
        It is a free, open source and enterprise-ready security monitoring solution for threat detection, integrity monitoring, incident response and compliance.
        Sysdig
        Sysdig is open source, system-level exploration: capture system state and activity from a running Linux instance, then save, filter and analyze. Sysdig is scriptable in Lua and includes a command line interface and a powerful interactive UI, csysdig, that runs in your terminal. Think of sysdig as strace + tcpdump + htop + iftop + lsof + awesome sauce. With state of the art container visibility on top.
        Ansible
        Ansible is an IT automation tool. It can configure systems, deploy software, and orchestrate more advanced IT tasks such as continuous deployments or zero downtime rolling updates. Ansible’s goals are foremost those of simplicity and maximum ease of use.
        See all alternatives