Need advice about which tool to choose?Ask the StackShare community!
New Relic vs Runscope: What are the differences?
<New Relic vs Runscope>
1. **Monitoring Capabilities**: New Relic is primarily focused on application performance monitoring providing insights into application health, while Runscope is more focused on API testing and monitoring, enabling users to validate API functionality and performance.
2. **Integration Options**: New Relic offers integration with a wide range of programming languages, frameworks, and services to provide comprehensive monitoring capabilities, whereas Runscope offers integrations specifically tailored to API monitoring tools and platforms.
3. **Alerting and Notification**: New Relic provides customizable alerting features that notify users when certain thresholds are met, enabling quick responses to issues, while Runscope offers similar alerting capabilities but with a focus on API performance metrics.
4. **Collaboration and Team Management**: Runscope provides more robust collaboration features, allowing team members to share and work together on API tests and results, whereas New Relic focuses more on individual monitoring and analysis.
5. **Price Structure**: New Relic typically charges based on the number of hosts or containers being monitored, while Runscope's pricing is based on the number of API calls being monitored, catering to different monitoring needs and budgets.
6. **Focus on DevOps Teams**: Runscope is designed with a stronger focus on DevOps teams, providing features that cater to the needs of developers and operations professionals working closely together, while New Relic caters to a broader range of users including developers, IT operations, and business stakeholders.
In Summary, New Relic and Runscope differ in their focus on application performance monitoring vs API testing, integrations, alerting capabilities, collaboration tools, pricing structures, and target user audience.
We are looking for a centralised monitoring solution for our application deployed on Amazon EKS. We would like to monitor using metrics from Kubernetes, AWS services (NeptuneDB, AWS Elastic Load Balancing (ELB), Amazon EBS, Amazon S3, etc) and application microservice's custom metrics.
We are expected to use around 80 microservices (not replicas). I think a total of 200-250 microservices will be there in the system with 10-12 slave nodes.
We tried Prometheus but it looks like maintenance is a big issue. We need to manage scaling, maintaining the storage, and dealing with multiple exporters and Grafana. I felt this itself needs few dedicated resources (at least 2-3 people) to manage. Not sure if I am thinking in the correct direction. Please confirm.
You mentioned Datadog and Sysdig charges per host. Does it charge per slave node?
Can't say anything to Sysdig. I clearly prefer Datadog as
- they provide plenty of easy to "switch-on" plugins for various technologies (incl. most of AWS)
- easy to code (python) agent plugins / api for own metrics
- brillant dashboarding / alarms with many customization options
- pricing is OK, there are cheaper options for specific use cases but if you want superior dashboarding / alarms I haven't seen a good competitor (despite your own Prometheus / Grafana / Kibana dog food)
IMHO NewRelic is "promising since years" ;) good ideas but bad integration between their products. Their Dashboard query language is really nice but lacks critical functions like multiple data sets or advanced calculations. Needless to say you get all of that with Datadog.
Need help setting up a monitoring / logging / alarm infrastructure? Send me a message!
Hi Medeti,
you are right. Building based on your stack something with open source is heavy lifting. A lot of people I know start with such a set-up, but quickly run into frustration as they need to dedicated their best people to build a monitoring which is doing the job in a professional way.
As you are microservice focussed and are looking for 'low implementation and maintenance effort', you might want to have a look at INSTANA, which was built with modern tool stacks in mind. https://www.instana.com/apm-for-microservices/
We have a public sand-box available if you just want to have a look at the product once and of course also a free-trial: https://www.instana.com/getting-started-with-apm/
Let me know if you need anything on top.
I have hands on production experience both with New Relic and Datadog. I personally prefer Datadog over NewRelic because of the UI, the Documentation and the overall user/developer experience.
NewRelic however, can do basically the same things as Datadog can, and some of the features like alerting have been present in NewRelic for longer than in Datadog. The cool thing about NewRelic is their last-summer-updated pricing: you no longer pay per host but after data you send towards New Relic. This can be a huge cost saver depending on your particular setup
I'd go for Datadog, but given you have lots of containers I would also make a cost calculation. If the price difference is significant and there's a budget constraint NewRelic might be the better choice.
I haven't heard much about Datadog until about a year ago. Ironically, the NewRelic sales person who I had a series of trainings with was trash talking about Datadog a lot. That drew my attention to Datadog and I gave it a try at another client project where we needed log handling, dashboards and alerting.
In 2019, Datadog was already offering log management and from that perspective, it was ahead of NewRelic. Other than that, from my perspective, the two tools are offering a very-very similar set of tools. Therefore I wouldn't say there's a significant difference between the two, the decision is likely a matter of taste. The pricing is also very similar.
The reasons why we chose Datadog over NewRelic were:
- The presence of log handling feature (since then, logging is GA at NewRelic as well since falls 2019).
- The setup was easier even though I already had experience with NewRelic, including participation in NewRelic trainings.
- The UI of Datadog is more compact and my experience is smoother.
- The NewRelic UI is very fragmented and New Relic One is just increasing this experience for me.
- The log feature of Datadog is very well designed, I find very useful the tagging logs with services. The log filtering is also very awesome.
Bottom line is that both tools are great and it makes sense to discover both and making the decision based on your use case. In our case, Datadog was the clear winner due to its UI, ease of setup and the awesome logging and alerting features.
I chose Datadog APM because the much better APM insights it provides (flamegraph, percentiles by default).
The drawbacks of this decision are we had to move our production monitoring to TimescaleDB + Telegraf instead of NR Insight
NewRelic is definitely easier when starting out. Agent is only a lib and doesn't require a daemon
Pros of New Relic
- Easy setup415
- Really powerful344
- Awesome visualization245
- Ease of use194
- Great ui151
- Free tier106
- Great tool for insights80
- Heroku Integration66
- Market leader55
- Peace of mind49
- Push notifications21
- Email notifications20
- Heroku Add-on17
- Error Detection and Alerting16
- Multiple language support13
- SQL Analysis11
- Server Resources Monitoring11
- Transaction Tracing9
- Apdex Scores8
- Azure Add-on8
- Analysis of CPU, Disk, Memory, and Network7
- Detailed reports7
- Performance of External Services6
- Error Analysis6
- Application Availability Monitoring and Alerting6
- Application Response Times6
- Most Time Consuming Transactions5
- JVM Performance Analyzer (Java)5
- Browser Transaction Tracing4
- Top Database Operations4
- Easy to use4
- Application Map3
- Weekly Performance Email3
- Pagoda Box integration3
- Custom Dashboards3
- Easy to setup2
- Background Jobs Transaction Analysis2
- App Speed Index2
- Super Expensive1
- Team Collaboration Tools1
- Metric Data Retention1
- Metric Data Resolution1
- Worst Transactions by User Dissatisfaction1
- Real User Monitoring Overview1
- Real User Monitoring Analysis and Breakdown1
- Time Comparisons1
- Access to Performance Data API1
- Incident Detection and Alerting1
- Best of the best, what more can you ask for1
- Best monitoring on the market1
- Rails integration1
- Free1
- Proce0
- Price0
- Exceptions0
- Cost0
Pros of Runscope
- Great features17
- Easy to use15
- Nicely priced4
- Free plan4
- No install needed - runs on cloud2
- Decent2
- Collections1
- Dead simple and useful. Excellent1
- Awesome customer support1
- Import scripts from sources including Postman1
- Shareable Collections1
- Global & Collection level variables1
- Graphical view of response times historically1
- Integrations - StatusPage, PagerDuty, HipChat, Victorop1
- Run tests from multiple locations across globe1
- Schedule test collections to auto-run at intervals1
- Auto Re-run failed scheduled tests before notifying1
- Makes developing REST APIs easy1
- History feature - call history and response history1
- Restrict access by teams1
- Fully featured without looking cluttered1
- Can save and share scripts1
Sign up to add or upvote prosMake informed product decisions
Cons of New Relic
- Pricing model doesn't suit microservices20
- UI isn't great10
- Expensive7
- Visualizations aren't very helpful7
- Hard to understand why things in your app are breaking5