Neo4j

Hello Stackshare. I'm currently doing some research on real-time reporting and analytics architectures. We have a use case where 1million+ records of users, 4million+ activities, and messages that we want to report against. The start was to present it directly from MySQL, which didn't go well and puts a heavy load on the database. Anybody can suggest something where we feed the data and can report in realtime? Read some articles about ElasticSearch and Kafka https://medium.com/@D11Engg/building-scalable-real-time-analytics-alerting-and-anomaly-detection-architecture-at-dream11-e20edec91d33 EDIT: also considering Neo4j

We have an in-house build experiment management system. We produce samples as input to the next step, which then could produce 1 sample(1-1) and many samples (1 - many). There are many steps like this. So far, we are tracking genealogy (limited tracking) in the MySQL database, which is becoming hard to trace back to the original material or sample(I can give more details if required). So, we are considering a Graph database. I am requesting advice from the experts.

1. Is a graph database the right choice, or can we manage with RDBMS?
2. If RDBMS, which RDMS, which feature, or which approach could make this manageable or sustainable
3. If Graph database(Neo4j, OrientDB, Azure Cosmos DB, Amazon Neptune, ArangoDB), which one is good, and what are the best practices?

I am sorry that this might be a loaded question.

I want to build learning paths in a simple way and visualize them, the way Neo4j or D3.js do it. Example: I have a set of learning resources that can be connected depending on certain criteria. Thus, it would be possible for learners to start from various starting points and have learning paths depending on this starting point.

Following this, I need two things: first, a UI that lets me connect entries from a database so that a linear view, like a path, comes out. And second, a bird's eye view on the various paths like a force-directed graph that stems from the linear connections I made.

I use Neo4j because i find it to be a superior way to store and query highly relational data. The new spatial functionality has made it even more useful.

Also, the APOC library adds a large number of extremely powerful features to the database. I know many people are purists about logic in databases but things like guid/uuid generation, geocoding, and distance algorithms are all extremely useful in the data storage context.

I use Neo4j because the data structure was a graph, based on the underlying research papert, so the project had to follow this concept. However, the research project doesn't take the full potential of Neo4j or an other graph database, because it doesn't apply any graph related algorithms. So the whole architecture could have been also modelled in a simple relational way (PostgreSQL/MySQL/etc.). However, Neo4j with its very easy to learn query language Cypher was in the end a very good choice, because other researchers were able to set up a new testing scenario also on the database level with much flexibility.

Node.js MySQL Neo4j ES6 PHP #chrome_extension ExpressJS sometimes ( read toy projects ) React and Vue