Need advice about which tool to choose?Ask the StackShare community!
RocksDB vs ToroDB: What are the differences?
RocksDB: Embeddable persistent key-value store for fast storage, developed and maintained by Facebook Database Engineering Team. RocksDB is an embeddable persistent key-value store for fast storage. RocksDB can also be the foundation for a client-server database but our current focus is on embedded workloads. RocksDB builds on LevelDB to be scalable to run on servers with many CPU cores, to efficiently use fast storage, to support IO-bound, in-memory and write-once workloads, and to be flexible to allow for innovation; ToroDB: Open source, document-oriented, JSON database that runs on top of PostgreSQL. ToroDB is an open source, document-oriented, JSON database that runs on top of PostgreSQL, providing storage and I/O savings and ACID semantics. ToroDB is MongoDB-compatible, so you can use Mongo clients to connect to it.
RocksDB and ToroDB belong to "Databases" category of the tech stack.
Some of the features offered by RocksDB are:
- Designed for application servers wanting to store up to a few terabytes of data on locally attached Flash drives or in RAM
- Optimized for storing small to medium size key-values on fast storage -- flash devices or in-memory
- Scales linearly with number of CPUs so that it works well on ARM processors
On the other hand, ToroDB provides the following key features:
- Document-oriented (JSON)
- Store data reliabily and durably with PostgreSQL
- Use MongoDB clients to connect to it
RocksDB and ToroDB are both open source tools. RocksDB with 14.3K GitHub stars and 3.12K forks on GitHub appears to be more popular than ToroDB with 10 GitHub stars and 2 GitHub forks.
I am researching different querying solutions to handle ~1 trillion records of data (in the realm of a petabyte). The data is mostly textual. I have identified a few options: Milvus, HBase, RocksDB, and Elasticsearch. I was wondering if there is a good way to compare the performance of these options (or if anyone has already done something like this). I want to be able to compare the speed of ingesting and querying textual data from these tools. Does anyone have information on this or know where I can find some? Thanks in advance!
You've probably come to a decision already but for those reading...here are some resources we put together to help people learn more about Milvus and other databases https://zilliz.com/comparison and https://github.com/zilliztech/VectorDBBench. I don't think they include RocksDB or HBase yet (you could could recommend on GitHub) but hopefully they help answer your Elastic Search questions.
Pros of RocksDB
- Very fast5
- Made by Facebook3
- Consistent performance2
- Ability to add logic to the database layer where needed1