Amazon S3 vs dat

Overview

Amazon S3

Stacks55.1K

Followers40.2K

Votes2.0K

dat

Stacks118

Followers43

Votes0

Amazon S3 vs dat: What are the differences?

Key Differences between Amazon S3 and Dat

Centralized vs. Decentralized: Amazon S3 is a centralized storage service provided by Amazon Web Services, where users store their data in a single location managed by AWS. In contrast, Dat is a decentralized data sharing platform that allows users to sync their data across multiple devices and servers, without relying on a central authority for storage or access control.
Cost Structure: Amazon S3 charges users based on the amount of data stored, data transferred, and other resource usage metrics. In contrast, Dat is a peer-to-peer protocol that does not charge for storage or data transfer. Users only need to manage their own infrastructure costs for hosting Dat archives.
Access Control: Amazon S3 provides fine-grained access control mechanisms that allow users to define permissions at the bucket and object level, using AWS IAM policies. On the other hand, Dat uses cryptographic keys and permissions to control access to data, allowing users to securely share data with specific individuals or groups without relying on a centralized authentication system.
Data Consistency: Amazon S3 ensures strong consistency for all data operations within a region, meaning that all reads reflect the most recent write. Dat, being a decentralized platform, may experience eventual consistency in some cases, where updates may take time to propagate across all nodes in the network.
Integration with Ecosystem: Amazon S3 integrates seamlessly with other AWS services, such as Lambda, Athena, and EMR, allowing users to build complex data processing pipelines. Dat, being a standalone protocol, may require additional tools or libraries for integration with existing workflows and systems.
Community Support: Amazon S3 has a large community of users and developers who contribute to its ecosystem through forums, tutorials, and third-party applications. Dat, being a relatively newer platform, may have a smaller community but offers a collaborative and open-source development model for building decentralized applications and services.

In Summary, Amazon S3 provides centralized storage with strong consistency and extensive AWS integration, while Dat offers decentralized peer-to-peer data sharing with no cost structure, fine-grained access control, and potential eventual consistency.

Share your Stack

Help developers discover the tools you use. Get visibility for your team's tech choices and contribute to the community's knowledge.

View Docs

CLI (Node.js)

Manual

Advice on Amazon S3, dat

Mohammad

Aug 30, 2020

Needs adviceon

Backblaze B2 Cloud Storage

PHP

Laravel

Hello! I have a mobile app with nearly 100k MAU, and I want to add a cloud file storage service to my app.

My app will allow users to store their image, video, and audio files and retrieve them to their device when necessary.

I have already decided to use PHP & Laravel as my backend, and I use Contabo VPS. Now, I need an object storage service for my app, and my options are:

Amazon S3 : It sounds to me like the best option but the most expensive. Closest to my users (MENA Region) for other services, I will have to go to Europe. Not sure how important this is?
DigitalOcean Spaces : Seems like my best option for price/service, but I am still not sure
Wasabi: the best price (6 USD/MONTH/TB) and free bandwidth, but I am not sure if it fits my needs as I want to allow my users to preview audio and video files. They don't recommend their service for streaming videos.
Backblaze B2 Cloud Storage: Good price but not sure about them.
There is also the self-hosted s3 compatible option, but I am not sure about that.

Any thoughts will be helpful. Also, if you think I should post in a different sub, please tell me.

180k views180k

Comments

Gabriel

CEO at NaoLogic Inc

Dec 24, 2019

Decided

We offer our customer HIPAA compliant storage. After analyzing the market, we decided to go with Google Storage. The Nodejs API is ok, still not ES6 and can be very confusing to use. For each new customer, we created a different bucket so they can have individual data and not have to worry about data loss. After 1000+ customers we started seeing many problems with the creation of new buckets, with saving or retrieving a new file. Many false positive: the Promise returned ok, but in reality, it failed.

That's why we switched to S3 that just works.

330k views330k

Comments

Detailed Comparison

Amazon S3	dat
Amazon Simple Storage Service provides a fully redundant data storage infrastructure for storing and retrieving any amount of data, at any time, from anywhere on the web	Dat is an open source project that provides a streaming interface between every file format and data storage backend.
Write, read, and delete objects containing from 1 byte to 5 terabytes of data each. The number of objects you can store is unlimited.;Each object is stored in a bucket and retrieved via a unique, developer-assigned key.;A bucket can be stored in one of several Regions. You can choose a Region to optimize for latency, minimize costs, or address regulatory requirements. Amazon S3 is currently available in the US Standard, US West (Oregon), US West (Northern California), EU (Ireland), Asia Pacific (Singapore), Asia Pacific (Tokyo), Asia Pacific (Sydney), South America (Sao Paulo), and GovCloud (US) Regions. The US Standard Region automatically routes requests to facilities in Northern Virginia or the Pacific Northwest using network maps.;Objects stored in a Region never leave the Region unless you transfer them out. For example, objects stored in the EU (Ireland) Region never leave the EU.;Authentication mechanisms are provided to ensure that data is kept secure from unauthorized access. Objects can be made private or public, and rights can be granted to specific users.;Options for secure data upload/download and encryption of data at rest are provided for additional data protection.;Uses standards-based REST and SOAP interfaces designed to work with any Internet-development toolkit.;Built to be flexible so that protocol or functional layers can easily be added. The default download protocol is HTTP. A BitTorrent protocol interface is provided to lower costs for high-scale distribution.;Provides functionality to simplify manageability of data through its lifetime. Includes options for segregating data by buckets, monitoring and controlling spend, and automatically archiving data to even lower cost storage options. These options can be easily administered from the Amazon S3 Management Console.;Reliability backed with the Amazon S3 Service Level Agreement.	-
Statistics
Stacks 55.1K	Stacks 118
Followers 40.2K	Followers 43
Votes 2.0K	Votes 0
Pros & Cons
Pros 590 Reliable 492 Scalable 456 Cheap 329 Simple & easy 83 Many sdks Cons 7 Permissions take some time to get right 6 Takes time/work to organize buckets & folders properly 6 Requires a credit card 3 Complex to set up	No community feedback yet

What are some alternatives to Amazon S3, dat?

dbForge Studio for MySQL

It is the universal MySQL and MariaDB client for database management, administration and development. With the help of this intelligent MySQL client the work with data and code has become easier and more convenient. This tool provides utilities to compare, synchronize, and backup MySQL databases with scheduling, and gives possibility to analyze and report MySQL tables data.

dbForge Studio for Oracle

It is a powerful integrated development environment (IDE) which helps Oracle SQL developers to increase PL/SQL coding speed, provides versatile data editing tools for managing in-database and external data.

dbForge Studio for PostgreSQL

It is a GUI tool for database development and management. The IDE for PostgreSQL allows users to create, develop, and execute queries, edit and adjust the code to their requirements in a convenient and user-friendly interface.

dbForge Studio for SQL Server

It is a powerful IDE for SQL Server management, administration, development, data reporting and analysis. The tool will help SQL developers to manage databases, version-control database changes in popular source control systems, speed up routine tasks, as well, as to make complex database changes.

Amazon EBS

Amazon EBS volumes are network-attached, and persist independently from the life of an instance. Amazon EBS provides highly available, highly reliable, predictable storage volumes that can be attached to a running Amazon EC2 instance and exposed as a device within the instance. Amazon EBS is particularly suited for applications that require a database, file system, or access to raw block level storage.

Google Cloud Storage

Google Cloud Storage allows world-wide storing and retrieval of any amount of data and at any time. It provides a simple programming interface which enables developers to take advantage of Google's own reliable and fast networking infrastructure to perform data operations in a secure and cost effective manner. If expansion needs arise, developers can benefit from the scalability provided by Google's infrastructure.

Liquibase

Liquibase is th leading open-source tool for database schema change management. Liquibase helps teams track, version, and deploy database schema and logic changes so they can automate their database code process with their app code process.

Sequel Pro

Sequel Pro is a fast, easy-to-use Mac database management application for working with MySQL databases.

DBeaver

It is a free multi-platform database tool for developers, SQL programmers, database administrators and analysts. Supports all popular databases: MySQL, PostgreSQL, SQLite, Oracle, DB2, SQL Server, Sybase, Teradata, MongoDB, Cassandra, Redis, etc.

dbForge SQL Complete

It is an IntelliSense add-in for SQL Server Management Studio, designed to provide the fastest T-SQL query typing ever possible.

Related Comparisons

Amazon S3 vs dat: What are the differences?

Key Differences between Amazon S3 and Dat

Centralized vs. Decentralized: Amazon S3 is a centralized storage service provided by Amazon Web Services, where users store their data in a single location managed by AWS. In contrast, Dat is a decentralized data sharing platform that allows users to sync their data across multiple devices and servers, without relying on a central authority for storage or access control.
Cost Structure: Amazon S3 charges users based on the amount of data stored, data transferred, and other resource usage metrics. In contrast, Dat is a peer-to-peer protocol that does not charge for storage or data transfer. Users only need to manage their own infrastructure costs for hosting Dat archives.
Access Control: Amazon S3 provides fine-grained access control mechanisms that allow users to define permissions at the bucket and object level, using AWS IAM policies. On the other hand, Dat uses cryptographic keys and permissions to control access to data, allowing users to securely share data with specific individuals or groups without relying on a centralized authentication system.
Data Consistency: Amazon S3 ensures strong consistency for all data operations within a region, meaning that all reads reflect the most recent write. Dat, being a decentralized platform, may experience eventual consistency in some cases, where updates may take time to propagate across all nodes in the network.
Integration with Ecosystem: Amazon S3 integrates seamlessly with other AWS services, such as Lambda, Athena, and EMR, allowing users to build complex data processing pipelines. Dat, being a standalone protocol, may require additional tools or libraries for integration with existing workflows and systems.
Community Support: Amazon S3 has a large community of users and developers who contribute to its ecosystem through forums, tutorials, and third-party applications. Dat, being a relatively newer platform, may have a smaller community but offers a collaborative and open-source development model for building decentralized applications and services.

Amazon S3 vs dat

Overview