Store and process terabytes of data each hour from hundreds of thousands of sources