Open Source Insider

Jun 1 2015   4:10PM GMT

Yahoo! cloud benchmark ‘scalability leadership’ for MongoDB

Adrian Bridgwater Adrian Bridgwater Profile: Adrian Bridgwater

Tags:
Cassandra
Couchbase
MongoDB

The Yahoo! Cloud Serving Benchmark (YCSB) has ‘determined’ (by its own measure) that MongoDB provides greater scalability than Cassandra and Couchbase in all tests, by as much as 13x.

This suggestion, or determination if you give this benchmark full credence, was provided by independent benchmarking and performance testing organisation United Software Associates.

The firm now suggests that MongoDB provides “more predictable scaling” than what has been somewhat disparagingly called ‘niche NoSQL alternatives’ including those named above here.

No need for modesty?

The report proposes that MongoDB “overwhelmingly outperforms” Cassandra and Couchbase in the following kinds of deployments:

• where the data size exceeds that of RAM,

• where data is partitioned across multiple servers and,

• where data is replicated for high availability.

“While performance is important, it must be considered along with many different criteria when evaluating database technology,” warns Sam Bhat, CEO of United Software Associates.

“The goal of this report is to take a closer look at scalability, another critical factor used to determine the right database technology for a project. MongoDB proved to have the best and most predictable scalability, better than either of the niche NoSQL products,” he said.

The following results are based on evaluation of two workloads using YCSB: Workload A, an equal mix of reads and updates, and Workload B, which consists of 95% reads and 5% updates.

All tests were performed with 400M records distributed across three servers, which represents a data set larger than RAM. Each test performs 100M operations and records throughput and latencies at the 95th and 99th percentiles for reads and updates separately.

According to a press statement focused on this news, “In the 50/50 workload, MongoDB provides over 1.8x greater throughput than Cassandra, and nearly 13x greater throughput than Couchbase.”

Don’t just take our word for it

“We encourage readers to use our findings as one of many inputs to their own evaluations and to thoroughly test a range of database functionality that fits their application,” said Bhat.

NOTE: The latest versions of each product were used: Couchbase 3.0.2, Cassandra 2.12 and MongoDB 3.0.1 with WiredTiger. In all tests, the best practices for each product were followed and multiple rounds of tests were run to determine the optimal number of threads and best performance for each product.

1 Mongoqwpdjoqowihf.png

1  Comment on this Post

 
There was an error processing your information. Please try again later.
Thanks. We'll let you know when a new response is added.
Send me notifications when other members comment.
  • Shane Johnson
    Couchbase Comment: MongoDB published another benchmark performed by United Software Associates. We believe that benchmarks are a useful tool to evaluate database performance. But to be useful, it must be transparent and repeatable. If it fails to meet these standards, the results are questionable. In recent benchmarks, Couchbase and MongoDB took two different approaches. Couchbase clearly documented the full configuration and the results of every test. MongoDB did not. For more information on our performance benchmarks, please visit the Couchbase Blog: http://blog.couchbase.com/mongodb-is-special-benchmarks-prove-it
    0 pointsBadges:
    report

Forgot Password

No problem! Submit your e-mail address below. We'll send you an e-mail containing your password.

Your password has been sent to:

Share this item with your network: