RESEARCH

RESOURCES / RESEARCH

Helping Different Companies With Information Management

Edge Bare Metal Benchmark: Lumen vs AWS: An Exploration of Edge Cloud Services: From Bare Metal to Private Cloud

August 23, 2023

This report focuses on the latency of two top bare-metal server providers: Lumen Edge Cloud Services (Lumen) and Amazon Web Services (AWS). For our testing, we defined a high-performance model, mixing applications that can process 1,000 transactions per second and demand a maximum latency of 5ms or less, while the NGINX reverse proxy handles HTTP requests.

Contact us for the report.

Cloud Data Warehouse vs. Cloud Data Lakehouse: A Snowflake vs. Starburst TCO and Performance Comparison

August 23, 2023

Recently, several architectural patterns have emerged that decentralize most components of the enterprise analytics architecture. Data lakes are a large part of that advancement.

A field test was devised to determine the differences between two popular enterprise data architectural patterns: a modern cloud data warehouse based on a Snowflake architecture and a modern data lakehouse with a Starburst-based architecture. The test was created with multiple components to determine the differences in performance and capability, as well as the amount of time and effort required to migrate to these systems from a legacy environment.

Contact us for the report.

Digital Analytics and Measurement Tools Evaluation: Google Analytics 4 and Snowplow

August 23, 2023

We performed a field test to assess how Snowplow compares to GA4 for a retail organization that realizes the mandate for digital analytics. To make the test as fair as possible, we used both Google Analytics and Snowplow in vanilla e-commerce implementations. This means that for both solutions, we used the out-of-the-box e-commerce events.

Contact us for the report.

Video SDK Benchmark Comparison

August 23, 2023

This benchmark report provides insight into how well Zoom and Jitsi supports enterprise applications requiring real-time customer engagement. We capture time to value by assessing the steps involved in initial setup, scaled deployment, and production integration, and we assess TCO by evaluating both software and labor costs associated with a deployment. The benchmark can also be used to determine the implementation steps for each solution.

Contact us for the report.

Transaction Processing & Price-Performance Testing: Distributed SQL Databases Using Cloud Managed Services Evaluation: Azure Cosmos DB for PostgreSQL, CockroachDB Dedicated & YugabyteDB Managed

July 24, 2023

To evaluate distributed databases, we conducted a Transactional Field Test derived from the industry-standard TPC Benchmark™ C (TPC-C). We compared fully-managed as-a-service offerings of cloud-distributed databases:

  • Azure Cosmos DB for PostgreSQL
  • CockroachDB Dedicated
  • YugabyteDB Managed

Contact us for the report.

Cloud Analytics Top Data base Performance Testing report: Exasol outstrips Snowflake and another major cloud data warehouse for performance and price-performance

July 24, 2023

You should never have to sacrifice budget control to improve the performance of your analytics database.

Exasol’s no-compromise analytics database takes care of this for you, delivering significant productivity gains, cost-savings and flexibility, without any trade-offs. Don’t just take our word for it, read the latest report conducted by McKnight Consulting Group, on Cloud Analytics Database Performance testing against Exasol, Snowflake, and another major cloud data warehouse (April 2023).

The report proves that Exasol wins on:

  • Query response times:
    • 3.6x faster than Snowflake
    • 20x faster than the unnamed data warehouse
  • Price-performance:
    • Snowflake is nearly 17x more expensive than Exasol
    • Unnamed data warehouse is over 20x more expensive

Get the report here.

SQL Transaction Processing and Analytic Performance Price-Performance Testing: Microsoft SQL Server Evaluation: Azure vs. Amazon Web Services

May 22, 2023

This report outlines the results from two Field Tests (one transactional and the other analytic) derived from the industry-standard TPC Benchmark™ E (TPC-E) and TPC Benchmark™ H (TPC-H). The tests compare two IaaS cloud database offerings running Red Hat Enterprise Linux (RHEL), configured as follows:

  1. RHEL 8.6 with Microsoft SQL Server 2022 Enterprise on r6idn.8xlarge Amazon Web Services (AWS) Elastic Cloud Compute (EC2) instances with gp3 volumes.
  2. RHEL 8.6 with Microsoft SQL Server 2022 Enterprise on a E32bdsv5 Azure Virtual Machine (VM) with Premium SSD v2 disks.

Contact us for the report.

Total cost of ownership: NATS vs Kafka

May 22, 2023

A total cost of ownership (TCO) comparison against several real-world, and comparable workloads for NATS and Kafka for streaming. Users want to know if the “simplicity” is a trade-off vs functionality or performance.

Get the report here.

New Microsoft Teams Performance Benchmark

March 30, 2023

Microsoft Teams (Teams) is a collaboration platform that combines workplace chat, video meetings, file storage, and application integration. It is part of the Microsoft 365 suite of applications and is designed to help teams stay organized and connected. Teams allows users to communicate and collaborate in real-time, share files, and access applications from a single platform. As application performance is key to productivity, Teams has a regular cadence of releases focused on enhancements to functionality, performance, and ease of use.

This report benchmarks the performance differences between two versions of the Microsoft Teams desktop application for Windows: classic Teams (version 1.1, release June 2022) and new Teams (version 2.1, preview release March 2023). It showcases the improvements provided by new Teams by comparing the results of tests across three domains—installation behavior, application responsiveness, and resource utilization.

Contact us for the report.

Procurement Efficiency with the Microsoft Commercial Marketplace

March 30, 2023

In this benchmark, we set out to test the value of the marketplace.

We used the marketplace to buy and deploy three well-known products and contrasted that experience with buying each service separately. We selected a public cloud cost-saving solution provided as a service, an event streaming platform, and an application delivery solution frequently used for its load balancing and web firewall capabilities.

Contact us for the report.