Click the button below to skip over all of the silly parts, aka our carefully collected, scientific research that took valuable hours to collate and document. Seriously, it won’t hurt our feelings. At all.
Why (you might ask) is website speed soooo important? Here’s our take:
When a website takes a while to load (say more than 2-3 seconds) outside of it being generally annoying, it can cost you money, search rankings, bounce rates and just plain likability. Studies have shown that website speed is a ‘confirmed Google ranking factor’ (look it up, it’s science). Visitors these days don’t have all day, so if your site takes a while to load, they are likely to lose patience and pop to the next site – costing you coveted conversions. And no one wants that.
Why did we pick these hosts?
We picked four hosts that were very similar to Frankie Dog Hosting.
- Similar price. Frankie Dog Hosting costs $30 a month (month-to-month). So do all the others – except for Flywheel which is $15 (…but there may be a reason for this as you’ll see later).
- Similar infrastructure. Frankie Dog Hosting uses containerized hosting. If you do not know what this is…uh…google it. Basically, it’s a new, better way to host websites. You get the idea.
- Our services are similar – not the exact same – but similar.
Now, onto the methodology! Aww yeah!
Testing Overview
Using two WordPress images, we performed a series of five speed and stability tests. These being:
- TTFB (Time to First Byte)
- Best of 3
- Average of 3
- DOM Content Loaded
- Best of 5
- Average of 5
- Max Parallel Clients
- Load Test
- Soak Test
The definition and results of each test are outlined below.
Scoring & Ranking
Our goal was to rank each host against one another. Within each test, hosts were ranked on their performance, or given a rank between 1 and 5. Using pairwise ranking, 1st place awarded 5 points, 2nd place awarded 4 points, etc.
Pairwise Scoring Outline
5 participants:
- First Place = 5
- Second Place = 4
- Third Place = 3
- Fourth Place = 2
- Fifth Place = 1
WordPress Images
We tested two versions of a WordPress site. One, the current, standard install or image – basically what you get when you install WordPress for the first time. Although the site looks pretty empty, it’s still running the all important WordPress processes in the background. Our second WordPress image was a small, one-page site with a couple images and paragraphs of text, running the Salient Theme and it’s required plugins. See the WordPress images section for a brief, visual overview of each site.
Test A: Standard WordPress Image
April 20, 2021
- WordPress 5.7
- Theme Twenty Twenty-One version 1.2
- No Plugins
Test B: Custom WordPress Image
April 22, 2021
- WordPress 5.7.1
- Theme Salient 13.05
- Plugins
- Defender Pro
- Salient Core
- Salient Demo Importer
- Salient Home Slider
- Salient Nectar Slider
- Salient Portfolio
- Salient Shortcodes
- Salient Social
- Salient Widgets
- Salient WPBakery Page Builder
- Smush Pro
- WPMU DEV Dashboard
Test #1: TTFB (Time to First Byte)
Tests
- TTFB – Best of 3
- TTFB – Average of 3
Testing Site:
Definition:
TTFB measures the duration from the user or client making an HTTP request to the first byte of the page being received by the client’s browser. This time is made up of the socket connection time, the time taken to send the HTTP request, and the time taken to get the first byte of the page. Although sometimes misunderstood as a post-DNS calculation, the original calculation of TTFB in networking always includes network latency in measuring the time it takes for a resource to begin loading.Often, a smaller (faster) TTFB size is seen as a benchmark of a well-configured server application. For example, a lower time to first byte could point to fewer dynamic calculations being performed by the webserver, although this is often due to caching at either the DNS, server, or application level. More commonly, a very low TTFB is observed with statically served web pages, while larger TTFB is often seen with larger, dynamic data requests being pulled from a database. Source: https://en.wikipedia.org/wiki/Time_to_first_byte
TTFB Example
TTFB Best Chart
In this test, each site was measured using the TTFB three times. This result represents the single fastest time from all three tests.
Winner: Frankie Dog Hosting!
TTFB Average Chart
In this test, each site was measured using the TTFB three times. This result represents the averaged total response times of all locations.
Winner: WP Engine!
Test #2: DOM Content Loaded
Tests
- DOM Content Loaded – Best of 5
- DOM Content Loaded – Average of 5
Definition
The DOMContentLoaded event is fired when the initial HTML document has been completely loaded and parsed, without waiting for stylesheets, images, and subframes to finish loading. A very different event load should be used only to detect a fully-loaded page. It is an incredibly common mistake to use load where DOMContentLoaded would be much more appropriate, so be cautious. Source: https://developer.mozilla.org/en-US/docs/Web/API/Document/DOMContentLoaded_event
DOM Content Loaded Example
DOM Content Loaded Best Chart
Winner: Frankie Dog Hosting!
DOM Content Loaded Average Chart
Winner: Frankie Dog Hosting!
Test #3: Max Parallel Clients (Until Failure, Maximum 250)
Tests
- 1 – 250 client load over 1 min period, or until 50% failure rate.
Testing Site
Definition
Server performance over a 1 minute period, when there is a constant build of 1 to 250 clients.
In computer science, the number of concurrent users (sometimes abbreviated CCU) for a resource in a location, with the location being a computing network or a single computer, refers to the total number of people simultaneously accessing or using the resource. The resource can, for example, be a computer program, a file, or the computer as a whole. Source: https://en.wikipedia.org/wiki/Concurrent_user
From WPMUDEV: Here’s a good analogy we like to use: “If you prefer to have a bar serving beer to 10 clients and then closing it down because the 11th started a fire, fine by us.” “We’d prefer a bar that serves 140 people in a timely manner. Even if it is a tad slower.”
Max Parallel Clients Example
Max Parallel Clients Chart
Winner: GoDaddy!
Test #4: Load
Testing Site
Definition
Load Testing is a type of Performance Testing used to determine a system’s behavior under both normal and peak conditions. Load Testing is used to ensure that the application performs satisfactorily when many users access it at the same time. Source: https://k6.io/docs/test-types/load-testing/
Load Chart
Winner: WP Engine!
Test #5: Soak
Testing Site
Definition
While load testing is primarily concerned with performance assessment, and stress testing is concerned with system stability under extreme conditions, soak testing is concerned with reliability over a long time. The soak test uncovers performance and reliability issues stemming from a system being under pressure for an extended period. Reliability issues typically relate to bugs, memory leaks, insufficient storage quotas, incorrect configuration or infrastructure failures. Performance issues typically relate to incorrect database tuning, memory leaks, resource leaks or a large amount of data. With soak test you can simulate days worth of traffic in only a few hours. Source: https://k6.io/docs/test-types/soak-testing/
Soak Chart
Winner: WP Engine!
Overall Test Rankings
Winner: Frankie Dog Hosting
Overview
And the winner is…(bap-ba-da-da)… Frankie Dog Hosting. We did not plan this.
Frankie Dog Hosting Places
- TTFB Best, Second Place
- TTFB Average, Winner
- DOM Content Loaded Best, Winner
- DOM Content Loaded Average, Winner
- Max Parallel Clients, Third Place
- Load, Third Place
- Soak, Fourth Place
Conclusion
How is Frankie So Fast!?!
Although a relative newcomer to WordPress hosting, it’s our newness that gives us an added benefit. Our infrastructure and service providers (specifically Amazon Web Servers) put the get up and go into Frankie’s blazing fast response times. The AWS infrastructure is not only newer, but (more importantly) it’s bigger and faster. It’s also our duty to remind all of our visitors that Frankie Dog has No Caching and No CDN (or content delivery network).
Possible Hosts for Next Round of Testing:
- Cloudways
- WPX
- WPMUDEV
- A2 Hosting
- Dreamhost
- Pantheon
- Convisio