Thanks to a great post from Ed Bott on ZDNet I just learned that Soluto’s announcement of its new Soluto for Business subscription/service was also accompanied by a very interesting report on April 24 as well. Entitled “Soluto’s PC Purchasing Guide for Small Businesses” (and its subtitle: “Monthly Report, April 2013” and URL suggest we’ll be seeing more of this kind of data possibly on a monthly or quarterly basis), this report crunches data from what the company calls “long term, ongoing analysis of a huge number of PCs, taking into account events such as application crashes, application hangs, blue-screens-of-death, long boot times and excessive number of background processes.”
Soluto finally starts to share some results from its massive PC stability and performance monitoring of its large current user community.
In reporting on the top 10 PCs, Soluto incorporated a large data set, including the following information:
Data points considered included counts of crashes, hangs, BSODs, boots, and overall boot time.
In addition, in publishing the guide, Soluto filtered its results to include only Windows laptops that are currently for sale through various commercial outlets, including online, from the manufacturer, in big-box stores, and so forth. Interestingly the highest-scoring machine wasn’t a PC at all: The Ivy Bridge MacBook Pro (vintage mid-2012) took the pole position, closely followed by a $429 budget notebook from Acer, the Aspire E1-571. Dell notched up 5 out of the top 10 slots, with Acer and Apple each picking up another spot themselves, and Lenovo barely squeaking into tenth place with its Thinkpad X1 Carbon. Even more interestingly, units that cost at or under $700 dominated the list, racking up six spots overall.
Soluto’s Top 10 puts a MacBook Pro in top position, with Dell sweeping “overall best by total count.”
In their reporting on the Top 10 units, Soluto observes that PCs from vendors who traditionally load their machines up with third-party software, often called “crapware,” do not appear in this list. Such machines often experience lower stability and longer boot times as a result of this practice — which OEMs defend as a way to reduce PC pricing, since the companies that provide the added software help to subsidize the cost of PCs that include their warez — so it’s no big surprise that this would cost them position on Soluto’s list, given the metrics they use and the way those metrics get weighted. One of the reasons Soluto attributes to a MacBook landing in the top spot “is the fact that every Windows installation on it is clean.”
To me, what makes this report interesting is the data that drives it, and what that data tells us about how things work out there in homes and workplaces as measured empirically. This paints a very different picture from the reviews we see at the major online PC publications (PC Magazine, PC World, CNET, and so forth) and even at more focused laptop oriented sites (NotebookReview.com, NotebookCheck.com, LaptopMag.com, and so on). There, reviews concentrate most heavily on features and functions, and a “how fast can it go” kind of review philosophy that doesn’t always incorporate stability or reliability considerations (let alone the kind of database that Soluto can bring to bear).
This is extremely interesting stuff, not just because of what this single dataset and analysis has to say — which is pretty valuable and informative all by itself — but because of the ways the Soluto can (and promises to) be sliced and diced in future reports as well. Soluto already plans to report on stability differences between OEM installs and clean reinstalls on the same hardware; given their observations on the impact of crapware on overall stability and reliability this, too, promises to make for some fascinating reading and learning. It also already argues pretty forcefully that re-imaging new machines with clean installs may repay the time and effort required to replace an OEM image with a clean image of one’s own may repay itself quickly, and offer users a better overall computing experience as well.