Martin Heller
Contributing Writer

uTest crowd-sources QA

analysis
Mar 27, 20093 mins

uTest has a pool of 15,000 capability-profiled QA professionals in 150 countries

Last week (OK, I’m running behind on writing up these conversations — so sue me!), I had a lively conversation with Matt Johnston, vice president of marketing and community at uTest, a company whose tagline is “software testing community.” Imagine having a pool of 15,000 QA professionals in 150 countries available on call, with each member having a profile of capabilities, and you’ll get a good picture of what uTest is all about.

Since I do a lot of testing of applications that I write or manage, I keep a number (currently about eight total) of desktop and laptop computers around, running a variety of Windows and Linux builds and an assortment of browsers; I expand my testing repertoire with virtual machines. My primary language is English and my primary locale is the United States; when I need to test in a range of languages and locales, I typically have to enlist coworkers with the appropriate language skills who have the operating systems installed to the correct locales, although I can do a certain amount of that myself. Now add mobile devices: ouch. I can really see the need for a QA taskforce like uTest’s.

[ Cut straight to the key news for technology development and IT management, with our once-a-day summary of the top tech news. Subscribe to the InfoWorld Daily newsletter. ]

Matt and I spent quite a while talking about QA in Agile environments. I recently did some editing work on a book that’s about Agile QA, so I was tuned into the topic. According to Matt, QA has been a bigger pain point in Agile software organizations than in traditional shops; uTest can help quite a bit with this.

Think about a Scrum shop with one inside QA person assigned to a team. At the end of each one- or two-week sprint, the QA person is going to have a crushing integration testing load, even if he or she was proactive in working with the developers on test definitions throughout the sprint. Enter uTest: Instead of working the weekend so that the team can start the next sprint bright and early on Monday, the QA person can define a test matrix and a profile of desired testers for uTest on Friday, post the test build to uTest, and come back Monday to a folder full of bug reports.

That sounds great, but it also sounds like it’s either going to be expensive for the company or the testers will have to work for peanuts. According to Matt, that turns out not to be the case; the company can pay for performance by the accepted bug report, and testers with strong reputations receive more work and higher rates.

This is crowd-sourced QA. Interesting, no?

Martin Heller

Martin Heller is a contributing writer at InfoWorld. Formerly a web and Windows programming consultant, he developed databases, software, and websites from his office in Andover, Massachusetts, from 1986 to 2010. From 2010 to August of 2012, Martin was vice president of technology and education at Alpha Software. From March 2013 to January 2014, he was chairman of Tubifi, maker of a cloud-based video editor, having previously served as CEO.

Martin is the author or co-author of nearly a dozen PC software packages and half a dozen Web applications. He is also the author of several books on Windows programming. As a consultant, Martin has worked with companies of all sizes to design, develop, improve, and/or debug Windows, web, and database applications, and has performed strategic business consulting for high-tech corporations ranging from tiny to Fortune 100 and from local to multinational.

Martin’s specialties include programming languages C++, Python, C#, JavaScript, and SQL, and databases PostgreSQL, MySQL, Microsoft SQL Server, Oracle Database, Google Cloud Spanner, CockroachDB, MongoDB, Cassandra, and Couchbase. He writes about software development, data management, analytics, AI, and machine learning, contributing technology analyses, explainers, how-to articles, and hands-on reviews of software development tools, data platforms, AI models, machine learning libraries, and much more.

More from this author