10 Reasons Why Time's XQ Article on Hiring is Based on Faulty Science

10 Reasons Why Time's XQ Article on Hiring is Based on Faulty Science

Many years ago I took a bunch of personality-type assessments including Myers Briggs, Calipers, Predictive Index and DISC. They all came back with the same general assessment – extroverted, dominant, influencing, intuitive and creative. It also turned out I was far below average on the analytical and attention-to-detail side for any jobs these traits required. I knew this was totally backwards.

The tests all showed that given the choice I’d rather go to a party and debate all night long, which was true. But these were just preferences and in no way reflected ability. At the time, the work I had enjoyed most, and was really good at, involved mathematical modeling of complex manufacturing and business processes. None of these tests picked this up. Over the next 15 years I validated this fundamental flaw with hundreds of candidates and described the results in my first book, Hire With Your Head, in 1997.

I’m still fighting this same preferences vs. competencies battle. These tests do not predict performance. At best they confirm how the performance was achieved.

So when I saw the cover story on last week’s Time magazine, How High is Your XQ?, my personal personality assessment battle resurfaced. XQ is just another spin for the same old narrow-minded HR in-the-box thinking. Asking a bunch of preference-oriented questions and finding some statistical correlation ignores outliers, diverse candidates, non-traditional candidates, older candidates, younger candidates, high potential candidates, military veterans, people of different religions and races and anyone who thinks differently. In my opinion, Time magazine’s article sets the world of hiring back 40 years.

The big idea behind the so-called XQ factor is to use screening questionnaires to weed out weaker candidates who apply to jobs they should never have applied to. The unintended consequence of this approach is that it puts a lid on the quality of the people who do apply and ultimately get hired. This concept is shown in the infographic.  

The core problem is that the XQ approach severely limits the pool of contenders to only those who are skills- and experience-qualified (“SE Q”) AND who are also willing to take a lateral transfer AND who are willing to endure the demeaning application process. This is only 1% of the the entire talent market (represented by the little “X” in the lower left of the infographic). The full talent market includes those who are performance-qualified plus all of those who didn’t apply either because they didn’t see the job posting or they weren’t interested in enduring the process to obtain a lateral transfer. It would be far better to attract the best people into the process by offering career opportunities rather than weeding out the weakest.

Here are some more reasons the XQ approach should be discarded or reengineered: 

  • You can’t use a surplus of talent strategy in a scarcity of talent situation. In a talent scarcity situation, 95% of the best people – those in the talent sweet spot – will rarely directly apply to an open job. These people usually get referred to better spots short-circuiting the high volume XQ hiring processes used by most companies.
  • Preferences aren’t competences. Preferring to meet a bunch of friends for lunch over reading a book on some meaningful topic doesn’t mean you’re an extroverted team player and a technical bimbo. It means you’re hungry.
  • Confirming indicators aren’t predictive indicators. While these XQ preferences are reasonable confirming predictors of performance, they can’t be used as leading indicators. There is great value in giving these assessments after the person has been determined to be performance-qualified. Unexpected differences can then be evaluated to see if there is a fit, style or personality problem.
  • You can't assert the consequent. A dependent variable, like competencies, can't be converted into a independent variable. It's illogical
  • Skills-based job descriptions are not job descriptions, they’re person descriptions. A performance-based job description defines the job as a series of 6-8 performance objectives. People who can do this work are performance-qualified. This should be the criteria for initial consideration. This shift in thinking opens up the entire talent pool to every qualified person.  

The biggest reason I oppose the XQ factor weeding out approach is that the best people tend to have less or different skills, experiences and competencies typically listed as required. The reason is obvious: They achieve better results, get promoted more quickly, are quick learners, get assigned to stretch jobs early in their careers, volunteer for jobs that are challenges or no one else wants and think differently about how to solve problems. Why would anyone want to filter these people out?

Now if I didn’t get the 10 reason count right and if I blasted this post out with bombastic and superficial thinking, maybe all of these XQ-like assessment tests are actually perfect predictors of performance.

Regardless, as far as I'm concerned these alphabet-named assessments and screening tools are anti-diversity, anti-gender, anti-race and simply wrong-headed hiring techniques. They’re lazy tools used to weed out people who should never have applied to a job in the first place. For this, they’re okay.

Now I'm going to lunch and read a book. 

_______________________

Lou Adler (@LouA) is the CEO of The Adler Group, a consulting and training firm helping companies implement Performance-based Hiring. He's also a regular columnist for Inc. Magazine and BusinessInsider. His latest book, The Essential Guide for Hiring & Getting Hired (Workbench, 2013), provides hands-on advice for job-seekers, hiring managers and recruiters on how to find the best job and hire the best people. His new video program provides job seekers inside secrets on what it takes to get a job in the hidden job market.

Ji-A Min

Learning & Development Manager at Prime Quadrant | People first, data a close second

8y

>Asking a bunch of preference-oriented questions and finding some statistical correlation ignores outliers, diverse candidates, non-traditional candidates, older candidates, younger candidates, high potential candidates, military veterans, people of different religions and races and anyone who thinks differently. This is false, and a fundamental misunderstanding of psychometric assessment. In fact, organizations that use personality testing in their hiring process have greater minority representation than those that don't: http://www.academia.edu/1410962/The_effect_of_adverse_impact_in_selection_practices_on_organizational_diversity_a_field_study

Like
Reply
Eric Wentworth

Co-Founder, Director Of Operations at Wentworth Executive Recruiting | Co-Founder, Arrangr.com | Author, A Mindful Career

8y

The emphasis on analytics these days has carried over into everything, including hiring. It's the modern equivalent of covering your ass. Companies seem to both want innovative performers and do everything they can to keep them away (not a culture fit). There are millions of great potential employees shut out of the best jobs because they "aren't a good fit" or "didn't pass the tests." Then there is the age-old problem of office politics, insecure over-controlling bosses, corporate hierarchies, and poor communications to muck up the workplace even more. A good recruiter (hard to find) who takes the time to assess the candidate and company, is intuitive and compassionate, who isn't a "churn and burn" type, can be the catalyst for a good hire.

Susan Dingle

Researcher-Writer-Presenter on Inclusion, Transportation, & Historic Preservation (No dating or Bitcoin)

8y

I'm still smiling after reading your article. My preferences results from the same kinds of tests you took are a little different than yours were. Your conclusion was great (and this is when my smile begins): <I’m still fighting this same preferences vs. competencies battle. These tests do not predict performance. At best they confirm how the performance was achieved.> Indeed. And your comments about all the interesting, talented, diverse, outlier candidates that these assessments miss are outstanding. Thank you!

Like
Reply

You are so right! Having worked in HR for many years I always tried to circumvent that process. How long will it take the HR community to wake up is another story.

Like
Reply
Prasad M

Experienced Human Resources Development Professional

8y

I don't understand why people are shooting at HR guys as if they have been granted sole proprietorship rights for hiring. Hiring is a joint task. Coming to ...Qs, even when different assessment tests were in vogue decades ago; they were not a great tool to depend upon for hiring. Validation exercises after a lapse of time on hired guys - assessment results vs performance on the job, didn't match. Good assessment results, performance poor, average assessment results, performance good. Hence to put down tests as useless or saying they reflect candidates' abilities very well are 2 extreme statements. Tests for jobs involving dexterity, hand-reflex coordination, possibly some of these tests would be appropriate. For jobs involving team working, decision making, managerial nature of responsibilities, multi interviewing techniques coupled with references should suffice. Scene is different if someone wants to use filters to eliminate and go ahead with remnants. To clarify, my views expressed are in the context of my experience in my country, India. Prasad

Like
Reply

To view or add a comment, sign in

Insights from the community

Explore topics