{"id":106,"date":"2020-10-09T16:03:54","date_gmt":"2020-10-09T16:03:54","guid":{"rendered":"https:\/\/www.talentgrader.com\/blog\/?p=106"},"modified":"2020-11-19T17:51:11","modified_gmt":"2020-11-19T17:51:11","slug":"adverse-impact-addressing-risks-of-bias-in-job-selection","status":"publish","type":"post","link":"https:\/\/www.talentgrader.com\/blog\/adverse-impact-addressing-risks-of-bias-in-job-selection\/","title":{"rendered":"Adverse impact: Addressing risks of bias in job selection"},"content":{"rendered":"

One of the critical roles played by Human Resources professionals is to ensure that organisations are compliant with employment legislation, such as the case of recruitment.\u00a0 Readers of this post will likely have at the least a broad understanding of legislation relating to equality at work (e.g. the Equality Act (2010) in the UK), and some may have a high level of expertise.\u00a0 Beyond this, readers are likely to have values linked to promoting diversity and inclusion.\u00a0 In other words, I assume readers would not deliberately<\/strong> discriminate against people of different ethnicities, gender identities, religious beliefs, etc.\u00a0 The emphasis is on the deliberate, but this is not going to be a post about unconscious bias.\u00a0 Rather, I refer to indirect discrimination, which occurs when a policy or process of some kind is applied equally, but leads to unequal outcomes for people based on protected characteristics, and is not a proportionate means for pursuing a legitimate outcome.\u00a0 In other words, I want to discuss the unintended consequences of decisions that we take, known as \u201cadverse impact.\u201d\u00a0 Adverse impact applies when, for example, we use a selection tool that discriminates against people of colour, women, individuals who are neurodiverse, and so on.\u00a0 This has legal and ethical implications; from a legal perspective it is important to consider what is defensible, from an ethical perspective we should be seeking to remove unfair discrimination (based on personal characteristics rather than ability to do the job) wherever we find it.\u00a0 Drawing on the research evidence helps us both legally and ethically.<\/p>\n

<\/h4>\n

It is important to consider adverse impact before making decisions.\u00a0 Without a background in individual differences (a core component of psychology courses) or having read about research on recruitment and selection, it can be all too easy to make decisions that will have undesirable outcomes.\u00a0 For example, intelligence (or cognitive ability as psychologists tend to call it) is one of the best predictors of job performance (Morgeson, Delaney-Klinger, & Hemingway, 2005; Salgado & Moscoso, 2019; Schmidt & Hunter, 1998).\u00a0 It reflects our ability to take in information, store it, retrieve it, and use it.\u00a0 People with more of it therefore learn quicker and can do more with what they learn.\u00a0 It therefore seems an obvious choice for selection.\u00a0 Readers are probably waiting for the \u201cbut\u201d\u2026\u00a0 The downside is that cognitive ability tests create adverse impact based on ethnicity (Schmidt, 2002) and age (Klein, Dilchert, Ones, & Dages, 2015).\u00a0 In the latter case, \u201cfluid intelligence\u201d, reflecting our ability to learn new things and solve new problems, declines over the adult lifespan \u2013 hence jokes about asking children to teach us how to use gadgets.\u00a0 In the case of ethnicity it suffices to say that there continue to be debates as to the causes for differences, which are likely to include socioeconomic factors.<\/p>\n

<\/h4>\n

When we know about a problem, there are some points to consider.\u00a0 Firstly, is this legally defensible as a proportionate way of pursuing a legitimate goal?\u00a0 Continuing with the case of intelligence, it is legitimate to seek to hire the best \u2013 and no one in the diversity field is arguing otherwise.\u00a0 However, we can consider whether high levels of intelligence are really essential.\u00a0 Research shows that intelligence has a greater impact on performance when jobs are complex (Bertua, Anderson, & Salgado, 2005).\u00a0 When hiring for a simple job we can therefore simply do without the intelligence test, because it is unnecessary, and at the same stroke do away with a major source of adverse impact.\u00a0 However, we may be hiring for complex jobs in which our employees must grapple with new problems (maybe even problems we don\u2019t know exist yet).\u00a0 In this case an intelligence test may be defensible, but we should consider options for mitigating the risks.\u00a0 There are a variety of strategies such as combining intelligence with other tools that have low risk of adverse impact, adjusting the weighting we give to the use of intelligence tests, or grouping performance on intelligence tests into bands based on the margin of error \u2013 within which we arguably cannot differentiate anyway (see Ployhart & Holtz, 2008 for more detail on strategies).\u00a0 It is important to note that in the case of intelligence tests we are likely to face a trade-off between predicting performance and reducing adverse impact, as strategies that achieve the latter reduce our ability to predict performance.\u00a0 However, we can at least make an informed decision about these trade-offs.<\/p>\n

<\/h4>\n

What I am hoping to demonstrate is that choosing a selection strategy is not a simple thing.\u00a0 We need to educate ourselves about the tools that we use.\u00a0 I was recently considering the use of a work sample (i.e. observing a person perform a relevant practical task) in a selection process.\u00a0 They have good predictive ability (Borman & Hallam, 1991; O\u2019Leary, Forsman, & Isaacson, 2017; Roth, Bobko, & McFarland, 2005), but research has also identified adverse impact in the use of work samples (Roth, Bobko, & McFarland, 2005).\u00a0 Intuitively I had not expected this, and had I failed to review the evidence base I might not have been aware of the need to formulate a strategy for mitigating adverse impact.\u00a0 Roth and colleagues observed that scholars often assumed that a work sample would show similar outcomes as actual job performance, where differences are small between people of different ethnic backgrounds.\u00a0 Roth et al\u2019s analysis supports an interpretation that some work sample tests tap cognitive ability due to the need to take in and use information, for example in-tray exercises.\u00a0 They found work sample tests such as role-plays, which tap interpersonal skills, demonstrate much lower levels of adverse impact.\u00a0 Thus, similar mitigation strategies might be used with work sample tests as with cognitive ability tests, starting with an evaluation of whether the test is needed.<\/p>\n

<\/h4>\n

The scenario described above is an example of the practical use of engaging with psychological literature.\u00a0 However, not everyone has access to the research evidence (which is often published in academic journals) or the expertise.\u00a0 If you are choosing selection tools you can take some steps to protect yourself by either gaining expertise (if you have the inclination and resources) or contracting with someone who does have the expertise.\u00a0 For example, Occupational Psychologists (registered with the Health and Care Professions Council) very often have expertise in recruitment and selection techniques.<\/p>\n

<\/h4>\n

What does all this mean in practice?\u00a0 We should be reviewing our practices in terms of adverse impact.\u00a0 I have discussed recruitment and selection, but we can apply this lens to nearly every aspect of organisational functioning (e.g. organisational practices relating to working hours).\u00a0 We also need to review decisions when we are implementing something new (e.g. making a selection process for a new job).\u00a0 This will need to become a habitual part of what we do.\u00a0 Racism, sexism etc. are not going to disappear quickly, or possibly ever, so we need to be sensitive to how these may occur in our structures.\u00a0 New challenges may emerge, perhaps as new individual differences become known.\u00a0 In other words we are going to have to create and recreate solutions, and evaluate how well they work.\u00a0 We will need to scan the horizon.\u00a0 For example, the use of artificial intelligence in selection poses challenges, because machine learning functions by identifying patterns without judging patterns ethically.\u00a0 If our selection process discriminates against black men, and we automate the process, we now have racist automation \u2013 not what I dreamed of when reading science fiction as a child.\u00a0 If we are going to do this right, we can start by recognising that it is challenging and will require effort and thought.<\/p>\n

<\/h4>\n

Dr Andrew Clements is a Lecturer in Business and Occupational Psychology at Coventry University, with interests in promoting evidence-based practice.\u00a0 You can find out more about postgraduate courses teaching the application of psychology to the workplace here<\/a> (for individuals with a first degree in psychology) or here<\/a> (for individuals with first degrees in other subjects).<\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

One of the critical roles played by Human Resources professionals is to ensure that organisations are compliant with employment legislation, such as the case of recruitment.\u00a0 Readers of this post will likely have at the least a broad understanding of legislation relating to equality at work (e.g. the Equality Act (2010) in the UK), and […]<\/p>\n","protected":false},"author":3,"featured_media":109,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[8,18,19,20,21,6,9,5],"yoast_head":"\nAdverse impact: Addressing risks of bias in job selection - My blog<\/title>\n<meta name=\"description\" content=\"What is adverse impact? Using certain type of selection tests can cause adverse impact and could lead to indirect discrimination. Read our blog to know more.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/www.talentgrader.com\/blog\/adverse-impact-addressing-risks-of-bias-in-job-selection\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Adverse impact: Addressing risks of bias in job selection - My blog\" \/>\n<meta property=\"og:description\" content=\"What is adverse impact? Using certain type of selection tests can cause adverse impact and could lead to indirect discrimination. Read our blog to know more.\" \/>\n<meta property=\"og:url\" content=\"http:\/\/www.talentgrader.com\/blog\/adverse-impact-addressing-risks-of-bias-in-job-selection\/\" \/>\n<meta property=\"og:site_name\" content=\"My blog\" \/>\n<meta property=\"article:published_time\" content=\"2020-10-09T16:03:54+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-11-19T17:51:11+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.talentgrader.com\/blog\/wp-content\/uploads\/2020\/10\/800by800blog.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"800\" \/>\n\t<meta property=\"og:image:height\" content=\"800\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" value=\"Written by\">\n\t<meta name=\"twitter:data1\" value=\"Andrew Clements\">\n\t<meta name=\"twitter:label2\" value=\"Est. reading time\">\n\t<meta name=\"twitter:data2\" value=\"5 minutes\">\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.talentgrader.com\/blog\/#website\",\"url\":\"https:\/\/www.talentgrader.com\/blog\/\",\"name\":\"My blog\",\"description\":\"Psychometric Tests for Recruitment and Selection\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/www.talentgrader.com\/blog\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"http:\/\/www.talentgrader.com\/blog\/adverse-impact-addressing-risks-of-bias-in-job-selection\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/www.talentgrader.com\/blog\/wp-content\/uploads\/2020\/10\/800by800blog.jpg\",\"width\":800,\"height\":800},{\"@type\":\"WebPage\",\"@id\":\"http:\/\/www.talentgrader.com\/blog\/adverse-impact-addressing-risks-of-bias-in-job-selection\/#webpage\",\"url\":\"http:\/\/www.talentgrader.com\/blog\/adverse-impact-addressing-risks-of-bias-in-job-selection\/\",\"name\":\"Adverse impact: Addressing risks of bias in job selection - My blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.talentgrader.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"http:\/\/www.talentgrader.com\/blog\/adverse-impact-addressing-risks-of-bias-in-job-selection\/#primaryimage\"},\"datePublished\":\"2020-10-09T16:03:54+00:00\",\"dateModified\":\"2020-11-19T17:51:11+00:00\",\"author\":{\"@id\":\"https:\/\/www.talentgrader.com\/blog\/#\/schema\/person\/675479ccadf1cca2fc465731cd59e6cc\"},\"description\":\"What is adverse impact? Using certain type of selection tests can cause adverse impact and could lead to indirect discrimination. Read our blog to know more.\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"http:\/\/www.talentgrader.com\/blog\/adverse-impact-addressing-risks-of-bias-in-job-selection\/\"]}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.talentgrader.com\/blog\/#\/schema\/person\/675479ccadf1cca2fc465731cd59e6cc\",\"name\":\"Andrew Clements\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/www.talentgrader.com\/blog\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d65a0e6d52d387bc8fd03b392450eafd?s=96&d=mm&r=g\",\"caption\":\"Andrew Clements\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/www.talentgrader.com\/blog\/wp-json\/wp\/v2\/posts\/106"}],"collection":[{"href":"https:\/\/www.talentgrader.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.talentgrader.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.talentgrader.com\/blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.talentgrader.com\/blog\/wp-json\/wp\/v2\/comments?post=106"}],"version-history":[{"count":8,"href":"https:\/\/www.talentgrader.com\/blog\/wp-json\/wp\/v2\/posts\/106\/revisions"}],"predecessor-version":[{"id":129,"href":"https:\/\/www.talentgrader.com\/blog\/wp-json\/wp\/v2\/posts\/106\/revisions\/129"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.talentgrader.com\/blog\/wp-json\/wp\/v2\/media\/109"}],"wp:attachment":[{"href":"https:\/\/www.talentgrader.com\/blog\/wp-json\/wp\/v2\/media?parent=106"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.talentgrader.com\/blog\/wp-json\/wp\/v2\/categories?post=106"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.talentgrader.com\/blog\/wp-json\/wp\/v2\/tags?post=106"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}