Biodata Thesis Proposal Summary


Improving the Accuracy of Biodata Personnel Selection Questionnaires


Introduction

There are many costs associated with hiring personnel who subsequently are not successful. These costs can be measured not only in dollar terms but also by the effect on the lives and careers of the persons involved. One personnel selection technique involves obtaining biographical information(Biodata) from job applicants to predict future job sucess. While resembling the standard job application form, a Biodata questionnaire seeks to obtain more extensive and detailed information. The basis of Biodata predictive abilities is the theory that past behaviour is the best predictor of future behaviour. Biodata cannot predict all future behaviours but it can give an indication of the types of probable behaviours based on an individual's prior learning history.(Mumford & Owens, 1987). Nichols(1994) stated that "Biodata measures may predict performance across so many aspects of behaviour as well as they do because responses to Biodata items may serve to capture previous manifestations of the constructs and mechanisms that ultimately determine predictive relationships with criteria."

While job application forms of one type or the other have been in use since the turn of this century, it has been only relatively recently that there has been a concerted effort to improve Biodata's reliability and validity. Two of the major concerns are how to minimize the incidence of faking and how to reduce inaccurate responses due to social desirability.

One recent approach to addressing both of these concerns employs differing the instructions given to the applicants. Kluger and Colella(1993) studied the effects of faking Biodata test items by randomly warning 214 of 429 applicants for a nurse's assistant position against faking. While the warning mitigated the propensity to fake, the specific warning effects depended on item transparency. For transparent items, warning reduced the extremeness of item means and increased item variances. For nontransparent items, warning did not have an effect on item means and reduced item variances. These faking effects were best predicted when transparency was operationalized in terms of item- specific job desirability in addition to the item-general social desirability.

Method

My study examines the instructions given to the applicant to see if a forceful caution can reduce the incidence of faking good. It also looks at what types of additional information will increase the accuracy of responses. I am proposing to examine the effects of warning conditions and amount of supporting detail requested on faking behaviours in a simulated job application situation using a two by two between and two by two within factorial design as shown below.. There are two levels of warning(minimum and maximum warnings). In the maximum warning groups, the subjects will be explicitly cautioned that some of their responses will be verified and that any false statements would be grounds for dismissal.

All items will be rated as to the degree it could be perceived as being job related(JR) and verifiable(V). It is expected that the means and correlations will be different for items that are highly job related(HJR) and highly verifiable(HV) as opposed to items that are low(LJR & LV). Within the instrument there is also "fake" (verifiable) item to further assess faking based on a study by Pannone(1984).

Biodata Study (N = 280)

(Desired power of .80, Effect size .67, sig. .05)

2 X 2 Between
Short Version Extended Version
Minimum Warning 70 70
Maximum Warning 70 70




2 X 2 Within

Items
High Job Relevance Low Job Relevance
Highly Verifiable 10 10
Slightly Verifiable 10 10


The subjects will be 300 Psychology 1000 students. These students volunteer to participate in return for receiving credit towards their course participation marks. The subjects will be asked to role play as a job applicant responding to a fictional job advertisement. A set of the materials is enclosed at appendix A.

The responses to the 40 test items will be converted to Z scores. The means and correlations will be compared between and within the groups.

References

Adler, S. (1987). Toward The More Efficient Use of Assessment Center Technology In Personnel Selection. Journal of Business and Psychology, 2(1), 75-93.

Anthony, D. T., & Silverhart, T. A. (1994). Combining Biodata Test And Interview Information: Predicting Decisions And Performance Criteria. Personnel Psychology, 47, 305-315.

Baehr, M. E., Jones, J. W., Baydoun, R. B., & Behrens, G. M. (1994). Proactively balancing the validity and legal compliance of Personal background measures in personnel management. Journal of Business and Psychology, Volume 8(No. 3).

Becker, T. E., & Colquitt, A. I. (1992). Potential Versus Actual Faking of a Biodata Form: An Analysis Along Several Dimensions of Item Type. Personnel Psychology, 45, 389-405.

Brown, S. H. (1994). Validating Biodata. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 199-236). Palo Alto, California: CPP Books.

Camara, W. J., & Schneider, D. L. (1994). Integrity Tests. .

Campbell, J. P., & Zook, L. M. (1994). Building and Retaining the Career Force: New Procedures for Accessing and Assigning Army Enlisted Personnel Annual Report, 1991 Fiscal Year (ARI Research Note 9440): United States Army Research Institute for the Behavioral and Social Sciences.

Christiansen, N. D., Richard D, G., Johnston, N. G., & Rothstein, M. G. (1994). Correcting the 16PF For Faking: Effects On Criterion-Related Validity And Individual Hiring Decisions. Personnel Psychology, 47, 847-861.

Cronshaw, S. F. (1986). The Status of Employment Testing in Canada: A Review And Evaluation of Theory And Professional Practice. Canadian Psychology, 27(2), 183-195.

Endsley, M. R. (1995). Measurement of Situation Awareness in Dynamic Systems. Human Factors, 37(1), 65-84.

Endsley, M. R. (1995). Toward a Theory of Situation Awareness in Dynamic Systems. Human Factors and Ergonomics Society, 37(1), 32-64.



Fine, S. A., & Cronshaw, S. (1994). The Role of Job Analysis in Establishing the Validity of Biodata. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 39-64). Palo Alto, California: CPP Books.

Fleishman, E. A. (1988). Some New Frontiers in Personnel Selection Research. Personnel Psychology, 41, 681-701.

Gandy, J. A., Dye, D. A., & MacLane, C. N. (1994). Federal Government Selection: The Individual Achievement Record. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 275-310). Palo Alto, California: CPP Books.

Hakstian, R. A., Woolley, R. M., & Woolsey, L. K. (1991). Management Selection By Multiple-Domain Assessment: 1. Concurrent Validity. Educational and Psychological Measurement, 51, 882-898.

Harris, M. M., & Schaubroeck, J. (1988). A Meta-Analysis Of Self-Supervisor, Self-Peer, and Peer-Supervisor Ratings. Personnel Psychology, 41, 43-62.

Harris, M. M. (1989). Reconsidering The Employment Interview: A Review of Recent Literature And Suggestions For Future Research. Personnel Psychology, 42, 691-727.

Harris, M. M. (1989). Reconsidering the Employment Interview: A Review of Recent Literature and Suggestions for Future Research. Personnel Psychology, 42, 691-726.

Harvey, R. J., Hakel, M. D., Friedman, L., & III, E. T. C. (1988). Dimensionality of the Job Element Inventory, a Simplified Worker-Oriented Job Analysis Questionnaire. Journal of Applied Psychology, 73(4), 639-646.

Hein, M., & Wesley, S. (1994). Scaling Biodata Through Subgrouping. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 171-196). Palo Alto, California: CPP Books.

Hogan, J. B. (1994). Empirical Keying of Background Data Measures. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 69-108). Palo Alto, California: CPP Books.

Hogan, R., Hogan, J., & Roberts, B. W. (1996). Personality Measurement and Employment Decisions. American Psychologist, 51(5), 469-477.





Holden, R. R.& Samuels, Trisha J. (1993) Response Latency Detection of Fakers

on Personnel Tests. Paper presented at the Canadian Psychological Association Annual Convention, Montreal, Quebec.

Hough, L., & Paullin, C. (1994). Construct-oriented Scale Construction. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 109-146). Palo Alto, California: CPP Books.

James, S. W., Reilly, R. R., Millsap, R. E., Pearlman, K., & Stoffey, R. W. (1993). Applicant Reactions to Selection Procedures. , 46, 49-77.

Kluger, A. N., & Colella, A. (1993). Beyond The Mean Bias: The Effect of Warning Against Faking On Biodata Item Variances. Personnel Psychology, 46, 763-861.

Lancaster, S. J., Stephen M. Colarelli, & Daniel W. Icing, A. T. A. B. (1994). Job Applicant Simularity on Cognitive Ability, Vocational Interests and Personality Characteristics: Do Similar Persons Choose Similar Jobs? Educational and Psychological Measurement, 54(2), 299-316.

Lautenschlager, G. J. (1994). Accuracy and Faking of Background Data. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 391-420). Palo Alto, California: CPP Books.

LoBello, S. G., & Sims, B. N. (1993). Fakability of a Commercially Produced Pre-employment Integrity test. JOURNAL OF BUSINESS AND Psychology, 8(No 2).

Mael, F. A. (1991). A Conceptual Rationale For The Domain And Attributes Of Biodata Items. Personnel Psychology, 44, 763-927.

Mael, F. A., & Ashforth, B. E. (1995). Loyal From Day One: Biodata, Organizational Identification, and Turnover Among Newcomers. , 48, 309-333.

Mitchell, T. W. (1994). The Utility of Biodata. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 485-516). Palo Alto, California: CPP Books.

Morrison, R. F. (1994). Biodata Applications in Career Development Research and Practice. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 451-484). Palo Alto, California: CPP Books.

Muchinsky, P. M. (1994). The Influence of Life History Experiences on Vocational Interest and Choices. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 535-554). Palo Alto, California: CPP Books.

Mumford, M. D., Reiter-Palmon, R., & Snell, A. F. (1994). Background Data and Development: Structural Issue in the Application of Life History Measures. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 555-582). Palo Alto, California: CPP Books.

Mumford, M. D., Snell, A. F., & Reiter-Palmon, R. (1994). Personality and Background Data: Life History and Self-concepts in an Ecological System. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 583-625). Palo Alto, California: CPP Books.

Nickels, B. J. (1994). The Nature of Biodata. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 1-16). Palo Alto, California: CPP Books.

Owens, W. A., & Schoenfeldt, L. F. (1979). Towar a Classification of Persons. Journal of Applied Psychology Monograph, 65(5), 569-607.

Pannone, R. D. (1984). Predicting Test Performance: A content valid approach to screening applicants. Personnel Psychology, 65, 507-514.

Pannone, R. D. (1994). Blue Collar Selection. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 261-274). Palo Alto, California: CPP Books.

Peckan, L. M. (1995). Biodata Applications in Selection Systems: A Review of the Literature : Canadian Forces Personnel Applied Research Unit.

Ree, M. J., James A. Earles, & Teachout, a. M. S. (1994). Predicting Job Performance: Not Much More Than g. Journal of Applied Psychology, 79(4), 518-524.

Richard, M. J., & Baldwin, T. T. (1991). Team-based Employee Involvement Programs: Effects of Design and Administration. Personnel Psychology, 44, 793-737.

Russell, C. J. (1990). Selecting Top Corporate Leaders: An Example of Biographical Information. Journal of Management, 16(1), 73-86.

Russell, C. J. (1994). Generation Procedures for Biodata Items: A Point of Departure. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 17-38). Palo Alto, California: CPP Books.

Sarter, N. B., & Woods, D. D. (1995). How in the World Did We Ever Get into That Mode? Mode Error and Awareness in Supervisory Control. Human Factors, 37(1), 5-19.

Schmidt, F. L., & Rothstein, H. R. (1994). Application of Validity Generalization to Biodata Scales in Employment Selection. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 237-260). Palo Alto, California: CPP Books.

Schneider, B., & Schneider, J. L. (1994). Biodata: An Organizational Focus. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 423-450). Palo Alto, California: CPP Books.

Schoenfeldt, L. F., & Mendoza, J. L. (1994). Developing and Using Factorially Derived Biographical Scales. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 147-170). Palo Alto, California: CPP Books.

Sharf, J. C. (1994). The Impact of Legal and Equal Employment Opportunity Issues on Personal History Inquiries. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 351-390). Palo Alto, California: CPP Books.

Stokes, G. S., Mumford, M. D., & Owens, W. A. (Eds.). (1994). Biodata Handbook. Palo Alto, California: CPP Books.

Stokes, G. S., & Cooper, L. A. (1994). Selection Using Biodata: Old Notions Revisited. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 311-350). Palo Alto, California: CPP Books.

Stokes , G. S., Hogan, J. B., & Snell, A. R. (1993). Comparability of incumbent and Applicant samples for the development Of Biodata keys: the influence of

Social desirability. Personnel Psychology, 46, 739-761.

Tenopyr, M. L. (1994). Big Five, Structural Modelling, and Item Response Theory. In G. S. Stokes, M. D. Mumford, & W. A. Owens (Eds.), Biodata Handbook (pp. 519-534). Palo Alto, California: CPP Books.

Young, M. C., & White, L. A. (1995). Assessment of Background and Life Experiences (ABLE) : U.S. Army Research Institute for the Behavioral and Social Sciences.





Return to Table of Contents


Last Updated January 20, 1997 by Frank Kuschnereit