Are We Collaborating Yet? Employee Assessment of Peer’s Perceptions

Benjamin Heslop, Elizabeth Stojanovski, Jonathan Paul, Kylie Bailey


Employers rarely utilise their employees’ capacity to assess the collegiality and productivity of their own work unit, yet they are determinants of employee retention and profitability. One reason is the lack of a reliable, valid survey instrument to measure collaboration viability (CoVi), which we postulate is the construct that employees use to implicitly assess their work unit. Inherent weaknesses of own-perception and peer-assessment instruments prevent them reliably measuring CoVi. A novel method overcoming respective deficiencies by combining the strengths of both approaches is proposed that we term peer’s-perception. It is contended that such an instrument may be improved through formulation in accordance with a universal model of collaboration. The model chosen is PILAR as it encapsulates a variety of social and organisational psychology theories. Prospects, involved, liked, agency and respect constitute five Pillars of collaboration (Heslop, Bailey, et al., 2017). Based on this review, we propose a peer’s-perception instrument (Pillar-PP) and that this instrument be formally evaluated.

Full Text:



Bandura. (1994). Self-efficacy. Encyclopedia of Human Behavior, 4(1994), 1–65.

Bargh, J. A., Gollwitzer, P. M., & Oettingen, G. (2010). Motivation. In S. Fiske, D. T. Gilbert, & G. Lindzay (Eds.), Handbook of Social Psychology (5th ed., pp. 268–316). New York: Wiley.

Brody, C. J., & Dietz, J. (1997). On the Dimensionality of Two-Question Format Likert Attitude Scales. Social Science Research, 26(26), 197–204.

Buss, D. M., & Duntley, J. D. (2008). Adaptations for Exploitation. Group Dynamics: Theory, Research, and Practice, 12(1), 53–62.

Ceston, C. M., Levine, R. E., & Lane, D. R. (2008). Peer Assessment and Evaluation in Team-Based Learning. In New Directions for Teaching and Learning (pp. 69–78). Wiley Periodicals, Inc.

Chen, C. C., Ünal, A. F., Leung, K., & Xin, K. R. (2016). Group harmony in the workplace: Conception, measurement, and validation. Asia Pacific Journal of Management, 33(4), 935–936.

Chiu, C., & Dweck, C. S. (1997). Lay Dispositionism and Implicit Theories of Personality. Journal of Personality and Social Psychology, 73(I), 19–30.

Cho, K., Schunn, C. D., & Wilson, R. W. (2006). Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives. Journal of Educational Psychology, 98(4), 891–901.

Claussen, D. S. (2004). Cognitive Dissonance, Media Illiteracy, and Public Opinion on News Media. American Behavioral Scientist, 48(2), 212–218.

Daley, D. M. (1992). Pay for Performance, Performance Appraisal, and Total Quality Management. Public Productivity & Management Review, 16(1), 39–51.

Debnath, S. C. (2015). Fifty Years and Going Strong: What Makes Behaviorally Anchored Rating Scales So Perennial as an Appraisal Method? International Journal of Business and Social Science, 6(2), 16–25.

DeCoths, T. A. (1977). An analysis of the external validity and applied relevance of three rating formats. Organizational Behavior and Human Performance, 19(2), 247–266.

Donaldson, S. I., & Grant-Vallone, E. J. (2002). Understanding self-reported bias in organizational behavior research. Journal Business and Psychology, 17(2), 245–261.

Edmondson, A. (1999). Psychological safety and learning behavior in work teams. Administrative Science Quarterly, 44(2), 350–383.

Elfenbein, H. A. (2008). Emotion in Organizations. In The Academy of Management Annals (pp. 315–386). University of California, Berkeley.

Erber, R., & Erber, M. W. (2000). The Self-Regulation of Moods: Second Thoughts on the Importance of Happiness in Everyday Life. Psychological Inquiry, 11(3), 142–148.

Fowler, F. (1995). Improving survey questions: Design and evaluation (Applied Social Research Methods, Volume 38). Thousand Oaks, California: Sage.

Frith, C. D., & Frith, U. (2006). The neural basis of mentalizing. Neuron, 50(4), 531–4.

Greitemeyer, T. (2012). Boosting One’s Social Identity: Effects of Social Exclusion on Ethnocentrism. Basic and Applied Social Psychology, 34(5), 410–416.

Hackman, J., & Katz, N. (2010). Group behavior and performance. In Handbook of social psychology (pp. 1208–1251). Retrieved from

Hastie, C., Fahy, K., & Parratt, J. (2014). The development of a rubric for peer assessment of individual teamwork skills in undergraduate midwifery students. Women and Birth, 27(3), 220–226.

Heslop, B., Bailey, K., Drew, A., Paul, J., Stojanovski, E., & Smith, R. (2017). Encapsulating Social Psychology: The PILAR Model of Collaboration. Manuscript Submitted for Publication.

Heslop, B., Bailey, K., Paul, J., Drew, A., & Smith, R. (2016). Collaboration Guidelines to Transform Culture. Interdisciplinary Journal of Partnership Studies, 3(3).

Heslop, B., Stojanovski, E., Paul, J., Iverson, S., & Bailey, K. (2017). Respondent Disengagement in a Peer-Assessment Instrument Measuring Collaboration Viability. Manuscript Submitted for Publication.

Hess, S., & Stathopoulos, A. (2013). Linking response quality to survey engagement: a combined random scale and latent variable approach. Journal of Choice Modelling, 7, 1–12.

Hoenderdos, J. W. (2013). Towards an Observational Measure for Team Psychological Safety. University of Twente. Retrieved from

Hughes, R. L., & Jones, S. K. (2011). Developing and Assessing College Student Teamwork Skills. New Directions for Institutional Research, 149, 53–64.

Jacob, P. (2008). What Do Mirror Neurons Contribute to Human Social Cognition? Mind & Language, 23(2), 190–223.

Jehn, K., & Mannix, E. (2001). The dynamic nature of conflict: A longitudinal study of intragroup conflict and group performance. Academy of Management Journal, 44(2), 238–251.

Kaplan, S., Bradley, J. C., Luchman, J. N., & Haynes, D. (2009). On the role of positive and negative affectivity in job performance: a meta-analytic investigation. Journal of Applied Psychology, 94(1), 162–176.

Kendall, D. L., & Salas, E. (2015). Measuring Team Performance: Review of current methods and consideration of future needs. In The Science and Simulation of Human Performance (pp. 307–326). Online: Emerald Group Publishing Ltd.

Kim, J., Baek, T. H., & Kim, D. (2011). Quality of Work and Team Spirit as Drivers of Student Peer Evaluation on Advertising Group Project Performance. Journal of Advertising Education, 15(2), 14–24. Retrieved from

Kingstrom, P. O., & Bass, A. R. (1981). A critical analysis of studies comparing Behaviorally Anchored Rating Scales (BARS) and other rating formats. Personnel Psychology, 34(2), 263–289.

Koh, E., Hong, H., & Seah, J. (2014). An analytic frame and multi-method approach to measure teamwork competency. Proceedings - IEEE 14th International Conference on Advanced Learning Technologies, ICALT 2014, 264–266.

Koh, E., Shibani, A., Tan, J. P. L., & Hong, H. (2016). A pedagogical framework for learning analytics in collaborative inquiry tasks. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge - LAK ’16, 74–83.

Konak, A., Magluilo, S., & Kulturel-Konak, S. (2016). Behaviorally anchored rating scales for teamwork peer assessment. ISEC 2016 - Proceedings of the 6th IEEE Integrated STEM Education Conference, 168–172.

Kuhn, D. (2015). Thinking together and alone. Educational Researcher, 44(1), 46–53.

Kusano, S. M., Conger, A. J., & Wright, M. C. (2015). Development and Assessment of Collaboration, Teamwork and Communication. Michigan. Retrieved from RES.pdf

Lievens, F. (2001). Assessor training strategies and their effects on accuracy, interrater reliability, and discriminant validity. The Journal of Applied Psychology, 86(2), 255–264.

Lönnqvist, J. E., Leikas, S., Verkasalo, M., & Paunonen, S. V. (2008). Does Self-Enhancement Have Implications for Adjustment? Basic and Applied Social Psychology, 30(4), 377–386.

Lord, R. G., & Maher, K. J. (1990). Alternative Information-Processing Models and Their Implications for Theory, Research, and Practice. The Academy of Management Review, 15(1), 9–28.

Lott, A., & Lott, B. (1965). Group cohesiveness as interpersonal attraction: a review of relationships with antecedent and consequent variables. Psychological Bulletin, 64(4), 259–309.

Luthans, F., Avolio, B. J., Avery, J. B., & Norman, S. M. (2007). Positive psychological capital: Measurement and relationship with performance and satisfaction. Personnel Psychology, 60, 541–572.

Mathieu, J. E., Gilson, L. L., & Ruddy, T. M. (2006). Empowerment and team effectiveness: an empirical test of an integrated model. The Journal of Applied Psychology, 91(1), 97–108.

Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749.

Morgeson, F., & DeRue, D. (2006). Event criticality, urgency, and duration: Understanding how events disrupt teams and influence team leader intervention. The Leadership Quarterly.

Mount, M. K., Barrick, M. R., & Stewart, G. L. (1998). Five-Factor Model of personality and Performance in Jobs Involving Interpersonal Interactions. Human Performance, 11(2–3), 145–165.

Newman, A., Donohue, R., & Eva, N. (2017). Psychological safety: A systematic review of the literature. Human Resource Management Review, 1–15.

O’Neill, T. A., McLarnon, M. J. W., & Carswell, J. J. (2015). Variance Components of Job Performance Ratings. Human Performance, 28(1), 66–91.

Oberman, L. M., Pineda, J. a, & Ramachandran, V. S. (2007). The human mirror neuron system: a link between action observation and social skills. Social Cognitive and Affective Neuroscience, 2(1), 62–66.

Ohland, M. W., & Loughry, M. L. (2006). Designing a Peer Evaluation Instrument that is Simple, Reliable, and Valid. In National STEM Assessment Conference (pp. 202–208).

Ohland, M. W., Loughry, M. L., Woehr, D. J., Bullard, L. G., Felder, R. M., Finelli, C. J., … Schmucker, D. G. (2012). The comprehensive assessment of team member effectiveness: Development of a behaviorally anchored rating scale for self- and peer evaluation. Academy of Management Learning and Education, 11(4), 609–630.

Panadero, E., Romero, M., & Strijbos, J. W. (2013). The impact of a rubric and friendship on peer assessment: Effects on construct validity, performance, and perceptions of fairness and comfort. Studies in Educational Evaluation, 39(4), 195–203.

Peeters, M. A. G. (2006). The Big Five Personality Traits and Individual Satisfaction With the Team. Small Group Research, 37(2), 187–211.

Pounder, J. S. (2000). Evaluating the Relevance of Quality to Institutional Performance Assessment in Higher Education. Evaluation, 6(1), 66–78.

Propper, C., & Wilson, D. (2003). The Use and Usefulness of Performance Measures in the Public Sector. CMPO Working Paper, May(73).

Salas, E., Shuffler, M. L., Thayer, A. L., Bedwell, W. L., & Lazzara, E. H. (2015). Understanding and Improving Teamwork in Organizations: A Scientifically Based Practical Guide. Human Resource Management, 54(4), 599–622.

Schwarz, N., & Clore, G. (2003). Mood as Information: 20 Years Later. Psychological Inquiry, 14(3), 296–303.

Smith, N. K., Cacioppo, J. T., Larsen, J. T., & Chartrand, T. L. (2003). May I have your attention, please: Electrocortical responses to positive and negative stimuli. Neuropsychologia, 41(2), 171–183.

Sosik, J. J., & Jung, D. I. (2002). Work-group characteristics and performance in collectivistic and individualistic cultures. The Journal of Social Psychology, 142(1), 5–23.

The iTOFT Consortium. (2015). Work-based assessment of teamwork: an interprofessional approach. Canberra, Australia. Retrieved from

Thomas, E. J., Taggart, B., Crandell, S., Lasky, R. E., Williams, A. L., Love, L. J., … Helmreich, R. L. (2007). Teaching teamwork during the Neonatal Resuscitation Program: a randomized trial. Journal of Perinatology : Official Journal of the California Perinatal Association, 27(7), 409–414.

Topping, K. J. (2010). Methodological quandaries in studying process and outcomes in peer assessment. Learning and Instruction, 20(4), 339–343.

Tziner, A., & Kopelman, R. E. (2002). Is there a Preferred Performance Rating Format? A Non-psychometric Perspective. Applied Psychology: An International Review, 51(3), 479–503.

van Zundert, M., Sluijsmans, D., & van Merrienboer, J. (2010). Effective peer assessment processes: Research findings and future directions. Learning and Instruction, 20(4), 270–279.

Viswesvaran, C., Schmidt, F. L., & Ones, D. S. (2005). Is There a General Factor in Ratings of Job Performance? A Meta-Analytic Framework for Disentangling Substantive and Error Influences. Journal of Applied Psychology, 90(1), 108–131.

Wiese, D. S., & Buckley, M. R. (1998). The evolution of the performance appraisal process. Journal of Management History, 4(3), 233–249.

Wildman, J. L., Shuffler, M. L., Lazzara, E. H., Fiore, S. M., Burke, C. S., Salas, E., & Garven, S. (2012). Trust Development in Swift Starting Action Teams: A Multilevel Framework. Group & Organization Management, 37(2), 137–170.

Willey, K., & Gardner, A. (2009). Developing team skills with self- and peer assessment: Are benefits inversely related to team function? Campus-Wide Information Systems, 26(5), 365–378.

Zingoni, M., & Corey, C. M. (2016). How Mindset Matters. Journal of Personnel Psychology, Online pub, 1–10.


Copyright (c) 2017 Benjamin Heslop

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

International Journal of Human Resource Studies  ISSN 2162-3058


Copyright © Macrothink Institute  

To make sure that you can receive messages from us, please add the '' domain to your e-mail 'safe list'. If you do not receive e-mail in your 'inbox', check your 'bulk mail' or 'junk mail' folders.