Experimental Research and its Application in the Development of Knowledge in Management

Document Type : Original Research Paper

Authors

1 Ph.D. Student in Systems Management, Faculty of Management and Economics, Imam Hossein University, Tehran, Iran

2 Assistant Professor, Department of Business Management, Faculty of Management, University of Tehran, Tehran, Iran

3 Ph.D. Student in Human Resource Management, Faculty of Management and Accounting, Allameh Tabataba'i University, Tehran, Iran

Abstract

The environment of business organizations and institutions is constantly fluctuating and changing, so it is unavoidable to employ new ways of creating and developing managerial knowledge. Experimental research methodology has been one of the important research methods for investigating and improving organizational issues; and its use in social and behavioral sciences such as sociology, psychology, economics, and management has grown significantly in recent years. Laboratory studies are one of the main types of experimental researches conducted in a controlled environment, to investigate the causal relationship and control the disturbing variables. Their application has led to the development of knowledge in various branches of management including organizational behavior, human resource management, advertising and consumer behavior, behavioral operations management, behavioral strategy, and behavioral economics. Despite the worldwide development of experimental research applications and knowledge accumulation in the international management literature, their recognition, and application in domestic research seems to have received less attention. The purpose of this study is to systematically review the related literature and identify the main concepts of this research method and its functions in management using the Delphi method. According to the research findings, 11 categories and over 30 related concepts have been identified. The main categories include experimental research nature and its types, manipulation of variables, control, repeatability, validity, and ethics in experimental research. The findings of this study can be exploited by researchers in different areas of management in order to identify and develop the applications of a new methodology in management knowledge creation.

Keywords

References

American Psychological Association (2014). "statistical control" in APA Dictionary of Psychology. Retrieved from: https://dictionary.apa.org/statistical-control.
Anderson, D. M., & Edwards, B. C. (2015). Unfulfilled Promise: Laboratory experiments in public management research. Public Management Review, 17(10): 1518-1542.
Antonakis, J., Bendahan, S., Jacquart, P., & Lalive, R. (2010). On making causal claims: A review and recommendations. The leadership quarterly, 21(6): 1086-1120.
Ares, G., Mawad, F., Giménez, A., & Maiche, A. (2014). Influence of rational and intuitive thinking styles on food choice: Preliminary evidence from an eye-tracking study with yogurt labels. Food Quality and Preference, 31: 28-37.
Aronson, E., Brewer, M., & Carlsmith, J. M. (1985). Experimentation in social psychology. In G. Lindzey, & E. Aronson (Vol. Eds.), Handbook of social psychology (3rd ed.). Vol. 1. Hoboken, New Jersey: John Wiley & Sons.
Asch, S. (1951). Effects of group pressure upon the modification and distortion of judgment. In H. Guetzkow (Ed.), Groups, leadership, and men (pp. 177–190). Pittsburgh, PA: Carnegie Press.
Berger, P. D., Maurer, R. E., & Celli, G. B. (2018). Experimental Design with Applications in Management, Engineering, and the Sciences. Second Edition. Cham, Switzerland: Springer.
Bollard, T., Maubach, N., Walker, N., & Mhurchu, C. N. (2016). Effects of plain packaging, warning labels, and taxes on young people’s predicted sugar-sweetened beverage preferences: an experimental study. International Journal of Behavioral Nutrition and Physical Activity. 13(95): 1-7.
Brosig‐Koch, J., Hennig‐Schmidt, H., Kairies‐Schwarz, N., & Wiesen, D. (2015). The Effects of Introducing Mixed Payment Systems for Physicians: Experimental Evidence. Health Economics. 26(2): 243- 262.
Camerer, C. F. (2015). The promise and success of lab-field generalizability in experimental economics: A critical reply to Levitt and List. In G. Fréchette, & A. Schotter (Eds.). Handbook of experimental economic methodology (pp. 249–295). Oxford, UK: Oxford University Press.
Cartwright, D., & Zander, A. F. (1953). Group dynamics: Research and theory. New York: Harper & Row.
Castelli, M., Dobreva, M., Henriques, R., & Vanneschi, L. (2020). Predicting Days on Market to Optimize Real Estate Sales Strategy. Complexity. Volume 2020., Article ID 4603190.
Çelebi, E. (2018). Measuring the Effectiveness of Organizational Public Relations: An Experimental Research on Crisis Response Strategies. Journal of Communication Theory & Research, 46: 275- 290.
Chamberlin, E. H. (1948). An experimental imperfect market. Journal of Political Economy, 56, 95–108.
Charness, G., Gneezy, U., & Kuhn, M. A. (2012). Experimental methods: Between-subject and within-subject design. Journal of Economic Behavior & Organization. 81: 1- 8.
Chatterji, A., Findley, M., & Jensen, N. M., Meier, S., & Nielson, D. L., Field Experiments in Strategy Research. IZA Discussion Papers, No. 8705, Institute for the Study of Labor (IZA), Bonn.
Chu, H., & Hwang, G.J. (2008). A Delphi-based approach to developing expert systems with the cooperation of multiple experts. Expert Systems with Applications, 34(4): 2826- 40.
Colquitt, J. A. (2008). From the editors: Publishing laboratory research in AMJ: A question of when, not if. Academy of Management Journal, 51: 616–620.
Crano, W. D., Brewer, M. B., & Lac, A. (2015). Principles and methods of social research (3rd ed.). New York, NY: Routledge.
Creswell, J. W. (2014). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. Sage. CA. USA.
Croson, R., Schultz, K., Siemsen, E. & Yeo, M.L. (2013). Behavioral operations: the state of the field. Journal of Operations Management, 31(1-2): 1-5.
Croson, R., Anand, J., Agarwal, R. (2007). Using experiments in corporate strategy research. European Management Review, 4: 173- 181.
Curtis, M.J., Bond, R.A., Spina, D., Ahluwalia, A., Alexander, S.P., Giembycz, M.A., Gilchrist, A., Hoyer, D., Insel, P.A., Izzo, A.A., Lawrence, A.J., MacEwan, D.J., Moon, L.D., Wonnacott, S., Weston, A.H., & McGrath, J.C. (2015). Experimental design and analysis and their reporting: new guidance for publication in BJP. British Journal of Pharmacology, 172(14): 3461- 71.
Davis, A. M., & Hyndman, K. (2019). Multidimensional bargaining and inventory risk in supply chains: An experimental study. Management Science, 65(3): 1286-1304.
Erjavec, J. & Trkman, P. (2018). Behavioral operations management: identification of its research program. International Journal of Services and Operations Management, In press.
Ertac, S., & Gurdal, M. Y. (2019). Preference Communication and leadership in group decision-making. Journal of Behavioral and Experimental Economics. 80: 130- 140.
Fairweather, G. W., & Tornatzky, L. G. (2013). Experimental Methods for Social Policy Research. Oxford. England: Pergamon Press.
Feng, T., & Zhang, Y. (2017). Modeling strategic behavior in the competitive newsvendor problem: an experimental investigation. Production and Operations Management, 26(7): 1383-1398.
Festinger, L., & Carlsmith, J. M. (1959). Cognitive consequences of forced compliance. Journal of Abnormal and Social Psychology, 58: 203–210.
Fisher, R. A. (1935). The design of experiments. London: Oliver & Boyd.
Fry, M., & Burr, G. (2001). Using the Delphi technique to design a self-reporting triage survey tool. Accident and Emergency Nursing, 9(4): 235-241.
Gartner, S. S., Bangerter, J., Goncz, Z., Sarver, M., & Schreffler, N. (2019). An experimental study of the role of gender in selecting third-party mediators in crisis resolution. In Research Handbook on Mediating International Crises. Massachusetts, USA: Edward Elgar Publishing.
Goodman, C. M (1987). The Delphi technique: a critique. Journal of Advanced Nursing, 12: 729-734.
Grant, A. M., & Wall, T. D. (2009). The neglected science and art of quasi experimentation: Why-to, when-to, and how-to advice for organizational researchers. Organizational Research Methods, 12, 653–686.
Grunewald, M., Hammermann, A., & Placke, B. (2017). Human Resource Management and Nudging: An Experimental Analysis on Goal Settings in German Companies. International Journal of Economics and Finance. 9(9): 147- 156.
Harrison, G. W., & List, J. A. (2004). Field experiments. Journal of Economic Literature, 42: 1009–1055.
Hasson, F., Keeney, S., & McKenna, H. (2000). Research guidelines for the Delphi survey technique. Journal of Advanced Nursing, 3: 1008–1015.
Hauser, O. P., Linos, E., & Rogers, T. (2017). Innovation with field experiments: Studying organizational behaviors in actual organizations. Research in organziational behavior, 37: 185- 198.
He, H., Martinsson, P., & Sutter, M. (2012). Group decision making under risk: An experiment with student couples. Economics Letters. 117(3): 691- 693.
Heifetz, R., Grashow, A., & Linsky, M. (2009). Run Experiments: Leading Adaptive Change with an Experimental Mindset. Chapter from The Practice of Adaptive Leadership: Tools and Tactics for Changing Your Organization and the World. London: Harvard Business Publishing Education.
Hendijani, R. (2019). Behavioral Operations Management: A Review of the Field. Journal of Psychological Research. 1(3): 12- 30.
Hendijani, R., & Bischak, D. P. (2016). The effect of social relationships on the rates of referral to specialists. International Journal of Operations & Production Management. 36(4): 384- 407.
Hendijani, R., Bischak, D. P., Arvai, J., & Dugar, S. (2016). Intrinsic motivation, external reward, and their effect on overall motivation and performance. Human Performance, 29(4): 251-274.
Hill, K. Q. & Fowles, J. (1975). The methodological worth of the Delphi forecasting technique. Technological Forecasting and Social Change, 7: 193-194.
Hoewe, J. (2017). Manipulation Check. The International Encyclopedia of Communication Research Methods. NJ: USA: JohnWiley & Sons.
Hsu. C. H., & Sandford, B. A. (2008). The Delphi technique: making sense of consensus. Retrieved from: http://pareonline.net/pdf/v12n10.pdf.
Jackson, M., Cox, D.R. (2013). The Principles of Experimental Design and Their Application in Sociology. Annual Review of Sociology. 39: 27-49.
Jones, J., & Hunter, D. (1995). Onsensus methods for medical and health services research. British Medical Journal, 311: 376–380.
Jairath, N., & Weinstein, J. (1994). The Delphi methodology: a useful administrative approach. Canadian Journal of Nursing Administration, 7: 29–42.
Katok, E. (2011). Laboratory experiments in operations management. In Transforming Research into Action. Published online: 03 Sep 2014; 15-35
Kaur, B., & Sharma, R. R. (2018). Impact of viral advertising on product promotion: An experimental study. Indian Journal of Marketing, 48(6), 57-68.
Kennedy, H.P. (2004) Enhancing Delphi research: methods and results. Journal of Advanced Nursing, 45(5): 504-11.
Kidwell, L. A., & Lowensohn, S. (2011). A review and assessment of behavioral accounting research in government. Journal of accounting literature. the official journal of the Fisher School of Accounting, 30: 41- 67.
Kirk, R. E. (2014). Research Strategies and the Control of Nuisance Variables In: Experimental Design: Procedures for the Behavioral Sciences. California: USA: SAGE Publications.
Koschate-Fischer, N., & Schandelmeier, S. (2014). A guideline for designing experimental studies in marketing research and a critical discussion of selected problem areas. Journal of Business Economics, 84(6): 793-826.
Krauth, J. (2000). Experimental Design: A Handbook and Dictionary for Medical and Behavioral Research. London: UK: Elsevier.
Landeta J. (2006). Current validity of the Delphi method in social sciences. Technological Forecasting and Social Change, 73(5): 467-82.
Langlands, R.L., Jorm, A.F., Kelly, C.M., Kitchener, B.A. (2008) First aid for depression: a Delphi consensus study with consumers, carers and clinicians. Journal of Affective Disorders, 105(1-3): 157-165.
Libby, R., Bloomfield, R., & Nelson, M. E. (2002). Experimental research in financial accounting. Accounting, Organizations and Society, 27(8): 775- 810.
Leibbrandt, A. (2020). Behavioral constraints on price discrimination: Experimental evidence on pricing and customer antagonism. European Economic Review.121: 103303.
Loch, C. H., & Wu, Y. (2007). Behavioral operations management. Foundations and Trends® in Technology, Information and Operations Management, 1(3): 121-232.
Loman, T. (2003). Matching Procedures in Field Experiments. Institute of Applied Research. Retrieved from: http://capacitybuilding.net/Matching%20Procedures%20in%20Field%20Experiments.pdf.
McKenna, H.; Hasson, F. & Smith, M. (2002). A Delphi survey of midwives and midwifery students to identify non-midwifery duties. Midwifery, 18 (4): 314-322.
Mekler, E. D., Brühlmann, F., Tuch, A. N., & Opwis, K. (2017). Towards understanding the effects of individual gamification elements on intrinsic motivation and performance. Computers in Human Behavior, 71: 525- 534.
Penczynski, S. P. (2016). Strategic thinking: The influence of the game. Journal of Economic Behavior & Organization. 128: 72-84.
Thomas-Hunt, M.C., Ogden, T. Y and Neale, M A. (2003) Who's really sharing? Effects of social and expert status on knowledge exchange within groups. Management Science, 49(4): 464-477.
Okoli, C. & Pawlowski, S. D. (2004). The Delphi method as a research tool: an example, design considerations and applications. Information and Management, 42 (1): 15-29.
Pesendorfer, Wolfgang. (2006). Behavioral Economics Comes of Age: A Review Essay on Advances in Behavioral Economics. Journal of Economic Literature, 44 (3): 712-721.
Podsakoff, P. M., Podsakoff, N. P. (2019). Experimental designs in management and leadership research: Strengths, limitations, and recommendations for improving publishability. The Leadership Quarterly. 30 (1): 11- 33.
Powell, C. (2003). The Delphi technique: myths and realities. Journal of Advanced Nursing, 41(4): 376-382.
Rowe, E. (1994) Enhancing Judgement and Decision Making: a critical and empirical investigation of the Delphi technique. Unpublished PhD Thesis, University of Western England, Bristol.
Ryals, L., and Wilson, H. (2005). Experimental Methods in Market Research: From Information to Insight. International Journal of Market Research. 47(4): 345- 364.
Sagie, A., Elizur, D., and Koslowsky, M. (2009). Decision type, participative decision making (PDM), and organizational behavior: An experimental simulation. Human Performance. 8(2): 81- 94.
Salterio, S. E., & Gondowijoyo, P. M. (2017). “Moving beyond the lab”: Building on experimental accounting researchers' core competencies to expand methodological diversity in accounting research. The Routledge Companion to Behavioral Research in Accounting. Chapter 12, Forthcoming. February 2, 2016.
Sayinzoga, A., Bulte, E. H., & Lensink, R. (2014). Financial Literacy and Financial Behaviour: Experimental Evidence from Rural Rwanda. The Economic Journal. 126(594): 1571- 1599.
Saunders, M., Lewis, P., & Thornhill, A. (2009). Research methods for business students. Fifth edition. Harlow: Pearson Education.
Shaw S. (2020) The Influence of Thinking Styles on Perceived Price Fairness: An Experimental Study. In: Rocha Á., Reis J., Peter M., Bogdanović Z. (eds) Marketing and Smart Technologies. Smart Innovation, Systems and Technologies, vol 167. Singapore: Springer.
Sherif, M. (1948). An outline of social psychology. New York: Harper & Brothers.
Siegel, S., & Fouraker, L. E. (1960). Bargaining and group decision making. New York: McGraw- Hill.
Sparf, J., Petridou, E., Skog, F., Kolmodin, S., & Ljungdahl, J. (2019). Experimental Design in Teaching Crisis and Emergency Management in Social Sciences: The Case of the RCR Lab at Mid Sweden University. International Journal of Mass Emergencies & Disasters, 37(1).
Stefano, G. D., Gutierrez, C. (2018). Under a magnifying glass: On the use of experiments in strategy research. Strategic Organization. 17(4): 497- 507.
Sunder S. (2007). What Have We Learned From Experimental Finance? In: Oda S.H. (eds) Developments on Experimental Economics. Lecture Notes in Economics and Mathematical Systems, New York: Springer.
Thau, S., Pitesa, M., & Pillutla, M. M. (2014). Experiments in organizational behavior. Laboratory Experiments in the Social Sciences. 433-447. Research Collection Lee Kong Chian School of Business.
Thomke, S. (2001). Enlightened Experimentation: The New Imperative for Innovation. Harvard business review. 79(2): 66- 75.
Thomke, S. (2020). Building a Culture of Experimentation. Harvard business review. March–April 2020 Issue. Retrieved from: https://hbr.org/2020/03/productive-innovation
Turley, L. W., & Milliman, R. E. (2000). Atmospheric Effects on Shopping Behavior: A Review of the Experimental Evidence. Journal of Business Research. 49(2): 193- 211.
Von Neumann, J., & Morgenstern, O. (1944). Theory of games and economic behavior. Princeton, NJ: Princeton University Press.
Wagner, N., Quimbo, S., Shimkhada, R., & Peabody, J. (2018). Does health insurance coverage or improved quality protect better against out-of-pocket payments? Experimental evidence from the Philippines. Social Science & Medicine. 204: 51-58.
Weber, M., Duffy, J., & Schram, A. (2018). An Experimental Study of Bond Market Pricing. The Journal of Finance. 73(4): 1857-1892.
Webster, M., Sell, J. (2014). Laboratory Experiments in the Social Sciences. Second edition. London: U: Elsevier.
Wundt, W. (1911). Grundriss der Psychologie. 10th Edition. (First Edition 1896). Engelmann, Leipzig: Verlag von Wilhelm.

Files

History

  • Receive Date: 22 March 2020
  • Revise Date: 28 April 2020
  • Accept Date: 07 July 2020

Share

How to cite

Statistics