ESWA An Information Retrieval Benchmarking Model of Satisficing and Impatient Users’ Behavior in Online Search Environments [Source Code]

  1. Debora Di Caprio 2
  2. Francisco Javier Santos Arteaga 1
  3. Madjid Tavana 3
  1. 1 Universidad Complutense de Madrid
    info

    Universidad Complutense de Madrid

    Madrid, España

    ROR 02p0gd045

  2. 2 University of Trento
    info

    University of Trento

    Trento, Italia

    ROR https://ror.org/05trd4x28

  3. 3 La Salle University
    info

    La Salle University

    Filadelfia, Estados Unidos

    ROR https://ror.org/02beve479

Mostrar afiliaciones +
Revista:
Expert Systems with Applications

ISSN: 0957-4174

Año de publicación: 2021

Tipo: Artículo

DOI: 10.1016/J.ESWA.2021.116352 GOOGLE SCHOLAR

Otras publicaciones en: Expert Systems with Applications

Resumen

This study analyzes the effects that the position of the alternatives ranked by a search engine and the relative impatience of users have on their information retrieval behavior. We design a stochastic information retrieval algorithm calibrated to mimic the click-through rates (CTRs) of users observed in real-life environments. We introduce two versions of the mimicking algorithm designed to demonstrate the importance of impatience as a determinant of CTRs conditioned by the alternatives’ ranking position. The first version assumes that users proceed sequentially through the ranking until they find an alternative satisficing their expectations. Once they find a satisficing alternative, they continue retrieving information until they observe an alternative that violates their expectations. The second version increases users’ impatience, who stop retrieving information as soon as an alternative does not satisfy their expectations – even if it is the top-ranked one. All three algorithmic structures are sufficiently malleable to incorporate any potential modification to users’ beliefs and preferences. We simulate sets of 1,000,000 queries to illustrate how the CTRs of the top three ranked alternatives remain stable as users grow impatient, with differences widening as growingly impatient users proceed halfway through the ranking.

Referencias bibliográficas

  • Ahn, J. H., Bae, Y. S., Ju, J., & Oh, W. (2018). Attention adjustment, renewal, and equilibrium seeking in online search: An eye-tracking approach. Journal of Management Information Systems, 35, 1218–1250.
  • Bae, S., & Lee, T. (2011). Product type and consumers’ perception of online consumer reviews. Electronic Markets, 21, 255–266.
  • Baeza-Yates, R. Applications of web query mining. In: Losada, D.E., Fernandez-Luna, ´ J. M. (Eds.). Advances in Information Retrieval. Information Systems and Applications, incl. Internet/Web, and HCI, Vol. 3408. Springer-Verlag, Berlin Heidelberg, 7-22 (2005).
  • Bartels, D. M., & Johnson, E. J. (2015). Connecting cognition and consumer choice. Cognition, 135, 47–51.
  • Basu, S. (2018). Information search in the internet markets: Experience versus search goods. Electronic Commerce Research and Applications, 30, 25–37.
  • Bell, D., & Mgbemena, C. (2018). Data-driven agent-based exploration of customer behavior. Simulation, 94, 195–212.
  • Bolandifar, E., DeHoratius, N., Olsen, T., & Wiler, J. (2019). An empirical study of the behavior of patients who leave the emergency department without being seen. Journal of Operations Management, 65, 430–446.
  • Chitika: The value of Google result positioning. Chitika Insights June 7, 2013. Chitika, Westborough (2013) Available at perma.cc/7AGC-HTDH.
  • Cristofaro, M. (2017). Herbert Simon’s bounded rationality: Its historical evolution in management and cross-fertilizing contribution. Journal of Management History, 23, 170–190.
  • Dean, B. (2019). We analyzed 5 million Google search results. Here’s what we learned about organic click through rate. Available at https://backlinko.com/google-ctrstats.
  • Dell’Aversana, R., & Bucciarelli, E. (2018). Towards a natural experiment leveraging big data to analyse and predict users’ behavioural patterns within an online consumption setting. In International Symposium on Distributed Computing and Artificial Intelligence 2018 Jun 20 (pp. 103–113).
  • Dimoka, A., Hong, Y., & Pavlou, P. A. (2012). On product uncertainty in online markets: Theory and evidence. MIS Quarterly, 36, 395–426.
  • Doniec, A., Lecoeuche, S., Mandiau, R., & Sylvain, A. (2020). Purchase intention-based agent for customer behaviours. Information Sciences, 521, 380–397.
  • Dou, W., Lim, K. H., Su, C., Zhou, N., & Cui, N. (2010). Brand positioning strategy using search engine marketing. MIS Quarterly, 34, 261–279.
  • Dunke, F., & Nickel, S. (2020). Neural networks for the metamodeling of simulation models with online decision making. Simulation Modelling Practice and Theory, 99, Article 102016.
  • Epstein, R., & Robertson, R. E. (2015). The Search Engine Manipulation Effect (SEME) and its possible impact on the outcomes of elections. Proceedings of the National Academy of Sciences, 112, E4512–E4521.
  • European Commission: Online platforms. (2016). Special Eurobarometer 447- April 2016. European Union.
  • Fishkin, R. (2019). Less than half of Google searches now result in a click, Aug. 13, Available at https://sparktoro.com/blog/less-than-half-of-google-searches-now-re sult-in-a-click/.
  • Gao, R., & Shah, C. (2020). Toward creating a fairer ranking in search engine results. Information Processing & Management, 57, Article 102138.
  • Ghafurian, M., Reitter, D., & Ritter, F. E. (2020). Countdown timer speed: A trade-off between delay duration perception and recall. ACM Transactions on Computer-Human Interaction (TOCHI), 27, 1–25.
  • Google: The need for mobile speed: How mobile latency impacts publisher revenue. September (2016). Available at https://www.thinkwithgoogle.com/intl/en-154/insi ghts-inspiration/research-data/need-mobile-speed-how-mobile-latency-impacts-p ublisher-revenue/.
  • Gupta, S., Kar, A. K., Baabdullah, A., & Al-Khowaiter, W. A. (2018). Big data with cognitive computing: A review for the future. International Journal of Information Management, 42, 78–89.
  • Hong, W., Xiong, Z., You, J., Wu, X., & Xia, M. (2021). CPIN: Comprehensive presentinterest network for CTR prediction. Expert Systems with Applications, 168, Article 114469. https://doi.org/10.1016/j.eswa.2020.114469
  • Jankowski, J., Kazienko, P., Wątrobski, ´ J., Lewandowska, A., Ziemba, P., & Zioło, M. (2016). Fuzzy multi-objective modeling of effectiveness and user experience in online advertising. Expert Systems with Applications, 65, 315–331.
  • Jansen, M. B. J., Spink, A., Bateman, J., & Saracevic, T. (1998). Real life information retrieval: A study of user queries on the web. ACM SIGIR Forum, 32, 5–17.
  • Karanam, S., van Oostendorp, H., & Fu, W. T. (2016). Performance of computational cognitive models of web-navigation on real websites. Journal of Information Science, 42, 94–113.
  • Khamitov, M., Wang, X., & Thomson, M. (2019). How well do consumer-brand relationships drive customer brand loyalty? Generalizations from a meta-analysis of brand relationship elasticities. Journal of Consumer Research, 46, 435–459.
  • Kimmel, A. J. (2012). Psychological foundations of marketing. Routledge.
  • Kreye, M. E., Goh, Y. M., Newnes, L. B., & Goodwin, P. (2012). Approaches to displaying information to assist decisions under uncertainty. Omega, 40, 682–692.
  • Laura´eus, T., Saarinen, T., & O¨orni, ¨ A.: Factors affecting consumer satisfaction of online purchase. In: 48th Hawaii International Conference on System Sciences, Kauai, HI, 2015, 3364-3373. doi: 10.1109/HICSS.2015.406.
  • Lee, H., & Pang, N. (2018). Understanding the effects of task and topical knowledge in the evaluation of websites as information patch. Journal of Documentation, 74, 162–186.
  • Lerner, J. S., Li, Y., Valdesolo, P., & Kassam, K. S. (2015). Emotion and decision making. Annual Review of Psychology, 66, 799–823.
  • Lewandowski, D., & Kammerer, Y. (2020). Factors influencing viewing behaviour on search engine results pages: A review of eye-tracking research. Behaviour & Information Technology, 1–31. https://doi.org/10.1080/0144929X.2020.1761450
  • Li, G., Huang, J. Z., & Shen, H. (2018). To wait or not to wait: Two-way functional hazards model for understanding waiting in call centers. Journal of the American Statistical Association, 113, 1503–1514.
  • Lieder, F., & Griffiths, T. L. (2020). Resource-rational analysis: Understanding human cognition as the optimal use of limited computational resources. Behavioral and Brain Sciences, 43, E1. https://doi.org/10.1017/S0140525X1900061X
  • List, A., & Alexander, P.A. (2017) Text navigation in multiple source use. Computers in Human Behavior 75, 364-375.
  • Liu, Y., Miao, J., Zhang, M., Ma, S., & Ru, L. (2011). How do users describe their information need: Query recommendation based on snippet click model. Expert Systems with Applications, 38, 13847–13856.
  • Lohr, S. (Feb. 29, 2012). For impatient web users, an eye blink is just too long to wait. The New York Times, Available at https://www.nytimes.com/2012/03/01/tech nology/impatient-web-users-flee-slow-loading-sites.html.
  • Lorigo, L., Haridasan, M., Brynjarsdottir, ´ H., Xia, L., Joachims, T., Gay, G., … Pan, B. (2008). Eye tracking and online search: Lessons learned and challenges ahead. Journal of the American Society for Information Science and Technology, 59, 1041–1052.
  • Lu, W., & Altenbek, G. (2021). A recommendation algorithm based on fine-grained feature analysis. Expert Systems with Applications, 163, Article 113759. https://doi.org/10.1016/j.eswa.2020.113759
  • Lu, A. C. C., & Gursoy, D. (2015). A conceptual model of consumers’ online tourism confusion. International Journal of Contemporary Hospitality, 27, 1320–1342.
  • Luo, W., Cook, D., & Karson, E. J. (2011). Search advertising placement strategy: Exploring the efficacy of the conventional wisdom. Information & Management, 48, 404–411.
  • Misuraca, R., & Fasolo, B. (2018). Maximizing versus satisficing in the digital age: Disjoint scales and the case for “construct consensus”. Personality and Individual Differences, 121, 152–160.
  • Machackova, H., & Smahel, D. (2018). The perceived importance of credibility cues for the assessment of the trustworthiness of online information by visitors of healthrelated websites: The role of individual factors. Telematics and informatics, 35, 1534–1541.
  • Mahony, C., Sammon, D., & Heavin, C. (2016). Design guidelines for online resources: A longitudinal analysis of information processing. Journal of Decision Systems, 25, 329–342.
  • Nah, F. F. (2004). A study on tolerable waiting time: How long are web users willing to wait? Behaviour & Information Technology, 23, 153–163.
  • Norman, K. L., & Kirakowski, J. (Eds.). (2017). The Wiley handbook of human computer interaction. John Wiley & Sons.
  • Ong, K., J¨ arvelin, K., Sanderson, M., & Scholer, F. (2017). Using information scent to understand mobile and desktop web search behavior. In Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval (pp. 295–304).
  • Pei, S., & Hu, Q. (2018). Partially monotonic decision trees. Information Sciences, 424, 104–117.
  • Pirolli, B. (2018). Travel information online: Navigating correspondents, consensus, and conversation. Current Issues in Tourism, 21, 1337–1343.
  • Ren, H., & Huang, T. (2018). Modeling customer bounded rationality in operations management: A review and research opportunities. Computers & Operations Research, 91, 48–58.
  • Richardson, R. C. (2017). Heuristics and satisficing. In: W. Bechtel and G. Graham (Eds.) A companion to cognitive science. John Wiley & Sons, pp. 566-575. https://doi.org/10.1002/9781405164535.ch44.
  • Sadiq, S., Umer, M., Ullah, S., Mirjalili, S., Rupapara, V., & Nappi, M. (2021). Discrepancy detection between actual user reviews and numeric ratings of Google App store using deep learning. Expert Systems with Applications, 181, Article 115111. https://doi.org/10.1016/j.eswa.2021.115111
  • Sagi, O., & Rokach, L. (2020). Explainable decision forest: Transforming a decision forest into an interpretable tree. Information Fusion, 61, 124–138.
  • Schneider, M., Deck, C., Shor, M., Besedeˇs, T., & Sarangi, S. (2019). Optimizing choice architectures. Decision Analysis, 16, 2–30.
  • Shafiq, O., Alhajj, R., & Rokne, J. G. (2015). On personalizing Web search using social network analysis. Information Sciences, 314, 55–76.
  • Speier-Pero, C. (2019). Using aggregated data under time pressure: A mechanism for coping with information overload. Journal of Decision Systems, 28, 82–100.
  • Sun, H., Fan, M., & Tan, Y. (2020). An empirical analysis of seller advertising strategies in an online marketplace. Information Systems Research, 31, 37–56.
  • Varnali, K., Yilmaz, C., & Toker, A. (2012). Predictors of attitudinal and behavioral outcomes in mobile advertising: A field experiment. Electronic Commerce Research and Applications, 11, 570–581.
  • Victorelli, E. Z., Dos Reis, J. C., Hornung, H., & Prado, A. B. (2020). Understanding human-data interaction: Literature review and recommendations for design. International Journal of Human-Computer Studies, 134, 13–32.
  • Yoo, B., Jeon, S., & Han, T. (2016). An analysis of popularity information effects: Field experiments in an online marketplace. Electronic Commerce Research and Applications, 17, 87–98.
  • Zhang, J., Adomavicius, G., Gupta, A., & Ketter, W. (2020). Consumption and performance: Understanding longitudinal dynamics of recommender systems via an agent-based simulation framework. Information Systems Research, 31, 76–101.
  • Zillinger, M. (2020). The curious case of online information search. Current Issues in Tourism, 23, 276–279.
  • Zhu, F., & Zhang, X. (2010). Impact of online consumer reviews on sales: The moderating role of product and consumer characteristics. Journal of Marketing, 74, 133–148.