Machine Learning-Based Model for Visualization Memorability Prediction

Authors

  • Kevin Choi Boston College
  • Sangyoon Bae Seoul National University College of Engineering

DOI:

https://doi.org/10.47611/jsr.v13i4.2725

Keywords:

Visualization, machine learning, memorability, deep-learning, hybrid model, metadata analysis

Abstract

Creating impactful visualizations is essential for effectively conveying complex data insights. However, current visualization techniques often fall short in ensuring that the data remains memorable and easily understandable. This research addresses this problem by investigating the factors that influence the memorability of visualizations, with the purpose of enhancing how key insights are retained and utilized. The main hypothesis is that combining visual content with simple textual metadata can predict and improve the memorability of visualizations. Our study introduces a web-based system powered by deep learning to predict memorability, analyzing both visual elements and textual descriptors, such as recognizable objects. The model assigns a memorability score based on these inputs. Results show that the hybrid model, integrating image and metadata analysis, provides accurate memorability predictions. The system offers designers immediate feedback, enabling them to iteratively refine their visualizations. This data-driven approach supports the creation of more memorable visual content, enhancing information retention and impact.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

References or Bibliography

Borkin, Michelle A., et al. (2013). "What Makes a Visualization Memorable?" IEEE Transactions on Visualization and Computer Graphics, 19(12). https://doi.org/10.1109/TVCG.2013.234.

Harrison, Lane, et al. (2015). "Infographic Aesthetics: Designing for the First Impression." Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. https://doi.org/10.1145/2702123.2702545.

Khosla, Aditya, et al. (2015). "Understanding and Predicting Image Memorability at a Large Scale." Proceedings of the IEEE International Conference on Computer Vision. https://doi.org/10.1109/ICCV.2015.275.

Luo, Yuzhong, et al. (2018). "Deepeye: Towards Automatic Data Visualization." 2018 IEEE 34th International Conference on Data Engineering (ICDE). https://doi.org/10.1109/ICDE.2018.00020.

Stanislaw, Harold, and Natasha Todorov. (1999). "Calculation of Signal Detection Theory Measures." Behavior Research Methods, Instruments, & Computers, 31(1). https://doi.org/10.3758/BF03207704.

Published

11-30-2024

How to Cite

Choi, K., & Bae, S. (2024). Machine Learning-Based Model for Visualization Memorability Prediction. Journal of Student Research, 13(4). https://doi.org/10.47611/jsr.v13i4.2725

Issue

Section

Research Articles