Trailer Brain: Neural and Behavioral Analysis of Social Issue Documentary Viewing with Low-Density EEG

Authors Jason S. Sherwin, Corinne Brenner, John S. Johnson



PDF
Thumbnail PDF

File

OASIcs.CMN.2016.2.pdf
  • Filesize: 27.77 MB
  • 21 pages

Document Identifiers

Author Details

Jason S. Sherwin
Corinne Brenner
John S. Johnson

Cite AsGet BibTex

Jason S. Sherwin, Corinne Brenner, and John S. Johnson. Trailer Brain: Neural and Behavioral Analysis of Social Issue Documentary Viewing with Low-Density EEG. In 7th Workshop on Computational Models of Narrative (CMN 2016). Open Access Series in Informatics (OASIcs), Volume 53, pp. 2:1-2:21, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2016)
https://doi.org/10.4230/OASIcs.CMN.2016.2

Abstract

The effects of social issue documentaries are diverse. In particular, monetary donations and advocacy on social media are behavioral effects with public consequences. Conversely, information-seeking about an issue is potentially done in private. We designed a combined free-viewing and rapid perceptual decision-making experiment to simulate a real scenario confronted by otherwise uninformed movie-viewers, i.e., to determine what degree of support they will lend to a film based on its trailer. For a cohort of subjects with active video-streaming (e.g., Netflix) and social media accounts (e.g., Facebook), we recorded electroencephalography (EEG) and behavioral responses to trailers of social issue documentaries. We examined EEG using reliable component analysis (RCA), finding reliability within subjects across multiple viewings and across subjects within a given viewing of the same trailer. We found this reliability both over EEG captured from whole-movie viewing, as well as over 5-second movie segments. Behavioral responses following trailer viewing were not consistent from first to second viewings. Rather, support choices both tended towards extremes of support/non-support and were made faster upon second viewing. We hypothesized a relationship between reliability behavioral metrics, finding credible evidence for it in this dataset. Finally, we found that we could suitably train a naive classifier to categorize production value and narrative voice ratings given to the viewed movies from RCA-based metrics alone. In sum, our results show that EEG components during free-viewing of social issue documentary trailers can provide a useful tool to investigate viewers' neural responses during viewing, when coupled with a post hoc behavioral decision-making paradigm. The possibility of this tool being used by producers and filmmakers is also discussed.
Keywords
  • EEG
  • reliable components analysis
  • machine learning
  • documentary films

Metrics

  • Access Statistics
  • Total Accesses (updated on a weekly basis)
    0
    PDF Downloads

References

  1. D. H. Brainard. The Psychophysics Toolbox. Spatial Vision, 1997. Google Scholar
  2. Simon Carlile. Psychoacoustics. In The Sonification Handbook, pages 41-61. Logos Verlag, 2011. Google Scholar
  3. J. P. Dmochowski, M. A. Bezdek, B. P. Abelson, J. S. Johnson, E. H. Schumacher, and L. C. Parra. Audience preferences are predicted by temporal reliability of neural processing. Nat Commun, 5:4567, 2014. URL: http://dx.doi.org/10.1038/ncomms5567.
  4. J. P. Dmochowski, A. S. Greaves, and A. M. Norcia. Maximally reliable spatial filtering of steady state visual evoked potentials. NeuroImage, 2014. URL: http://arxiv.org/pdf/1407.6110.pdf, URL: http://dx.doi.org/10.1016/j.neuroimage.2014.12.078.
  5. J. P. Dmochowski, P. Sajda, J. Dias, and L. C. Parra. Correlated components of ongoing EEG point to emotionally laden attention - a possible marker of engagement? Front Hum Neurosci, 6:112, 2012. URL: http://dx.doi.org/10.3389/fnhum.2012.00112.
  6. M. M. Farbood, D. J. Heeger, G. Marcus, U. Hasson, and Y. Lerner. The neural processing of hierarchical structure in music and speech at different timescales. Front Neurosci, 9:157, 2015. URL: http://dx.doi.org/10.3389/fnins.2015.00157.
  7. Hugo Fastl and Eberhard Zwicker. Psychoacoustics: Facts and models. Springer, 2007. http://arxiv.org/abs/arXiv:1011.1669v3, URL: http://dx.doi.org/10.1007/978-3-540-68888-4.
  8. J. Finsterwalder, V. G. Kupppelwieser, and M. de Villiers. The effects of film trailers on shaping consumer expectations in the entertainment industry - A qualitative analysis. Journal of Retailing and Consumer Services, 2012. URL: http://dx.doi.org/10.1016/j.jretconser.2012.07.004.
  9. O. Furman, U. Hasson, L. Davachi, Y. Dudai, and N. Dorfman. They saw a movie: long-term memory for an extended audiovisual narrative. Learn Memory, 14(6):457-467, 2007. Google Scholar
  10. U. Hasson, O. Furman, D. Clark, Y. Dudai, and L. Davachi. Enhanced intersubject correlations during movie viewing correlate with successful episodic encoding. Neuron, 57(3):452-462, 2008. URL: http://dx.doi.org/10.1016/j.neuron.2007.12.009.
  11. U. Hasson, A. A. Ghazanfar, B. Galantucci, S. Garrod, and C. Keysers. Brain-to-brain coupling: a mechanism for creating and sharing a social world. Trends Cogn Sci, 16(2):114-121, 2012. URL: http://dx.doi.org/10.1016/j.tics.2011.12.007.
  12. U. Hasson, Y. Nir, I. Levy, G. Fuhrmann, and R. Malach. Intersubject synchronization of cortical activity during natural vision. Science, 303(5664):1634-1640, 2004. URL: http://dx.doi.org/10.1126/science.1089506.
  13. U. Hasson, E. Yang, I. Vallines, D. J. Heeger, and N. Rubin. A hierarchy of temporal receptive windows in human cortex. J Neurosci, 28(10):2539-2550, 2008. URL: http://dx.doi.org/10.1523/JNEUROSCI.5487-07.2008.
  14. Christopher J. Honey, Thomas Thesen, Tobias H. Donner, Lauren J. Silbert, Chad E. Carlson, Orrin Devinsky, Werner K. Doyle, Nava Rubin, David J. Heeger, and Uri Hasson. Slow Cortical Dynamics and the Accumulation of Information over Long Timescales. Neuron, 76(2):423-434, 2012. URL: http://dx.doi.org/10.1016/j.neuron.2012.08.011.
  15. W. D. Hoyer and S. P. Brown. Effects of Brand Awareness on Choice for a Common, Repeat Purchase Product. Journal of Consumer Research, 17:141-148, 1990. Google Scholar
  16. Laurent Itti. Automatic foveation for video compression using a neurobiological model of visual attention. IEEE Transactions on Image Processing, 13(10):1304-1318, 2004. URL: http://dx.doi.org/10.1109/TIP.2004.834657.
  17. D. Jerrick. The Effectiveness of Film Trailers: Evidence from the College Student Market. UW-L, Journal of Undergraduate Research, XVI, 2013. Google Scholar
  18. J. Kato, H. Ide, I. Kabashima, H. Kadota, K. Takano, and K. Kansaku. Neural correlates of attitude change following positive and negative advertisements. Front Behav Neurosci, 3:6, 2009. URL: http://dx.doi.org/10.3389/neuro.08.006.2009.
  19. D. R. J. Laming. Information theory of choice-reaction times. Academic Press, 1968. URL: http://dx.doi.org/10.1002/bs.3830140408.
  20. Baojuan Li, Xiang Wang, Shuqiao Yao, Dewen Hu, and Karl Friston. Task-dependent modulation of effective connectivity within the default mode network. Frontiers in Psychology, 3(JUN), 2012. URL: http://dx.doi.org/10.3389/fpsyg.2012.00206.
  21. Weisi Lin and C. C. Jay Kuo. Perceptual visual quality metrics: A survey. Journal of Visual Communication and Image Representation, 22(4):297-312, 2011. URL: http://dx.doi.org/10.1016/j.jvcir.2011.01.005.
  22. E. K. Macdonald and B. Sharp. Brand Awareness Effects on Consumer Decision Making for a Common, Repeat Purchase Product:: A Replication. Journal of Business Research, 2000. URL: http://dx.doi.org/10.1016/S0148-2963(98)00070-8.
  23. M.Vranjes, S. Rimac-Drlje, and O. Nemcic. Influence of foveated vision on video quality perception. 2009 International Symposium ELMAR, pages 28-30, 2009. Google Scholar
  24. Bill Nichols. Introduction to documentary. Indiana University Press, 2001. http://arxiv.org/abs/arXiv:1011.1669v3, URL: http://dx.doi.org/10.1017/CBO9781107415324.004.
  25. S. Nichter. Vote Buying or Turnout Buying? Machine Politics and the Secret Ballot. American Political Science Review, 102(1):19-31, 2008. Google Scholar
  26. E. Qualman. Socialnomics: How Social Media Transforms the Way We Live and Do Business. Wiley, 2012. Google Scholar
  27. Marcus E. Raichle. The Brain’s Default Mode Network. Annual review of neuroscience, 38:433-447, 2015. URL: http://dx.doi.org/10.1146/annurev-neuro-071013-014030.
  28. Mor Regev, Christopher J. Honey, Erez Simony, and Uri Hasson. Selective and invariant neural responses to spoken and written narratives. The Journal of Neuroscience, 33(40):15978-88, 2013. URL: http://dx.doi.org/10.1523/JNEUROSCI.1580-13.2013.
  29. Lior Rokach and Oded Maimom. Data mining with decision trees: theory and applications. Springer, 2007. URL: http://dx.doi.org/10.1007/978-0-387-09823-4.
  30. G. J. Stephens, L. J. Silbert, and U. Hasson. Speaker-listener neural coupling underlies successful communication. Proc Natl Acad Sci U S A, 107(32):14425-14430, 2010. URL: http://dx.doi.org/10.1073/pnas.1008662107.
  31. HI storypilot. https://storypilot.org/. Accessed: 2016-05-02.
  32. Zhou Wang and Qiang Li. Video quality assessment using a statistical model of human visual speed perception. Journal of the Optical Society of America. A, Optics, image science, and vision, 24:B61-B69, 2007. URL: http://dx.doi.org/10.1364/JOSAA.24.000B61.
  33. Stefan Winkler, Animesh Sharma, and D. McNally. Perceptual video quality and blockiness metrics for multimedia streaming applications. ... Wireless Personal Multimedia ..., 2001. URL: http://stefan.winkler.net/Publications/wpmc2001.pdf.
  34. J. R. Zhang, J. Dmochowski, P. Sajda, J. R. Kender, and J. Sherwin. Correlating speaker gestures in political debates with audience engagement measured via EEG. In ACM Multimedia 2014, Orlando, FL, USA, 2014. Google Scholar
Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail