3 Search Results for "Konstan, Joseph A."


Document
From Evaluating to Forecasting Performance: How to Turn Information Retrieval, Natural Language Processing and Recommender Systems into Predictive Sciences (Dagstuhl Perspectives Workshop 17442)

Authors: Nicola Ferro, Norbert Fuhr, Gregory Grefenstette, Joseph A. Konstan, Pablo Castells, Elizabeth M. Daly, Thierry Declerck, Michael D. Ekstrand, Werner Geyer, Julio Gonzalo, Tsvi Kuflik, Krister Lindén, Bernardo Magnini, Jian-Yun Nie, Raffaele Perego, Bracha Shapira, Ian Soboroff, Nava Tintarev, Karin Verspoor, Martijn C. Willemsen, and Justin Zobel

Published in: Dagstuhl Manifestos, Volume 7, Issue 1 (2018)


Abstract
We describe the state-of-the-art in performance modeling and prediction for Information Retrieval (IR), Natural Language Processing (NLP) and Recommender Systems (RecSys) along with its shortcomings and strengths. We present a framework for further research, identifying five major problem areas: understanding measures, performance analysis, making underlying assumptions explicit, identifying application features determining performance, and the development of prediction models describing the relationship between assumptions, features and resulting performance.

Cite as

Nicola Ferro, Norbert Fuhr, Gregory Grefenstette, Joseph A. Konstan, Pablo Castells, Elizabeth M. Daly, Thierry Declerck, Michael D. Ekstrand, Werner Geyer, Julio Gonzalo, Tsvi Kuflik, Krister Lindén, Bernardo Magnini, Jian-Yun Nie, Raffaele Perego, Bracha Shapira, Ian Soboroff, Nava Tintarev, Karin Verspoor, Martijn C. Willemsen, and Justin Zobel. From Evaluating to Forecasting Performance: How to Turn Information Retrieval, Natural Language Processing and Recommender Systems into Predictive Sciences (Dagstuhl Perspectives Workshop 17442). In Dagstuhl Manifestos, Volume 7, Issue 1, pp. 96-139, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2018)


Copy BibTex To Clipboard

@Article{ferro_et_al:DagMan.7.1.96,
  author =	{Ferro, Nicola and Fuhr, Norbert and Grefenstette, Gregory and Konstan, Joseph A. and Castells, Pablo and Daly, Elizabeth M. and Declerck, Thierry and Ekstrand, Michael D. and Geyer, Werner and Gonzalo, Julio and Kuflik, Tsvi and Lind\'{e}n, Krister and Magnini, Bernardo and Nie, Jian-Yun and Perego, Raffaele and Shapira, Bracha and Soboroff, Ian and Tintarev, Nava and Verspoor, Karin and Willemsen, Martijn C. and Zobel, Justin},
  title =	{{From Evaluating to Forecasting Performance: How to Turn Information Retrieval, Natural Language Processing and Recommender Systems into Predictive Sciences (Dagstuhl Perspectives Workshop 17442)}},
  pages =	{96--139},
  journal =	{Dagstuhl Manifestos},
  ISSN =	{2193-2433},
  year =	{2018},
  volume =	{7},
  number =	{1},
  editor =	{Ferro, Nicola and Fuhr, Norbert and Grefenstette, Gregory and Konstan, Joseph A. and Castells, Pablo and Daly, Elizabeth M. and Declerck, Thierry and Ekstrand, Michael D. and Geyer, Werner and Gonzalo, Julio and Kuflik, Tsvi and Lind\'{e}n, Krister and Magnini, Bernardo and Nie, Jian-Yun and Perego, Raffaele and Shapira, Bracha and Soboroff, Ian and Tintarev, Nava and Verspoor, Karin and Willemsen, Martijn C. and Zobel, Justin},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops-dev.dagstuhl.de/entities/document/10.4230/DagMan.7.1.96},
  URN =		{urn:nbn:de:0030-drops-98987},
  doi =		{10.4230/DagMan.7.1.96},
  annote =	{Keywords: Information Systems, Formal models, Evaluation, Simulation, User Interaction}
}
Document
Towards Performance Modeling and Performance Prediction across IR/RecSys/NLP (Dagstuhl Perspectives Workshop 17442)

Authors: Nicola Ferro, Norbert Fuhr, Gregory Grefenstette, and Joseph A. Konstan

Published in: Dagstuhl Reports, Volume 7, Issue 10 (2018)


Abstract
This reports briefly describes the organization and the plenary talks given during the Dagstuhl Perspectives Workshop 17442. The goal of this workshop was to investigate the state-of-the-art and to delineate a roadmap and research challenges for performance modeling and prediction in three neighbour domains, namely information retrieval (IR), recommender systems (RecSys), and natural language processing (NLP).

Cite as

Nicola Ferro, Norbert Fuhr, Gregory Grefenstette, and Joseph A. Konstan. Towards Performance Modeling and Performance Prediction across IR/RecSys/NLP (Dagstuhl Perspectives Workshop 17442). In Dagstuhl Reports, Volume 7, Issue 10, pp. 139-146, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2018)


Copy BibTex To Clipboard

@Article{ferro_et_al:DagRep.7.10.139,
  author =	{Ferro, Nicola and Fuhr, Norbert and Grefenstette, Gregory and Konstan, Joseph A.},
  title =	{{Towards Performance Modeling and Performance Prediction across IR/RecSys/NLP (Dagstuhl Perspectives Workshop 17442)}},
  pages =	{139--146},
  journal =	{Dagstuhl Reports},
  ISSN =	{2192-5283},
  year =	{2018},
  volume =	{7},
  number =	{10},
  editor =	{Ferro, Nicola and Fuhr, Norbert and Grefenstette, Gregory and Konstan, Joseph A.},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops-dev.dagstuhl.de/entities/document/10.4230/DagRep.7.10.139},
  URN =		{urn:nbn:de:0030-drops-86667},
  doi =		{10.4230/DagRep.7.10.139},
  annote =	{Keywords: Information Systems, Formal models, Evaluation, Simulation, User Interaction}
}
Document
Social Comparisons and Contributions to Online Communities: A Field Experiment on MovieLens

Authors: Yan Chen, Maxwell Harper, Joseph Konstan, and Sherry Li

Published in: Dagstuhl Seminar Proceedings, Volume 7271, Computational Social Systems and the Internet (2007)


Abstract
We explore the use of social comparison theory as a natural mechanism to increase contributions to an online movie recommendation community by investigating the effects of social information on user behavior in an online field experiment. We find that, after receiving behavioral information about the median user's total number of movie ratings, users below the median demonstrate a 530% increase in the number of monthly movie ratings, while those above the median decrease their monthly ratings by 62%. Movements from both ends converge towards the median, indicating conformity towards a newly-established social norm in a community where such a norm had been absent. Furthermore, the social information has a more dramatic effect on those below the median, suggesting an interaction between conformity and competitive preferences. When given outcome information about the average user's net benefit score from the system, consistent with social preference theory, users with net benefit scores above average contribute 94% of the new updates in the database. In both treatments, we find a highly significant Red Queen Effect.

Cite as

Yan Chen, Maxwell Harper, Joseph Konstan, and Sherry Li. Social Comparisons and Contributions to Online Communities: A Field Experiment on MovieLens. In Computational Social Systems and the Internet. Dagstuhl Seminar Proceedings, Volume 7271, pp. 1-7, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2007)


Copy BibTex To Clipboard

@InProceedings{chen_et_al:DagSemProc.07271.14,
  author =	{Chen, Yan and Harper, Maxwell and Konstan, Joseph and Li, Sherry},
  title =	{{Social Comparisons and Contributions to Online Communities: A Field Experiment on MovieLens}},
  booktitle =	{Computational Social Systems and the Internet},
  pages =	{1--7},
  series =	{Dagstuhl Seminar Proceedings (DagSemProc)},
  ISSN =	{1862-4405},
  year =	{2007},
  volume =	{7271},
  editor =	{Peter Cramton and Rudolf M\"{u}ller and Eva Tardos and Moshe Tennenholtz},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops-dev.dagstuhl.de/entities/document/10.4230/DagSemProc.07271.14},
  URN =		{urn:nbn:de:0030-drops-11550},
  doi =		{10.4230/DagSemProc.07271.14},
  annote =	{Keywords: Social comparison, conformity, public goods, embedded online field experiment}
}
  • Refine by Author
  • 2 Ferro, Nicola
  • 2 Fuhr, Norbert
  • 2 Grefenstette, Gregory
  • 2 Konstan, Joseph A.
  • 1 Castells, Pablo
  • Show More...

  • Refine by Classification

  • Refine by Keyword
  • 2 Evaluation
  • 2 Formal models
  • 2 Information Systems
  • 2 Simulation
  • 2 User Interaction
  • Show More...

  • Refine by Type
  • 3 document

  • Refine by Publication Year
  • 2 2018
  • 1 2007

Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail