1 Search Results for "Esmeli, Ramazan"

Document
DOI: 10.4230/OASIcs.ICCSW.2018.4
Comparison of Platforms for Recommender Algorithm on Large Datasets

Authors: Christina Diedhiou, Bryan Carpenter, and Ramazan Esmeli

Published in: OASIcs, Volume 66, 2018 Imperial College Computing Student Workshop (ICCSW 2018)

Abstract
One of the challenges our society faces is the ever increasing amount of data. Among existing platforms that address the system requirements, Hadoop is a framework widely used to store and analyze "big data". On the human side, one of the aids to finding the things people really want is recommendation systems. This paper evaluates highly scalable parallel algorithms for recommendation systems with application to very large data sets. A particular goal is to evaluate an open source Java message passing library for parallel computing called MPJ Express, which has been integrated with Hadoop. As a demonstration we use MPJ Express to implement collaborative filtering on various data sets using the algorithm ALSWR (Alternating-Least-Squares with Weighted-lambda-Regularization). We benchmark the performance and demonstrate parallel speedup on Movielens and Yahoo Music data sets, comparing our results with two other frameworks: Mahout and Spark. Our results indicate that MPJ Express implementation of ALSWR has very competitive performance and scalability in comparison with the two other frameworks.
Cite as

Christina Diedhiou, Bryan Carpenter, and Ramazan Esmeli. Comparison of Platforms for Recommender Algorithm on Large Datasets. In 2018 Imperial College Computing Student Workshop (ICCSW 2018). Open Access Series in Informatics (OASIcs), Volume 66, pp. 4:1-4:10, Schloss Dagstuhl – Leibniz-Zentrum für Informatik (2019)

Copy BibTex To Clipboard

@InProceedings{diedhiou_et_al:OASIcs.ICCSW.2018.4,
  author =	{Diedhiou, Christina and Carpenter, Bryan and Esmeli, Ramazan},
  title =	{{Comparison of Platforms for Recommender Algorithm on Large Datasets}},
  booktitle =	{2018 Imperial College Computing Student Workshop (ICCSW 2018)},
  pages =	{4:1--4:10},
  series =	{Open Access Series in Informatics (OASIcs)},
  ISBN =	{978-3-95977-097-2},
  ISSN =	{2190-6807},
  year =	{2019},
  volume =	{66},
  editor =	{Pirovano, Edoardo and Graversen, Eva},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops-dev.dagstuhl.de/entities/document/10.4230/OASIcs.ICCSW.2018.4},
  URN =		{urn:nbn:de:0030-drops-101852},
  doi =		{10.4230/OASIcs.ICCSW.2018.4},
  annote =	{Keywords: HPC, MPJ Express, Hadoop, Spark, Mahout}
}
  • Refine by Author
  • 1 Carpenter, Bryan
  • 1 Diedhiou, Christina
  • 1 Esmeli, Ramazan

  • Refine by Classification
  • 1 Information systems → Database management system engines

  • Refine by Keyword
  • 1 HPC
  • 1 Hadoop
  • 1 MPJ Express
  • 1 Mahout
  • 1 Spark

  • Refine by Type
  • 1 document

  • Refine by Publication Year
  • 1 2019

Questions / Remarks / Feedback
X

Feedback for Dagstuhl Publishing


Thanks for your feedback!

Feedback submitted

Could not send message

Please try again later or send an E-mail
© 2023-2024 Schloss Dagstuhl – LZI GmbH Imprint Privacy Contact