演講主題：On Evaluation Dilemmas in Social Media Research

演講者：Prof. Huan Liu

Data Mining and Machine Learning Lab
School of Computing, Informatics, and Decision Systems Engineering
Arizona State University, Tempe, Arizona
http://www.public.asu.edu/~huanliu

演講時間：10/6 (四) 10:00~11:30
演講地點： 工程三館345室

Abstract (摘要)

Social media data is steeped with user-generated content and social information. Most of user-generated content can be text and multimedia. Social media is a new source of data and therefore, social media research faces novel challenges. We discuss one of such challenges - evaluation dilemmas. One evaluation dilemma is that there is often no ground truth in evaluating research findings of social media. Without ground truth, how can we perform credible and reproducible evaluation? Another associated dilemma is that we frequently resort to crowdsourcing mechanisms such as Amazon’s Mechanical Turk for evaluation tasks. It costs even if a small group of Turkers is employed.  Is it too small? Large-scale evaluation could be very costly. Can we find alternative ways of evaluation that are more objective, reproducible, or scalable? We use case studies to illustrate these dilemmas and show how to overcome associated challenges in mining big social media data.

Short Bio (演講者簡介)

Dr. Huan Liu is a professor of Computer Science and Engineering at Arizona State University. He obtained his Ph.D. in Computer Science at University of Southern California. He was recognized for excellence in teaching and research in Computer Science and Engineering at Arizona State University. His research interests are in data mining, machine learning, social computing, and artificial intelligence, investigating problems that arise in real-world applications with high-dimensional data of disparate forms. His well-cited publications include books, book chapters, encyclopedia entries as well as conference and journal papers. He serves on journal editorial/advisory boards and numerous conference program committees. He is a Fellow of IEEE and a member of several professional societies.