Introduction

SMILE lab focuses on the frontier research of applied machine learning, social media analytics, human-computer interaction, and high-level image and video understanding. Our research is driven by the explosion of diverse multimedia from the Internet, personal or publicly available photos and videos. We start by treating fundamental theory from learning algorithm as the soul of machine intelligence and arm it with visual perception. What follows is a synergetic media learning system that not only actively collects massive visual information from the environment, but also processes and responds human interactively with precise analysis and possible suggestions. We approach visual problem "what is it?" but we are more interested in "what should we do?" or "what does it mean?" and hopefully tackle them by interacting with machines when data are in large-scale and parsing process is extremely complex, e.g., mining social relations among billions of images, recommending through visual cues, total understanding and early prediction of events and activities under social context.

Machine Learning

Data Mining

Computer Vision

Supported By

NSF
NIH
DoD
Air Force Office of Scientific Research
Army
DoHSS
IC
NEU
ONR
ARL
DARPA
IARPA
LincolnLab
Samsung
Google
Adobe
UB
ALERT

News

May

KDD 2016

We have 1 KDD 2016 paper accepted. Congratulations!

May

Søren Buus Research Award

Prof. Fu has received the Søren Buus Outstanding Research Award from Northeastern University.

Apr

Graduation!

2 Ph.D. students graduated! Congratulations to Dr. Ming Shao and Dr. Chengcheng Jia!

Apr

Funding

Prof. Fu as PI, NSF i-Corps, Facial image analysis system, $50k.

Apr

IJCAI 2016

We have 3 IJCAI 2016 papers accepted. All authors from SMILE Lab! Congratulations!

Apr

IP 2016

We have 2 IEEE Transactions on IP papers accepted for 2016 publishing.

Apr

Alumni Achievement

Prof. Fu has been selected as the recipient of the 2016 Young Alumni Achievement Award by the ECE Alumni Board of Directors at the University of Illinois at Urbana-Champaign.

Mar

Fundings

Prof. Fu as PI, Grainger Foundation Frontiers of Engineering Award from National Academy of Engineering, $30k.
Prof. Fu as PI, Mathworks, Video Classification and Prediction for Computer Vision Toolbox, $20k.
Prof. Fu as PI, NEU FY17 Tier 1, Dynamic Heterogeneous Information Networks for Intelligent Visual Forecasting, $50k.

Awards

2015 NEU Outstanding Graduate Student Award (Topmost student award in NEU) (Sheng Li)
ICDM 2014 NSF Student Travel Award (Zhengming Ding, Kang Li, and Sheng Li)
ACM MM 2014 Student Travel Award (Chengcheng Jia, Shuyang Wang, and Zhengming Ding)
DHS Homland Security- STEM Career Development Program fellowship award (Joseph Robinson)
Northeastern University’s ‘Huntington 100′ Award (Joseph Robinson)
ECE Department Senior Capstone Competition (1st Place) award (Joseph Robinson)
2014 SDM Best Paper Award from SIAM SDM! Only 1 out of 384 submissions! (Sheng Li and Prof. Fu)
CDSP Research Workshop Award for Best Poster award (Joseph Robinson)
IEEE and ECE Department Winner for T-shirt Design Contest (Joseph Robinson)
ACM MM 2014 Student Travel Award (Chengcheng Jia, Shuyang Wang, and Zhengming Ding)