Large Margin Metric Learning for Multi-label Prediction
Ivor Tsang
Associate Professor
University of Technology, Sydney
Abstract: Canonical correlation analysis(CCA)and maximum margin output coding(MMOC) methods have shown promising results for multi-label prediction, where each instance is associated with multiple labels.However,these methods require an expensive decoding procedure to recover the multipie labels of each testing instance. The testing complexity becomes unbearable when there are many labels.To avoid decoding completely, we present a novel large margin metric learning paradigm for multi-label prediction.Particularly,the proposed method learns a distance metric to discover label dependency such that instances with very different multiple labels will be moved far away. To handle many labels, we further present
an accelerated proximal gradient procedure to speed up the learning process.Comprehensive experiments demonstrate that our proposed method is significantly faster than CCA and MMOC in terms of both training and testing complexities. Moreover,our method achieves superior prediction performance compared with state-of-the-art methods.
Bio: Ivor W Tsang is a Future Fellow and Associate Professor with the Centre for Quantum Computation&Intelligent Systems(QCIS), at the University of Technology, Sydney. His research focuses on kernel methods, transfer learning, feature selection, big data analytics for data with trillions of dimensions, and their applications to computer vision and pattern recognition.He has more than 100 research papers published in top-tier journals and conference proceedings.Dr Tsang was conferred the 2008 NaturaI Science Award(Class 11)by Ministry of Education,China. In 2013, Dr Tsang received his prestigious AustraIian Research Council Future Fellowship for his research regarding Machine Learning on Big Data. He had received the prestigious IEEE Transactions on Neural Networks Outstanding 2004 Paper Award in 2007, the 2014 IEEE Transactions on Multimedia Prize Paper Award, the Best Student Paper Award at CVPR 2010, and the Best Paper Award at ICTAI 2011. Dr Tsang is currently serving as an Area Chair at NIPS 2015 and Senior Program Committee at IJCAl 2011—2015.