Abstract

multimodal fusion Abstract: Motivated by the widespread adoption of social networks and the abundant availability of user-generated mul-timedia content, our purpose in this work is to investigate how the known principles of active learning for image classification fit in this newly developed context. The process of active learning can be fully automated in this social context by replacing the human oracle with the user tagged images obtained from social net-works. However, the noisy nature of user-contributed tags adds further complexity to the problem of sample selection since, apart from their informativeness, our confidence about their actual content should be also max-imized. The contribution of this work is on proposing a probabilistic approach for jointly maximizing the two aforementioned quantities with a view to automate the process of active learning. Experimental results show the superiority of the proposed method against various baselines and verify the assumption that significant performance improvement cannot be achieved unless we jointly consider the samples ’ informativeness and the oracle’s confidence. 1