Journal of Advances in Technology and Engineering Research
Details
Journal ISSN: 2414-4592
Article DOI: https://doi.org/10.20474/jater-2.5.3
Received: 03 August 2016
Accepted: 10 September 2016
Published: 27 October 2016
Download Article (PDF)
  • Batch size for training convolutional neural networks for sentence
    classification


Nabeel Zuhair Tawfeeq Abdulnabi, Oğuz Altun

Published online: 2016

Abstract

Sentence classification of shortened text such as single sentences of movie review is a hard subject because of the limited finite information that they normally contain. We present a Convolutional Neural Network (CNN) architecture and better hyper-parameter values for learning sentence classification with no preprocessing on small sized data. The CNN used in this work have multiple stages. First the input layer consist of sentence concatenated word embedding. Then followed by convolutional layer with different filter sizes for learning sentence level features, followed by max-pooling layer which concatenate features to form final feature vector. Lastly a softmax classifier is used. In our work we allow network to handle arbitrarily batch size with different dropout ratios, which is gave us an excellent way to regularize our CNN and block neurons from co-adapting and impose them to learn useful features. By using CNN with multi filter sizes we can detect specific features such as existence of negations like “not amazing”. Our approach achieves state-of-the-art result for sentence sentiment prediction in both binary positive/negative classification.