Sorry, you need to enable JavaScript to visit this website.

Gotong Royong in NLP Research: A Mobile Tool for Collaborative Text Annotation in Indonesia

Error message

  • The specified file temporary://fileScWtEg could not be copied, because the destination directory is not properly configured. This may be caused by a problem with file or directory permissions. More information is available in the system log.
  • The specified file temporary://file8jkzqY could not be copied, because the destination directory is not properly configured. This may be caused by a problem with file or directory permissions. More information is available in the system log.
  • The specified file temporary://fileNTHHog could not be copied, because the destination directory is not properly configured. This may be caused by a problem with file or directory permissions. More information is available in the system log.
  • The specified file temporary://fileWg1gWB could not be copied, because the destination directory is not properly configured. This may be caused by a problem with file or directory permissions. More information is available in the system log.
  • The specified file temporary://filemlqNkB could not be copied, because the destination directory is not properly configured. This may be caused by a problem with file or directory permissions. More information is available in the system log.
  • The specified file temporary://file5C3ZwW could not be copied, because the destination directory is not properly configured. This may be caused by a problem with file or directory permissions. More information is available in the system log.
  • The specified file temporary://fileUmQFt7 could not be copied, because the destination directory is not properly configured. This may be caused by a problem with file or directory permissions. More information is available in the system log.
  • The specified file temporary://fileZUMYur could not be copied, because the destination directory is not properly configured. This may be caused by a problem with file or directory permissions. More information is available in the system log.
  • The specified file temporary://filexs5SK0 could not be copied, because the destination directory is not properly configured. This may be caused by a problem with file or directory permissions. More information is available in the system log.
Citation Author(s):
Lisa Madlberger, Ayu Purwarianti
Submitted by:
Ade Romadhony
Last updated:
21 November 2016 - 10:49pm
Document Type:
Presentation Slides
Document Year:
2016
Event:
Presenters:
Ade Romadhony
Paper Code:
46
 

The absence of manually annotated training data presents an obstacle for the development of machine-learning based NLP tools in Indonesia. Existing annotation tools lack a mobile-friendly interface which is a problem in Indonesia where most users access the internet using their smartphone. In this paper we propose the first mobile collaborative data annotation tool and evaluate it in an experiment involving 15 Indonesian students who annotated 1500 data records using their smartphones. Users confirmed
the responsiveness and good usability. Using the mobile tool tend to annotate data in multiple short sessions of 7-15 minutes rather than in a single long one. Future research could examine ways to increase inter-annotator agreement, which was moderate in our experiment.

up
0 users have voted: