Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

Gotong Royong in NLP Research: A Mobile Tool for Collaborative Text Annotation in Indonesia

Abstract: 

The absence of manually annotated training data presents an obstacle for the development of machine-learning based NLP tools in Indonesia. Existing annotation tools lack a mobile-friendly interface which is a problem in Indonesia where most users access the internet using their smartphone. In this paper we propose the first mobile collaborative data annotation tool and evaluate it in an experiment involving 15 Indonesian students who annotated 1500 data records using their smartphones. Users confirmed
the responsiveness and good usability. Using the mobile tool tend to annotate data in multiple short sessions of 7-15 minutes rather than in a single long one. Future research could examine ways to increase inter-annotator agreement, which was moderate in our experiment.

up
0 users have voted:

Paper Details

Authors:
Lisa Madlberger, Ayu Purwarianti
Submitted On:
21 November 2016 - 10:49pm
Short Link:
Type:
Presentation Slides
Event:
Presenter's Name:
Ade Romadhony
Paper Code:
46
Document Year:
2016
Cite

Document Files

presentation_IALP2016_46.pdf

(130 downloads)

Subscribe

[1] Lisa Madlberger, Ayu Purwarianti, "Gotong Royong in NLP Research: A Mobile Tool for Collaborative Text Annotation in Indonesia ", IEEE SigPort, 2016. [Online]. Available: http://sigport.org/1290. Accessed: Oct. 23, 2017.
@article{1290-16,
url = {http://sigport.org/1290},
author = {Lisa Madlberger; Ayu Purwarianti },
publisher = {IEEE SigPort},
title = {Gotong Royong in NLP Research: A Mobile Tool for Collaborative Text Annotation in Indonesia },
year = {2016} }
TY - EJOUR
T1 - Gotong Royong in NLP Research: A Mobile Tool for Collaborative Text Annotation in Indonesia
AU - Lisa Madlberger; Ayu Purwarianti
PY - 2016
PB - IEEE SigPort
UR - http://sigport.org/1290
ER -
Lisa Madlberger, Ayu Purwarianti. (2016). Gotong Royong in NLP Research: A Mobile Tool for Collaborative Text Annotation in Indonesia . IEEE SigPort. http://sigport.org/1290
Lisa Madlberger, Ayu Purwarianti, 2016. Gotong Royong in NLP Research: A Mobile Tool for Collaborative Text Annotation in Indonesia . Available at: http://sigport.org/1290.
Lisa Madlberger, Ayu Purwarianti. (2016). "Gotong Royong in NLP Research: A Mobile Tool for Collaborative Text Annotation in Indonesia ." Web.
1. Lisa Madlberger, Ayu Purwarianti. Gotong Royong in NLP Research: A Mobile Tool for Collaborative Text Annotation in Indonesia [Internet]. IEEE SigPort; 2016. Available from : http://sigport.org/1290