Abusive language dataset annotation workshop

Presentation of insights and needs for a new offensive language corpora annotation – new taxonomy.

Annotation guidelines with examples of annotations – each participant will receive printed guidelines. (prepared by Barbara Lewandowska-Tomaszczyk, Slavko Žitnik, Anna Bączkowska, Giedre Valunaite Oleskevicienė,  Chaya Liebeskind, Jelena Mitrovič)

Searching for the translations of the offensive language categories from English to native languages of participants – Google Sheet.

Offensive language corpora overview and preparation of data for the annotation campaign.

General introduction into annotation campaigns (annotation tools, process, annotators, curators, monitoring, inter-rater agreement)

Hands-on tutorial on how to use INCEpTION annotation tool for the task of offensive language annotation – each participant will receive a username and password.

Giedre Valunaite Oleskevicienė, Slavko Žitnik

Live annotation of the prepared corpora using the INCEpTION tool.

Offering guidance and support during the annotation, discussing different options for the annotation – may result in annotation guidelines update.

Review of annotation activities during the workshop.

Gathering interest and plan by the interested participants – how much time are they prepared to invest for the annotation after the workshop. Decision on deadlines, collaborative communication means – mailing list.

Barbara Lewandowska-Tomaszczyk

Open discussion and closing.