Data Annotators

About the Project.

The Jordan Open Source Association (JOSA) is seeking (4) data annotators to support the development of an open source AI model designed to detect and classify hateful content on social media platforms in the Arabic language.

The model will serve as an AI-assisted content moderation tool for civil society organizations, media organizations, and newsrooms managing social media pages, particularly on Facebook and Instagram. The tool is being developed for the MENA region and Arabic-language online spaces, with a focus on Levantine (Shami) dialect.

The overall goal of the project is to use AI to develop an innovative and practical moderation tool that contributes to creating safer and more inclusive online spaces across the MENA region, by enabling more effective identification and moderation of hateful content on social media.

Tasks and Responsibilities

• Attend a full-day training covering technology facilitated violence, online hate speech, social media monitoring, the annotation platform, and the annotation guidelines, process, and tools.

• Support the team in conducting a social media monitoring of specific pre-identified accounts and identify posts that include instances of online hateful content.

• Annotate approximately 41,000 comments in total, with each comment independently annotated by two annotators, distributed equally among on-board data annotators, in accordance with the annotation guidelines.

• Incorporate revisions based on feedback from the lead annotator.

• Complete all assigned annotation tasks within the agreed timeline.

Requirements

• Fluent in Arabic language (mother tongue) and Levantine (Shami) dialect.

• Professional or educational knowledge/ experience in Journalism, Media and News Rooms, Activism, or other related fields.

• Proven knowledge or experience in technology facilitated violence, hate speech, and social media monitoring.

• Previous experience in desk research skills.

• Regular users of social media platforms.

• Preferably between 22 and 45 years of age, reflecting the demographic most exposed to online hate speech.

• Ability to work accurately, objectively, and adhere to strict deadlines.

Notes:

• A random quality check of annotated comments will be conducted by the Lead Annotator to identify inconsistencies and minimize annotation bias.

• Annotators will receive 25 Jordanian Dinars (JOD) for every 1,000 approved annotations completed.

• Payments will be made according to a fixed schedule or alternatively as a single payment upon completion of all assigned annotations.

• Payments are subject to 5% withholding tax, in accordance with applicable regulations.

• Amendments and corrections requested during the quality assurance process will not be counted as additional annotations.

• Annotators must submit an invoice at least 10 working days before the payment date. Payments are processed on the 15th and 25th of each month.

• Annotators are encouraged to use their own laptops for the annotation tasks.

How to Apply:

You can apply directly through this link:

• English Application Form: https://surveys.josa.ngo/index.php/713394?newtest=Y&lang=en

• Arabic Application Form: https://surveys.josa.ngo/index.php/713394?newtest=Y&lang=ar