Annotation and Quality Assurance Specialist (Linguistics Background)

Sófia, Bulgaria
Full Time
Entry Level
Description

Who is Defined.ai? Well, from a technical point of view, we leverage the power of a global crowd to provide some of the world’s biggest companies with the high-quality data they need to power their artificial intelligence. We’re instrumental to the progression and development of artificial intelligence and we couldn’t be prouder or more inspired to be involved in an industry that is changing the world.
From a personal point of view, we’re a group of big thinkers, high achievers and creative problem solvers. We bond over our shared love of software engineering, data science, and strong coffee. We like online gaming, running marathons, and team drinks. We celebrate authenticity and diversity and we’re invested in what we do. Our mission? World domination, obviously!

Who are we looking for?

We are seeking a highly detail-oriented and experienced Annotation and Quality Assurance Specialist to join our Platform team in Sofia. This crucial role focuses on ensuring the high quality and accuracy of the data used to train and evaluate our cutting-edge AI and machine learning models. The ideal candidate will have to collaborate in complex data annotation projects and perform rigorous quality assurance checks on our platform. 

Key Responsibilities 
  • Data Annotation: Perform detailed annotation, labeling, and categorization of various types of data (text, speech, images, etc.) according to project-specific guidelines. 

  • Quality Assurance (QA): Conduct thorough QA checks on annotated data, identifying and correcting errors, inconsistencies, and adherence to established standards. 

  • Stakeholder Collaboration: Collaborate effectively with product managers, engineers, and researchers, contributing to multiple projects simultaneously and adapting to evolving priorities. 

  • Guideline Development: Contribute to the refinement and development of clear and comprehensive annotation guidelines by providing linguistic insights and feedback. 

  • Training & Calibration: Participate in calibration sessions to maintain high inter-annotator agreement and train new team members on annotation tasks and tools. 

  • Tool Expertise: Become an expert user of our internal annotation platform, reporting bugs and suggesting improvements for better efficiency and quality. 

  • Linguistic Analysis: Apply deep knowledge of language structure, semantics, and pragmatics to resolve complex or ambiguous annotation cases. 

Required Skills & Experience 
  • Education: Bachelor's or Master's degree in Linguistics, Computational Linguistics, Translation, or a related field. 

  • Experience: Proven professional experience in data annotation, data labeling, or quality assurance, preferably within a technology or AI/ML environment. 

  • Linguistic Proficiency: Native or near-native fluency in English (required). 

  • Analytical Skills: Exceptional attention to detail and a highly organized approach to work, capable of following complex rules and documentation. 

  • Technical Aptitude: Comfortable working with various software tools, spreadsheets, and web-based platforms. 


Desirable Skills 
  • Multilingualism: Fluency or working proficiency in one or more additional languages (German, Spanish, French, Arabic, etc.).

  • Computational Experience: Familiarity with programming/scripting (Python) or experience with large-scale data processing. 

  • Industry Knowledge: Previous experience with Natural Language Processing (NLP), Machine Learning, or AI data pipeline


Benefits
You spend a lot of your time at work, so it should be challenging, fun and interesting. At Defined.ai it will be all of those things and more. Here’s what we offer:

  • Flexible working schedule and hybrid model. We know comfort can boost creativity and performance, so you can manage your schedule and work both from one of our modern office spaces or home.
  • Excellent career development opportunities in a high growth company. With us, you can accomplish your career goals and follow a well-described career path with the support of your supervisor.
  • Culture of feedback and continuous improvement. AI is a fast-paced area, so we keep track of tech trends, and we always ask for feedback.
  • An international and diverse team. We have more than 30 nationalities at our 3 locations, and we provide language classes.
  • Continuous training opportunities. You can choose from many options: leveraging hand-on workshops, unlimited access to Coursera and formal development opportunities.
  • We love to have fun together. We joke a lot, and we can't imagine work without fun activities – we already surfed, raced carts and played soccer together.


About Us

Defined.ai offers a platform with multiple data delivery options that leverages machine learning technology and human intelligence to deliver quality-guaranteed training data for AI systems. The platform offers self-service and fully customizable solutions that deliver high-quality project-specific training data, enabling AI products reach market quicker. It is this business model that has allowed Defined.ai to raise a total of $63.6M in funding over 4 rounds. Our value proposition is quality, privacy, speed and scale, covering more than 50 different languages. With strong expertise in speech and natural language processing technologies, we have been serving AI companies and Fortune 500 companies since day one. Defined.ai was founded in Seattle and has offices in Lisbon.

Privacy Notice: defined.ai/candidate-privacy-statement

Share

Apply for this position

Required*
We've received your resume. Click here to update it.
Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or Paste resume

Paste your resume here or Attach resume file

Human Check*