Job
- Level
- Experienced
- Job Field
- Data
- Employment Type
- Full Time
- Contract Type
- Permanent employment
- Location
- Vienna
- Working Model
- Hybrid, Onsite
Job Summary
In this role, you will manage the curation of human feedback and the development of high-quality synthetic data, significantly enhancing model performance through innovative evaluation studies and improvements.
Job Technologies
Your role in the team
- In dieser grundlegenden Rolle sind Sie der Experte dafür, was unsere Modelle antreibt: Daten.
- You will be responsible for the end-to-end lifecycle of our datasets, from curating nuanced human feedback on design quality to pioneering the use of machine learning for high-quality synthetic data generation.
- You will design the sophisticated human evaluation studies and experiments that measure our success, and you will be the key analyst who translates signals from automated evaluators into a deep understanding of our models' alignment with human taste and intent.
- Human Feedback Data Curation: Owning the processing, cleaning, and strategic curation of large-scale, subjective human feedback on design quality, which is the lifeblood of our models.
- Synthetic Data Generation: Using generative AI and machine learning techniques to create novel, high-quality synthetic data that augments our training sets and improves model capabilities.
- Alignment Analysis & Evaluation Design: Designing methods to analyze outputs from both human and automated systems to deeply understand and measure our models' alignment with user preferences.
- Design and build scalable pipelines for processing and curating large datasets of human design feedback.
- Develop ML models to generate high-quality synthetic data for training and fine-tuning.
- Own the design and implementation of human evaluation workflows, including creating guidelines and quality rubrics.
- Prepare datasets for automated evaluation systems and analyze their outputs to provide a robust signal on model performance and human alignment.
- Design and analyze experiments (including A/B tests) to measure the real-world impact of our models on design quality.
- Conduct deep-dive analyses into model performance to identify failure modes and guide future development.
This text has been machine translated. Show original
Our expectations of you
Qualifications
- A strong aesthetic sense, with a background or demonstrated passion for visual design or human-computer interaction.
- Strong proficiency in Python and ML frameworks (e.g., PyTorch, TensorFlow).
- Solid understanding of statistical methods, including experimental design, A/B testing, and quality evaluation systems.
- Familiarity with data annotation tools is a plus.
Experience
- Experience with generative AI and synthetic data generation is highly desirable.
This text has been machine translated. Show original
Benefits
Health, Fitness & Fun
- 🤫Relaxation Rooms
- ⚽️Tabletop Soccer, etc.
- 🎮Gaming Room
- 🧠Mental Health Care
- 🚲Bicycle Parking Space
- 🎳Team Events
- 🙂Health Care Benefits
Work-Life-Integration
- 🕺No Dresscode
- 🙅♂️No All-In Contracts
- 🏠Home Office
- ⏰Flexible Working Hours
- 🚌Excellent Traffic Connections
Food & Drink
More net
Job Locations
Location Vienna
Ungargasse 37
1030 Wien
Austria
Topics that you deal with on the job
This is your employer
Canva Austria GmbH.
Wien
By making complicated tech simple, we strive to enable individuals and businesses of all sizes to benefit from the recent advances in Visual AI. Our tools simplify and accelerate workflows, foster creativity, and enable others to create new products.
Description
- Company Size
- 50-249 Employees
- Founding year
- 2018
- Language
- English
- Company Type
- Startup
- Working Model
- Hybrid, Onsite
- Industry
- Internet, IT, Telecommunication
Research Engineer - Datasets
- Location
- Vienna
- Working Model
- Hybrid, Onsite
