RE/RS, Data Understanding (MM)

About The Team The Data Understanding team is responsible for creating the high quality datasets and their quantized representation for OpenAI. This includes synthesizing multimodal data, building VQ representations, and processing, filtering, deduplication, quality control, and tokenization so it can be used effectively in big model training runs. About The Role We’re looking to advance how OpenAI prepares, curates, synthesizes and understands multimodal data at scale. You’ll work on research and production problems like synthesizing multimodal content (images, audio, and video) and their supervisions, improving noisy data pipelines, building better quality filters, using models to automate data prep, and measuring whether changes in the dataset improve model performance. We Expect You To - Have a strong track record of new or improved ML ideas, through publications, projects, or applied research. - Own and drive a research agenda, from choosing the right multimodal data problems to carrying long-running work through to impact. - Be excited by OpenAI’s empirical, collaborative approach to research. Nice To Have - Experience with multimodal learning, audio, vision, video, synthetic... Click Apply to read the full job description.