Quelle:
Für dieses Angebot liegt keine vollständige Übersetzung in der gewählten Sprache vor. Unten sehen Sie den Originalinhalt.
Research Engineer - Pre-training Data
Prime Intellect
San Francisco, Vereinigte Staaten
Publication date: 14/11/2026
Build the data behind Prime Intellect's next generation of open models. You'll find valuable sources, turn them into training-ready corpora, and work with researchers to test what actually improves the model. Your work will shape both broad pre-training and the data used to develop reasoning, coding, and long-context capabilities.
Responsibilities
Find, evaluate, and collect valuable training data from web, code, and technical sources; Build scalable pipelines that turn raw data into training-ready corpora through extraction, cleaning, deduplication, and filtering; Develop checks for data quality, coverage, and contamination, and use them to improve collection and processing; Work with researchers on data mixtures and sampling strategies for pre-training and midtraining; Prepare and evaluate data for long-context learning, reasoning, and coding, testing synthetic data where it proves useful; Run controlled data experiments and use model evaluations to decide which sources, mixtures, and processing choices are worth scaling; Make large-scale data processing efficient, reproducible, and recoverable, with clear source provenance and dataset versioningRequirements
Strong programming skills in Python and a record of building reliable data-processing or distributed systems; Experience working with large datasets and managing the practical tradeoffs of storage, compute, throughput, and reproducibility; Ability to diagnose data-quality issues and translate research goals into measurable checks and experiments; Comfort owning an evolving technical problem end to end and working closely with researchers to test assumptions and improve the system; Relevant experience may include web crawling, document extraction, code-data collection, or large-scale corpus curation; Deduplication, text classification, quality scoring, synthetic data, or training-data contamination analysis; Data-mixture experiments, curriculum learning, or measuring how dataset changes affect model performanceNice to have
Experience preparing datasets for language-model pre-training, continued pre-training, or midtraining; Work with distributed processing frameworks such as Spark, Ray, or comparable systems; Experience with multilingual, mathematical, scientific, or repository-level code data; Familiarity with tokenization, training data loaders, and the needs of large model-training runs; Depth in data acquisition, scalable processing, or data research can be a strong starting pointBenefits
Cash Compensation Range of $150-350k, including equity incentives; Full medical, dental and vision coverage for employees and dependents; Flexible PTO; $200/month health and wellness benefit; Visa sponsorship and relocation assistance for international candidates; Professional development budget for courses and conferences; Quarterly team off-sites, hackathons, conferences and learning opportunities; Company-covered meals when working from our San Francisco officeHow to apply
Apply online: https://www.jobs.pl/en/oferta/102938920/aplikuj
JOBS.pl · https://www.jobs.pl/de/research-engineer-pre-training-data-oferta-102938920





