Джерело: CrawlJobs
Ця вакансія не має повного перекладу вибраною мовою. Нижче показано оригінальний зміст.

Data Engineer

Maincode Австралія ; Австралія (whole country)
Full-time Hybrid work

Publication date: 02/11/2026

About Maincode

Maincode makes Matilda, an Australian-made AI stack we own end to end, from tin to token. We own and operate our own infrastructure here in Australia, we train and maintain our own frontier models, and we run multiple surfaces on top of them, including chat, coding and API. Everything we ship is built on capability we control ourselves. We are hiring someone who cares about that. You should be passionate about Australian-made technology, a builder first, and keen to execute at the frontier of data engineering and model training.

The role

A frontier model is only as capable as the data it learns from, and every model carries the worldview of the data it was trained on. We did this for Australia with Matilda’s voice. Now we are building the capability to do it for any country or market: training open weights models on custom datasets that reflect the cultural, regulatory, governance, and ideological requirements of the people who will use them.

You will be the hands on engineer who builds the system that makes those datasets. You will own the pipeline end to end, from web scale crawling of hard to reach, country specific sources through to filtering, deduplication, quality control, and the agent driven pipelines that turn raw material into training sets. We need someone who moves fast, writes code every day, and knows how to use AI agents to multiply what a small team can produce without letting quality slip.

Highly regarded

- Direct experience building pre-training or post-training datasets for large language models, including SFT, preference, or reinforcement learning data.
- Experience with multilingual, regional, or culturally specific data, or with evaluating models against local norms and regulation.
- Experience fine-tuning or post-training open weights models.
- Open source contributions to crawling, data processing, or dataset tooling.
- A strong network within the Australian technology, academic, or media ecosystem to facilitate unique data partnerships.

Details

- Location: Melbourne, VIC (or Hybrid/On-Site across Australia).
- Type: Full time, permanent.
- Remuneration: Negotiable based on experience, plus super and equity.

Who thrives here

Engineers who understand that high quality data is the true moat of any frontier model, and that it is also where a model’s values come from. If you care about Australian-made technology and you would rather spend your week shipping crawlers, tuning agent pipelines, and reading samples of your own data than sitting in steering committee meetings, you will do well here.

Responsibilities

Build, run, and scale crawlers and scrapers for web scale collection, including specialized crawlers for high value, hard to reach sources such as legislation, regulator guidance, government publications, local media, and community forums.; Develop robust pipelines for extraction, filtering, cleaning, deduplication, and formatting to ensure the highest quality inputs for model training.; Build agentic pipelines where AI agents generate, annotate, critique, and verify data at scale, with the evaluation and spot checks needed to trust what they produce.; Turn a market’s requirements, from its laws and regulators to its cultural norms and governance expectations, into dataset specifications, data mixtures, and evaluations we can measure against.; Work directly with our core training team to iterate on data mixtures, evaluate data quality, and respond to model performance feedback.; Track provenance, licensing, privacy, and security for every dataset you ship.

Requirements

A track record of building, scaling, and running large scale web crawling or scraping systems in production.; Strong engineering in Python and at least one of Go, Rust, or C++, with real experience in distributed data processing (Spark, Ray, Beam, or similar) and petabyte scale storage.; Hands on knowledge of the hard parts of crawling: JavaScript heavy sites, headless browsers, rate limiting, robots.txt, and access and licensing constraints.; Experience using LLMs and AI agents inside data pipelines for classification, extraction, synthetic data generation, or quality scoring, and a clear sense of where they fail.; A bias for shipping. You get a working pipeline running in days, then make it reliable.; Experience leading the technical direction of a project and bringing other engineers along with you.; Must have the right to work in Australia.; Willingness to undergo background checks as required.
Apply on the employer's website
Зберегти
Apply with employer

Схожі вакансії

Усі →
Нова вакансія Вміст мовою оригіналу
Agencja Pracy KONCEPCJA

Spawacz /ka MAG (Dornstadt-AS-GL-DE)

Німеччина, Дорнштадт
3,3 тис. EUR / міс. нетто
Agencja Pracy KONCEPCJA
Трудовий договірПовна зайнятість +2
Подати заявку
Нова вакансія Вміст мовою оригіналу
Agencja Pracy KONCEPCJA

Operator /ka frezarki CNC (Oberndorf am Lech-TA-BH-DE)

Німеччина, Oberndorf am Lech
3 тис. EUR / міс. нетто
Agencja Pracy KONCEPCJA
Трудовий договірПовна зайнятість +2
Подати заявку
Вміст мовою оригіналу
DEVENTON D. MATCZAK N. MATCZAK SPÓŁKA JAWNA

Frezarz CNC / Programista CAD/CAM

Нідерланди, Reusel
DEVENTON D. MATCZAK N. MATCZAK SPÓŁKA JAWNA
IT - Розробка програмного забезпечення
Подати заявку
Вміст мовою оригіналу
TeamQuest Sp. z o.o.

Account Manager - Usługi rekrutacyjne

Польща, Варшава (Мазовецьке)
TeamQuest Sp. z o.o.
Повна зайнятістьСтаціонарна
Подати заявку
Вміст мовою оригіналу
TeamQuest Sp. z o.o.

Account Manager - Sprzedaż Usług Rekrutacyjnych

Польща, Варшава (Мазовецьке)
TeamQuest Sp. z o.o.
Повна зайнятістьСтаціонарна
Подати заявку

Налаштування згод

Кожна мета є необов’язковою і за замовчуванням вимкнена. Ви можете відкликати згоду будь-коли.

Показуємо вакансії найближче до вас