About the role
The ingestion platform brings Instagram posts, TikTok clips, X mentions and YouTube Shorts into dashboards. You own it end to end. That means connectors, rate limits, dedupe, media storage and the queues behind them.
Engineering
Staff
Staff Backend Engineer (Ingestion Platform)
Run the pipeline that pulls posts from 8 social sources and the review sites. Postgres, AWS Lambda, SQS.
Remote (Europe)
Full-time
€50.5K
What you'll do
- Own the connectors for 8 social sources and the review sites: rate limits, API deprecations
- Keep the SQS workers that download, resync and optimise media healthy as volume grows
- Set the ingestion reliability targets and report against them
- Partner with AI/ML on enrichment: auto-tagging, labels and product matching
- Run incident command for ingestion-side P0s; write the post-mortem
What you'll need
- 8+ years backend / distributed systems, including a high-volume pipeline you owned
- Postgres tuning at scale (partitioning, indexes, vacuum strategies)
- Queue-based systems (SQS, Kafka or similar): retries, dead-letter queues, back-pressure
- Serverless or container workloads on AWS
- Demonstrable on-call leadership
More on the Engineering team
Related open roles
Don’t see your role? Write to us anyway.
Tell us what you would build here.
