Senior Backend Engineer — Data Pipeline at Gurugram Full Time

Why this role exists:

You’ll own our data pipelines—ingesting, cleaning, and serving fashion/e-commerce data at scale—so the team (and founder) can focus on building new capabilities. If you love end-to-end ownership and turning messy web data into reliable, queryable systems, this role is your playground.

What you’ll do:

• Ingestion at scale: Design, build, and operate resilient crawlers/scrapers with rotation, rate-limits, backoff, and change-tolerance.
• Robust pipelines: Normalization, deduping, schema evolution, enrichment, and SLAs for freshness & completeness.
• Data stores & caching: Model products/variants/attributes in PostgreSQL, manage Redis for caching/queues, and keep costs predictable.
• Observability & quality: Instrument with metrics/tracing, add data QA checks, alerts, and auto-healing where sensible.
• Performance & reliability: Optimize throughput, memory, I/O, and infra spend; design for retries, idempotency, and correct delivery semantics.
• Collaboration: Partner with search/ML/product teams; write crisp docs; raise the bar in reviews; mentor where helpful.

Must-haves:

• Super high ownership: End-to-end closure on tasks you lead.
• 3.5+ years building backend systems, preferably in Python with production ownership.
• Strong data pipeline experience (batch/stream): schema design, deduplication, and backfills.
• Hands-on with PostgreSQL/MySQL and Redis (caching, rate-limits, queues).
• Real-world web scraping: requests/httpx/aiohttp, BeautifulSoup/lxml/Scrapy/Playwright, anti-bot tactics, respectful crawling.
• Concurrency & async (asyncio, multiprocessing), robust error handling, idempotent jobs.
• Solid testing habits and bias for simple, maintainable code.

Nice-to-haves:

• Message queues/streams: Kafka, RabbitMQ, SQS.
• Workflow schedulers: Airflow, Prefect.
• GraphQL; search tech (Elasticsearch/OpenSearch).
• Cost/perf tuning, on-call pragmatism, or prior startup/founding team experience.

How we work:

• High ownership, fast shipping, clear interfaces, strong documentation.
• We optimize for time to go live—startups that succeed outpace those that don’t.
• Competitive salary + meaningful ESOPs.
• (Optional) Work from our hacker-house on MG Road, Gurgaon.

Hiring process (fast closures)

1. 30-min technical deep-dive
2. Take-home (optional)
3. Founder conversation & references