Automations/Product Engineer
Permanent Employee, Full-time, Remote, PST Shift
Monthly Net Salary: $1,800 to $2,000
Job Summary:
Own the creator-discovery engine that helps brands find and connect with ambassadors. You’ll build and maintain scrapers, integrations, and automation pipelines; normalize and index data for fast search; and wire everything into the product with a focus on reliability, speed, and measurable impact (discovery uptime and creator connections).
Responsibilities:
Design, build, and maintain scrapers and API integrations for social/creator data (rate-limit aware, resilient, observable).
Normalize, dedupe, and enrich data; model and store it for fast search and retrieval.
Implement queues/workers/schedulers to orchestrate crawls, refresh cadences, and backfills at scale.
Integrate services into the existing Rails product; ship incremental, testable changes with CI/CD.
Instrument SLAs (uptime, latency, freshness), create dashboards/alerts, and handle incidents.
Scope new sources quickly; prototype, estimate effort, and join founder/customer calls as needed.
Write clear docs/runbooks and automate repetitive ops.
Requirements:
2–4+ years shipping production software; scrappy builder who can work directly with founders.
Strong in Ruby on Rails or excellent in Python and comfortable operating in a Rails environment.
Hands-on scraping/automation experience (selectors, headless browsers, anti-bot tactics, captchas, proxies).
Solid with queues/workers/schedulers (e.g., Sidekiq/Resque/Celery) and event-driven pipelines.
Data modeling and storage for searchability (Postgres, Elasticsearch/OpenSearch, Redis).
Production-grade testing, monitoring, and CI/CD; debugging with logs/metrics/traces.
Practical API design/consumption (REST/GraphQL), auth, pagination, retries/backoff.
Nice to have: Docker and cloud (AWS/GCP), basic IaC; data quality/fuzzy matching; SQL/analytics for KPI tracking; security/compliance awareness.