Data Engineer

About the role

Bureau is looking for a Data Engineer to design, build, and operate batch and streaming data pipelines that power its risk‑decisioning platform. You will develop backend services, write Spark jobs, and ensure data quality while collaborating with product and infrastructure teams in Bangalore.

Responsibilities

• Create and maintain batch and real‑time pipelines ingesting data from SDKs, APIs, and third‑party providers.
• Develop and own RESTful backend services that expose processed data to internal consumers.
• Build Airflow DAGs for reporting, analytics, model training, and feature generation, keeping them reliable.
• Write and optimise Spark jobs and SQL transformations on the data lake.
• Implement monitoring, alerting, and data‑quality checks for all pipelines.
• Troubleshoot production issues such as Kafka lag, schema changes, or query performance regressions.
• Work with containerised deployments, cluster configurations, and cost‑optimisation.
• Contribute to the identity graph by modelling entity relationships for fraud detection.
• Document designs, write tests, and participate in code reviews.

Eligibility

• 1–3 years of software engineering experience with data‑intensive systems.
• Proficiency in Python, Java or Scala and strong SQL skills.
• Understanding of OLTP vs OLAP databases and distributed processing frameworks (Spark preferred).
• Experience building backend services and REST APIs.
• Familiarity with AWS services such as S3 and EC2.
• Solid fundamentals in data structures, concurrency, and distributed systems.
• Comfort with Git, code reviews, and CI/CD pipelines.

Skills

• python
• java
• scala
• sql
• spark
• airflow
• kafka
• aws
• docker
• kubernetes

Benefits

• Opportunity to work on a high‑impact fraud‑risk platform used by over 150 banks and fintechs.
• Exposure to cutting‑edge data technologies and cloud infrastructure.
• Collaborative environment that encourages learning new tools quickly.
• Competitive salary range of ₹14 LPA – ₹20 LPA.
• Access to mentorship and design‑review sessions.