Skip to content
Capco logo

Capco

Bengaluru · On-site

AWS Data Engineer

Full-timePosted
Salary
Not disclosed
Experience
6–12 years
Eligible batches
2020
Location
BengaluruOn-site

About the role

Capco is seeking an experienced AWS Data Engineer to design, build and optimise large‑scale data pipelines on Databricks and AWS. The role involves end‑to‑end development of batch and streaming workloads, data platform design, and close collaboration with client stakeholders.

Responsibilities

  • Develop, test and maintain scalable data pipelines using Databricks, PySpark and SQL.
  • Design and optimise Delta Lake tables and implement Medallion Architecture layers.
  • Build data ingestion, transformation and validation workflows across diverse data sources.
  • Implement CI/CD pipelines, source control with Git and automate deployments via Terraform or Databricks Asset Bundles.
  • Apply data governance, security controls and monitoring using Unity Catalog and AWS services.
  • Provide technical leadership, mentor junior engineers and engage with clients to translate business needs into technical solutions.

Eligibility

  • Minimum 6 years of experience in data or software engineering, with at least 6‑12 years overall.
  • Proven hands‑on experience with Databricks, Apache Spark, Delta Lake and AWS data services.

Skills

  • Python, PySpark and SQL programming.
  • Databricks platform and Delta Lake management.
  • Apache Spark architecture and performance tuning.
  • AWS services such as Lambda, Glue, Step Functions, IAM, Lakeformation, EventBridge, SNS, SQS, EC2, CloudFormation, RDS, DynamoDB, Redshift.
  • Git version control and CI/CD pipeline implementation.
  • Agile delivery practices and strong communication abilities.

Resume keywords

Asked for

  • Python
  • PySpark
  • SQL
  • Databricks
  • Spark
  • Delta lake
  • AWS
  • Git
  • CI/CD
  • Terraform

Nice to have

  • Unity catalog
  • Delta live tables
  • Spark structured streaming
  • Kafka
Tailor my resume with these

You'll apply on job-boards.greenhouse.io

Find a referralPeople at Capco on LinkedIn

Apply link checked by CareersAt.Tech and re-tested nightly. You never pay to apply. Report listing

About Capco

Wipro-owned consultancy that helps banks, insurers, capital markets firms, wealth managers and energy companies with business and technology change.

Founded 1998 · 5000+ employees · HQ London, United Kingdom

More about Capco