AWS Data Engineer
Full-timePosted
- Salary
- Not disclosed
- Experience
- 6–12 years
- Eligible batches
- 2020
- Location
- BengaluruOn-site
About the role
Capco is seeking an experienced AWS Data Engineer to design, build and optimise large‑scale data pipelines on Databricks and AWS. The role involves end‑to‑end development of batch and streaming workloads, data platform design, and close collaboration with client stakeholders.
Responsibilities
- Develop, test and maintain scalable data pipelines using Databricks, PySpark and SQL.
- Design and optimise Delta Lake tables and implement Medallion Architecture layers.
- Build data ingestion, transformation and validation workflows across diverse data sources.
- Implement CI/CD pipelines, source control with Git and automate deployments via Terraform or Databricks Asset Bundles.
- Apply data governance, security controls and monitoring using Unity Catalog and AWS services.
- Provide technical leadership, mentor junior engineers and engage with clients to translate business needs into technical solutions.
Free interview prep
Prepare for the interview
Eligibility
- Minimum 6 years of experience in data or software engineering, with at least 6‑12 years overall.
- Proven hands‑on experience with Databricks, Apache Spark, Delta Lake and AWS data services.
Skills
- Python, PySpark and SQL programming.
- Databricks platform and Delta Lake management.
- Apache Spark architecture and performance tuning.
- AWS services such as Lambda, Glue, Step Functions, IAM, Lakeformation, EventBridge, SNS, SQS, EC2, CloudFormation, RDS, DynamoDB, Redshift.
- Git version control and CI/CD pipeline implementation.
- Agile delivery practices and strong communication abilities.
Resume keywords
Asked for
- Python
- PySpark
- SQL
- Databricks
- Spark
- Delta lake
- AWS
- Git
- CI/CD
- Terraform
Nice to have
- Unity catalog
- Delta live tables
- Spark structured streaming
- Kafka
You'll apply on job-boards.greenhouse.io
Apply link checked by CareersAt.Tech and re-tested nightly. You never pay to apply. Report listing
About Capco
Wipro-owned consultancy that helps banks, insurers, capital markets firms, wealth managers and energy companies with business and technology change.
Founded 1998 · 5000+ employees · HQ London, United Kingdom
More about Capco