Data Engineer


Job Location : Hyderabad

Experience : 8 Yr

CTC Budget : 100000 to 3200000

Posted At : 05-Feb-2026


Lead an outstanding Agile technical team Build data pipelines and data lake Deliver quality software Collaborate with the risk, security and compliance teams to ensure adherence to regulatory requirements (e.g., GDPR, PCI DSS) and industry standards related to data privacy and security Understand where there are overlapping technical requirements in your team and other teams and help build out technology roadmaps Codebase ownership Technical Application ownership

 

Qualifications

 

    Strong experience with DevOps & IaC tooling - Terraform, CI/CD pipelines, Git, Jenkins Strong experience of developing on Apache Spark/Hadoop Strong experience with AWS cloud services including (but not limited to) AWS Glue, S3, Step Strong experience building data pipelines and data lake Experience of the full development lifecycle/application Lifecycle Management Tools - BitBucket & Jira Significant experience of programming using Scala or Python. Configuration as code principles and API integration Ability to explain solutions to technical and non-technical audiences Write clean, scalable and re-usable code that implements SOLID principles, common design patterns where applicable and adheres to published coding standards Ability to analyse, investigate and compare large data sets when required Functions, Lambdas, EventBridge, SQS and Lake formation Experience with automated testing methodologies

 

Skills

spark, 

python, 

pyspark,

aws cloud - s3, athena, stepfuctions, glue, lambda, event bridge etc,

airflow,

jenkins,

terraform,

git

 

Apply Now
companylogo

Arena ITsoft Consultancy Pvt Ltd


Share Job