Big Data Engineer


Job Location : Hyderabad

Experience : 5 Yr

CTC Budget : 100000 to 2500000

Posted At : 16-Feb-2026


Mandatory (Must-Have) Skills

1. AWS Expertise

o Hands-on experience with AWS Big Data services such as EMR, Managed Apache Airflow, Glue, S3, DMS, MSK, and EC2.

o Strong understanding of cloud-native data architectures.

2. Big Data Technologies

o Proficiency in Scala Spark and SQL for large-scale data transformation and analysis.

o Experience with Apache Spark and Apache Kafka in production environments.

3. Data Frameworks

o Strong knowledge of Spark DataFrames and Datasets.

4. ETL Pipeline Development

o Proven experience in building scalable and reliable ETL pipelines for both batch and real-time data processing.

5. Database Modeling & Data Warehousing

o Expertise in designing scalable data models for OLAP and OLTP systems.

6. Data Analysis & Insights

o Ability to perform complex data analysis and extract actionable business insights.

o Strong analytical and problem-solving skills with a data-driven mindset.

7. CI/CD & Automation

o Basic to intermediate experience with CI/CD pipelines using Jenkins or similar tools.

o Familiarity with automated testing and deployment workflows.

 

Key Skills

 

4+ years in big data, 4+ years in Scala spark, 4+ years in apache spark, 5+ years in etl pipeline development,

 

Apply Now
companylogo

Arena ITsoft Consultancy Pvt Ltd


Share Job