Data Engineer

Greetings for the Day…!!!

We are looking for a Data Engineer for one of our esteemed clients in Hyderabad/Bangalore having experience into Python,Pyspark/Spark,SQL

Exp: - 6+ years

Location: Hyderabad/Bangalore

Shifts : - General shifts

Job Description:-

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and Apache Spark for large-scale data processing.
• Build and optimize ETL/ELT workflows to ingest, transform, and load data from multiple structured and unstructured sources.
• Work with distributed data processing frameworks like Spark (PySpark/Scala) to handle big data efficiently.
• Develop data solutions on cloud platforms such as AWS / Azure / GCP using services like S3, Glue, Databricks, or BigQuery.
• Implement data modeling techniques and optimize data storage using data lakes and data warehouses.
• Ensure data quality, integrity, and governance through validation, monitoring, and automated checks.
• Collaborate with data scientists, analysts, and business teams to deliver reliable datasets and insights.
• Optimize performance of Spark jobs through partitioning, caching, and tuning techniques.
• Use orchestration tools like Airflow or similar for workflow scheduling and monitoring.
• Work with SQL/NoSQL databases such as PostgreSQL, MySQL, MongoDB, or Hive.
• Implement CI/CD pipelines and follow best practices for version control using Git.
• Troubleshoot production issues and ensure high availability and performance of data systems.

*We are looking for candidates who can join us within 15 days*