Lead Data Engineer - Big Data & PySpark
India, Kerala, Kochi
3 weeks ago
Applicants: 0
Share
Salary Not Disclosed
3 months left to apply
Job Description
Role Description
Key Responsibilities:
- Big Data Architecture: Design, develop, and maintain scalable and distributed data architectures capable of processing large volumes of data.
- Data Storage Solutions: Implement and optimize data storage solutions using technologies such as Hadoop, Spark, and PySpark.
- PySpark Development: Develop and implement efficient ETL processes using PySpark to extract, transform, and load large datasets.
- Performance Optimization: Optimize PySpark applications for better performance, scalability, and resource management.
- Proven experience as a Big Data Engineer with a strong focus on PySpark.
- Deep understanding of Big Data processing frameworks and technologies.
- Strong proficiency in PySpark for developing and optimizing ETL processes and data transformations.
- Experience with distributed computing and parallel processing.
- Ability to collaborate in a fast-paced, innovative environment.
Pyspark,Big Data, Python,
Additional Information
- Company Name
- UST
- Industry
- IT Services and IT Consulting
- Department
- N/A
- Role Category
- Information Technology
- Job Role
- Mid-Senior level
- Education
- No Restriction
- Job Types
- On-site
- Employment Types
- Full-Time
- Gender
- No Restriction
- Notice Period
- Immediate Joiner
- Year of Experience
- 1 - Any Yrs
- Job Posted On
- 3 weeks ago
- Application Ends
- 3 months left to apply
Similar Jobs
Quick Apply
Upload your resume to apply for this position