Sr Data Engineer (Python, GCP, Airflow/Autosys)
Bengaluru, Karnataka, India
1 month ago
Applicants: 0
N/A
Job Description
Job Title: Data Engineer (Python, GCP, Airflow/Autosys) Location: Remote Experience: 6+ years Employment Type: Long-Term Contract (through end of 2025) Work Hours: Must have overlap with EST time zone Dual Employment: Not permitted Role Overview: We are seeking an experienced *Data Engineer* with strong expertise in scheduling/orchestration tools (*Autosys, Airflow), **Python scripting, and **Google Cloud Platform (GCP)* to support a critical data engineering initiative. The role focuses on building, optimizing, and automating data pipelines in GCP using BigQuery and DAG orchestration. The ideal candidate is hands-on, proactive, and eager to leverage modern cloud tools to deliver scalable data solutions. Key Responsibilities: * Design, develop, and maintain data pipelines leveraging *Airflow (DAGs)* and *Autosys* for scheduling and orchestration. * Build, optimize, and maintain scalable solutions in *Google Cloud Platform (BigQuery, Dataflow, Cloud Composer)*. * Write, test, and deploy *Python scripts* for automation, data transformations, and workflow efficiency. * Collaborate with cross-functional teams to gather requirements and deliver reliable data solutions. * Troubleshoot, debug, and optimize workflows for reliability, scalability, and performance. * Maintain clear documentation of data pipelines, workflows, and implemented solutions. Required Qualifications: * Hands-on experience with *Autosys and Airflow* for scheduling and orchestration. * Strong *Python scripting* skills for automation and data engineering tasks. * Proven experience with *GCP (BigQuery, Dataflow, Cloud Composer)*. * Solid understanding of workflow automation, data integration, and monitoring. * Independent problem solver with strong analytical and troubleshooting skills. * Excellent communication and documentation abilities. Nice to Have * Experience with *ETL frameworks*. * Familiarity with *SQL optimization*. * Exposure to *real-time data pipelines*. Interview Process 1. *Technical Assessment / Coding Test* 2. *HR Interview* 3. *1?2 Technical Interviews* Apply Now: Share your profiles only if you match the criteria mentioned above at [email protected] .
Required Skills
Additional Information
- Company Name
- KHEYDIGIT
- Industry
- N/A
- Department
- N/A
- Role Category
- Data Analyst
- Job Role
- Mid-Senior level
- Education
- No Restriction
- Job Types
- Hybrid
- Gender
- No Restriction
- Notice Period
- Less Than 30 Days
- Year of Experience
- 1 - Any Yrs
- Job Posted On
- 1 month ago
- Application Ends
- N/A