Data Engineer

Factspan Overview:

Established in 2012, Factspan is a leading pure-play analytics company with expertise in converting data into actionable business insights. We provide the expert services that organizations need to establish their own analytics centre of excellence. Our dedicated team of data scientists and consultants’ partner with the clients to provide analytics solutions that organizations need every day to make data-driven decisions. Headquartered in Seattle, we also have offices in Bangalore, India. Our clients include Fortune 100/500 companies in Retail, Financial Services, Insurance, Hospitality, and Technology industries. Our Vision is to be the foremost player in the business analytics space.

Reference Links: · www.factspan.com · https://www.linkedin.com/company/factspan-inc

Job Title: Data Engineer

Experience: 5–8 years

Job Location: Atlanta, GA (Hybrid)

Employment Type: Full Time

About the Project

This role is part of the MarTech Data Engineering POD supporting a large-scale ESP (Email Service Provider) migration program from Oracle Responsys to Adobe Journey Optimizer. The initiative aims to build a scalable, real-time marketing data foundation integrating customer journeys, preference orchestration, and omnichannel personalization across email, mobile, and direct channels.

The offshore team will focus on designing, building, and maintaining data pipelines across SAS, OES, Wunderkind, and AEP (Adobe Experience Platform), enabling real-time campaign execution and advanced targeting capabilities.

Must have :

Tech : GCP, SQL, Python, Airflow

Domain : MarTech, ESP (Email Service Provider), Retail

Key Responsibilities

• Design and develop data ingestion, transformation, and orchestration pipelines using GCP (BigQuery, Dataflow, Cloud Composer) and Airflow.
• Implement and maintain data integrations between AEP and data lake, ensuring high performance and scalability.
• Build and optimize ETL/ELT workflows to support campaign orchestration, preference logic, and audience segmentation.
• Implement data quality checks, monitoring, and exception handling frameworks to ensure clean and reliable data.
• Work closely with Lead DE and SME to translate campaign archetypes into data pipelines and orchestration rules.
• Support performance tuning, data reconciliation, and defect resolution during testing and hypercare phases.
• Collaborate with QA team for end-to-end test validation and ensure production readiness.
• Participate in daily Agile ceremonies, sprint reviews, and deployment planning.

Required Technical Skills

• Strong hands-on experience in GCP services: BigQuery, Dataflow, GCS, Cloud Composer (Airflow).
• Proficiency in SQL for data profiling, transformation, and performance optimization.
• Proficiency in Python for pipeline automation, scripting, and orchestration.
• Experience building batch and streaming data pipelines.
• Exposure to working with marketing or customer engagement platforms is a plus.
• Understanding of data quality, logging, monitoring, and alerting best practices.

Preferred Skills

• Experience in Airflow DAG development for complex data pipelines.
• Familiarity with MarTech platforms such as Adobe Experience Platform or similar ESPs.
• Knowledge of data modeling for campaign orchestration and audience segmentation.
• Experience with CI/CD and DevOps principles for data deployments.
• Strong troubleshooting and performance tuning skills.

Soft Skills & Attributes

• Strong problem-solving skills and attention to detail.
• Ability to work effectively in a distributed global POD model (onsite + offshore).
• Proactive communication and ownership mindset.
• Comfortable working in fast-paced agile environments with tight timelines.
• Excellent verbal and written communication skills.

Education

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• GCP certifications (e.g., Professional Data Engineer) preferred but not mandatory.