Data Engineer

Job Description

Experience : 4.00 + years Salary : Confidential (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Proplens) (*Note: This is a requirement for one of Uplers' client - Proplens) What do you need for this opportunity? Must have skills required: Agent Workflows, CCPA) and enterprise security patterns, Experience with Machine Learning and/or Computer Vision, Knowledge of data-governance (GDPR, Prompt Engineering, Data Engineering, DuckDB, Python Proplens is Looking for: Data Engineer We are seeking a versatile Data Engineer with 4-7 years of experience to own end-to-end data pipelines for downstream AI agent applications. You?ll design data models and transformations, build scalable ETL/ELT workflows, and collaborate on ML model deployment, while learning fast and working on the AI agent space. Key Responsibilities Data Modeling & Pipeline development Define and implement logical/physical data models and schemas Develop schema mapping and data dictionary artifacts for cross-system consistency Build, test, and maintain robust ETL/ELT workflows using Spark (batch & streaming) Automate data ingestion from diverse sources (Databases, APIs, files, Sharepoint/document management tools, URLs) Gen AI Integration Collaborate with AI engineers to enrich data for agentic workflows Instrument pipelines to surface real-time context into LLM prompts ML Model Deployment Support (Secondary role) Package and deploy ML models (e.g., via MLflow, Docker, or Kubernetes) Integrate inference endpoints into data pipelines for feature serving Observability & Governance Implement monitoring, alerting, and logging (data quality, latency, errors) Apply access controls and data privacy safeguards (e.g., Unity Catalog, IAM) CI/CD & Automation Develop automated testing, versioning, and deployment (Azure DevOps, GitHub Actions, Airflow) Maintain reproducible environments with infrastructure as code (Terraform, ARM templates) Required Skills & Experience 5 years in Data Engineering or similar role, with exposure to ML modeling pipelines Proficiency in Python, dlt for ETL/ELT pipeline, duckDB for analytical in-process analysis, dvc for managing large files efficiently. Solid SQL skills and experience designing and scaling relational databases. Familiarity with non-relational column based databases. Familiarity with Prefect is preferred or others (e.g. Azure Data Factory) Proficiency with the Azure ecosystem. Should have worked on Azure services in production. Familiarity with RAG indexing, chunking and storage across file types for efficient retrieval. Experience deploying ML artifacts using MLflow, Docker, or Kubernetes Strong Dev Ops/Git workflows and CI/CD (CircleCI and Azure DevOps) Bonus skillsets: Prompt Engineering Agent Workflows Experience with Machine Learning and/or Computer Vision Knowledge of data-governance (GDPR, CCPA) and enterprise security patterns Obs: We are an early-stage startup, so you are expected to wear many hats, working with things out of your comfort zone, but with real and direct impact in production. If you think you are a good fit for this fast-paced environment, please apply - no direct messages, e-mails will be considered. Why us? Fast-growing, revenue-generating proptech startup Steep learning opportunities in real world enterprise production use-cases Remote work with quarterly meet-ups Multi-market client exposure How to apply for this opportunity? Step 1: Click On Apply! And Register or Login on our portal. Step 2: Complete the Screening Form & Upload updated Resume Step 3: Increase your chances to get shortlisted & meet the client for the Interview! About Uplers: Our goal is to make hiring reliable, simple, and fast. Our role will be to help all our talents find and apply for relevant contractual onsite opportunities and progress in their career. We will support any grievances or challenges you may face during the engagement. (Note: There are many more opportunities apart from this on the portal. Depending on the assessments you clear, you can apply for them as well). So, if you are ready for a new challenge, a great work environment, and an opportunity to take your career to the next level, don't hesitate to apply today. We are waiting for you!