Data Engineer

We are looking for Data Engineers . Salary : INR 21,00,000 - 24,00,000 / year Responsibilities Analyze, parse and clean large datasets of structured and unstructured data Collaborate closely with security analysts and lead developers to understand bottlenecks and to prioritize, correct and ingest cleaned data Develop data ingestion frameworks to handle high-volume and high-variety data, including structured and unstructured data recovered from +2000 data sources across the deep, dark and open web Implement data quality control measures to detect and handle data anomalies, duplicates, and inconsistencies Work towards optimizing data pipeline performance for scalability, reliability, and latency Troubleshoot data pipeline issues and data quality problems Eligibility 2 years of relevant work experience Strong command of Linux CLI tooling and AWS CLI Deep understanding of common data formats such csv, json, sql, excel files Deep understanding of file encoding and related issues Strong Python scripting skills to develop tooling Strong problem-solving skills, with the ability to troubleshoot complex data pipeline issues (*Note: This is a requirement for one of Scout's clients) Skills: datasets,aws,unstructured data