Lead Data Software Engineer

Job Description

We are looking for a skilled Lead Data Software Engineer to join our innovative team and address exciting technical challenges. As a Lead Engineer, you will play a key role in designing and delivering advanced Data solutions for diverse projects. The successful candidate will have extensive expertise in Data technologies, with a strong focus on Apache Spark, Python, Azure, and AWS. ? Responsibilities Deliver end-to-end Data solutions tailored to complex business requirements Collaborate with cross-functional teams to interpret project objectives and deliver high-quality software solutions Leverage expertise in Apache Spark, Python, Azure, and AWS to create robust and scalable data processing systems Ensure optimal performance, security, and scalability of Big Data applications Stay informed about industry advancements and emerging trends in Big Data technologies to refine development practices ? Requirements 8?12 years of substantial experience in Data and related technologies Expertise in Apache Spark with extensive hands-on experience Proficiency in Python Competency in Hadoop and Hive Familiarity with native Cloud data services, primarily AWS and Azure ? Nice to have Background in applying machine learning algorithms and techniques Competency in data visualization tools such as Tableau or Power BI Knowledge of real-time data processing frameworks like Apache Flink or Apache Storm Familiarity with containerization technologies including Docker or Kubernetes ? Technologies Hadoop Hive