Backend Engineer - Big Data

Job Description

We are seeking a talented and motivated Software Developer to join our growing team. The ideal candidate will be an expert in object-oriented programming language, possess a strong aptitude for solving Bigdata problems, and have a passion for designing and developing sophisticated Bigdata solutions. As a key member of our development team, you will contribute to the creation of innovative software solutions in the data security domain.? Responsibilities: ? Develop high-quality software solutions using Java programming language? Develop high-performance data pipelines for real-time and batch processing? Collaborate with cross-functional teams to understand project requirements and translate them into technical specifications.? Design and implement complex, scalable, and reliable systems that meet business requirements.? Troubleshoot, debug, and optimize code to ensure performance and reliability.? Stay up-to-date with the latest industry trends, tools, and technologies.? Work closely with DevOps to deploy and maintain applications using Docker and Kubernetes.? Utilize cloud platforms such as AWS to build, deploy, and scale applications.? Integrate and utilize various cloud services to enhance system functionality.? ?Requirements:? ? Energetic self-starter, with a desire to work in a startup environment?? Experience in Bigdata processing using any of Snowflake, Redshift, Spark, Flink, Iceberg, Kafka etc.? Proficient in DSA and advanced Java/Python programming skills?? Expert in Application development cloud/on premise end to end. Middle layer, DB layer.?? Should have worked for cloud based applications, built on microservices based paradigms, achieving horizontal scaling.?? Good hands on and understanding of RMQ, Elasticsearch, SQL, NoSQL DB (e.g. mongoDB etc), K8s, Kafka streams, etc?? Good hands on in Complex Event Processing systems.?? Good to have solved scale and performance issues with respect to cloud applications? Experience of debugging applications running on Unix like systems (e.g. Ubuntu, CentOS)??? Experience developing RESTful APIs for complex data sets?? Knowledge of container based development & deployment (e.g. Dockers, rkt)?? ?? Exposure to AWS, Google Cloud Platform, Microsoft Azure, etc.?? ?Expertise in software security domain, a plus