Senior Software Engineer – Kafka

We are looking for a highly experienced Senior Software Engineer – Kafka to design, develop, and deliver scalable software solutions that power highly available and secure enterprise systems.The ideal candidate will have strong expertise in Apache Kafka, Python or Java, REST APIs, UNIX/Linux, CI/CD, and distributed systems, with hands-on experience building real-time event-driven architectures and microservices.This role requires close collaboration with engineering and data teams to build robust, fault-tolerant, and high-performance systems.Key ResponsibilitiesSoftware EngineeringDesign, develop, test, and deploy enterprise-grade applications using Python or JavaBuild scalable and high-performing REST APIs and microservicesDevelop secure, fault-tolerant distributed systemsBuild scalable ETL and real-time data processing pipelinesContribute to architecture discussions, service design, integration patterns, and data flowsParticipate in Agile ceremonies, code reviews, and technical discussionsKafka & Messaging SystemsDevelop and maintain event-driven messaging frameworks using Apache KafkaWork with Kafka brokers, topics, partitions, consumer groups, and Kafka StreamsDevelop Kafka Producer and Consumer APIs using Spring Boot / Spring KafkaImplement Kafka security using:TLS/SSLSASL authenticationACLs and RBACManage Kafka deployments using Docker and KubernetesWork with Kafka Connect and Schema Registry (Avro/JSON/Protobuf)Automation & DevOpsAutomate operational workflows using Bash scripting in UNIX/Linux environmentsBuild and maintain CI/CD pipelinesSupport deployment automation and release managementTroubleshoot and resolve software issues across development and production environmentsMaintain technical documentation, design documents, and system specificationsAI-Enabled DevelopmentUse AI productivity tools such as Claude, Cursor, or similar IDE assistantsBuild AI-enabled backend capabilities using:Foundation modelsPrompt engineeringRetrieval-Augmented Generation (RAG)AI agentsDesign AI-assisted workflows for:Code generationUnit/API testingIncident analysisCI/CD supportImplement audit logging, observability, and governance controls for AI-assisted systemsRequired QualificationsBachelor’s degree in Computer Science, Engineering, or related field6+ years of software engineering experienceStrong experience building enterprise-grade applicationsExperience working in Agile/Scrum environmentsStrong analytical, debugging, and problem-solving skillsAbility to work independently and collaborate across teamsMust-Have SkillsStrong expertise in Apache KafkaProficiency in Python or Java (Object-Oriented Programming)Strong experience with:REST APIsMicroservicesDistributed systemsAdvanced UNIX/Linux knowledge and Bash scriptingExperience with Git, GitLab, and CI/CD automationExperience with relational databases and SQLHands-on experience with Docker and KubernetesExperience with observability tools such as:SplunkGrafanaAppDynamicsKnowledge of secure Kafka implementation using TLS/SSL and SASLExperience with event-driven and messaging architecturesKey ExpectationsDeliver high-quality, scalable, and maintainable software solutionsFollow coding standards, development guidelines, and best practicesParticipate in code reviews and technical mentoringContribute to architecture and design decisionsCollaborate effectively with cross-functional teams and stakeholdersEnsure timely delivery with strong focus on quality and performanceSupport release management, defect resolution, and continuous improvement initiativesCore CompetenciesStrong communication and stakeholder management skillsTechnical leadership and mentoring capabilitiesAbility to manage multiple priorities in fast-paced environmentsStrong ownership and accountabilityHigh attention to quality and performance optimizationCustomer-focused mindsetMandatory Skills ChecklistKafkaPython or JavaUNIX/LinuxREST API DevelopmentCI/CDAdditional InformationTelecom / Network domain experience is a plusRelevant technical certifications are beneficialAbout Brickred SystemsBrickred Systems is a global leader in next-generation technology, consulting, and business process services. We enable clients to navigate their digital transformation across multiple industries worldwide. Certified with ISO 27001 & ISO 9001, with over a decade of experience managing global enterprise systems. We harness the power of cognitive computing, hyper-automation, robotics, cloud, analytics, and emerging technologies to help our clients succeed in the digital world and make them successful. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.