Report this Job
Job: Lead Kafka Engineer
Location: Hybrid - Dallas, TX OR Buffalo Grove, IL- In-person interview and on site 3X a week REQUIRED.
Term: 6-12+ Months Contract potential to convert to full time (USC/ GC Holder only)
TOP SKILLS:
5+ years of experience on Kafka Cluster, Confluent cloud, Partitions, Security, Disaster recovery, Data pipeline, Data replication.
5+ years of experience in building producer applications for Kafka and Configuration in KAFKA, preferably cloud native applications.
5+ years of experience as a technical lead developing middleware integration solution or architecting large scale federated systems.
4+ years of experience in enterprise, application and information architecture methodologies and design and/or equivalent combination of education and work experience.
4+ years of experience in diagnosing, Troubleshooting, and solving Kafka issues and maintaining the documentation for the same.
3+ years of extensive experience designing complex integrations with a focus on performance engineering and loose coupling utilizing APIs and Services on GCP and/or Azure
3+ years of experience with any or all of the following: Agile/Scrum Development & Management, Scaled Agile Framework, Iterative & Incremental development approaches, Continuous Integration and delivery
3+ years of experience with design considerations for high volume transaction systems
2+ years of experience on Leading, Architecting and capacity planning the Kafka clusters, brokers, Producer, Consumers, self-managed connectors, schema registry both on confluent Platform and confluent cloud.
2+ years of experience on monitoring technologies such as Prometheus, Grafana, Kafka Manager, confluent control Centre and other Kafka too
2+ years experience on automation of day to day operations using Terraforms.
Preferred Qualifications:
5+ years of experience in the role of a Solutions Technical Lead with demonstrated experience in applying architecture blueprints and aligning projects to enterprise standards.
5+ years Kafka development experience with Microservices/java/j2ee/python frameworks.
3+ years of experience on Confluent Cloud (SasS) preferably on GCP and Azure
Ability to assess the impact of architecture changes on the business, application relationships and information flow
Healthcare background or experience is preferred
Day to day:
Lead and work as Architect on Kafka Capacity planning, installation, administration/Platform management, performance optimization of Kafka partitioning and Kafka brokers.
Lead on Kafka Cluster, Partitions, Security, Disaster recovery, Data pipeline, Data replication.
Lead on Operational management of the Confluent Kafka platform.
Lead on tuning Kafka partitioning. Performance optimization with Kafka brokers.
Lead and Architect Self-Managed Kafka connectors
Lead on deploying confluent Kafka cluster which includes Installation, Configuration, Deployment, Securing, Monitoring and Troubleshooting
Work on administrating confluent Kafka
Lead on optimization of Kafka cluster using performance tuning at different levels (Producer, broker, and consumer).
Design and automate the daily operations of the Event Streaming Environments, as well as architecting additional tools for integrating with the Event Streaming environment.
Analyze current information technology environments to identify and assess critical capabilities and recommend solutions
Provide research and development activities for architecture
Collaborate with engineering and development teams to evaluate and identify optimal cloud solutions for confluent connectivity.
Collaborate with Project Managers and technical leads to provision estimates, develop overall implementation solution plan, and serve as a lead as required. Provide lab and vendor support
Provide guidance for enterprise-wide technology to junior staff
Develop frameworks, standards & reference material for architecture and associated products
Develop & maintain common services, repositories & utility components for the enterprise
Provide data, application & technology deliverables on a program & project level basis including risk & opportunity assessment, modeling and design related products and services
Effectively communicate the architecture to all levels of the organization
Adhere to enterprise architecture strategies, principals, standards, policies, and procedures
Steneral Consulting
