List of Topics:
Location Research Breakthrough Possible @S-Logix pro@slogix.in

Office Address

Social List

How to Create a Fully Managed Kafka Cluster using Amazon MSK?

 Alarm Triggers

Condition for Create a Fully Managed Kafka Cluster using Amazon MSK

  • Description:
    This activity focuses on setting up a fully managed Apache Kafka environment using Amazon MSK. The process begins by opening the Amazon MSK console and creating a new cluster using the custom configuration option. A three-broker setup is selected to ensure high availability and fault tolerance. The cluster is placed inside an existing VPC, and three private subnets are chosen to distribute the brokers across multiple Availability Zones. A security group is configured to allow Kafka traffic on port 9092 from the EC2 instances that will act as producers or consumers. Once the setup is complete, the cluster transitions to the Active state, making the managed Kafka environment ready for message streaming operations.

Steps

  •  Open AWS Console → Amazon MSK → Create cluster
     Choose Custom cluster
     Select 3 brokers (for HA)
     VPC: Choose the existing VPC
     Subnets: Choose 3 private subnets
     Security groups: Allow inbound 9092 port from the producer/consumer EC2s
      Wait until Active
Screenshots
  • 61
  • 62
  • 63
  • 64
  • 65
  • 66
  • 67
  • 68
  • 69
  • 70
  • 71
  • 72
  • 73
  • 74
  • 75
  • 76
  • 77
  • 78