在Ubuntu上高效搭建Kafka集群可以參考以下步驟:
安裝Java:
sudo apt update
sudo apt install openjdk-8-jdk
java -version
下載并解壓Kafka:
wget https://downloads.apache.org/kafka/3.6.2/kafka_2.12-3.6.2.tgz
tar -xzf kafka_2.12-3.6.2.tgz
sudo mv kafka_2.12-3.6.2 /usr/local/kafka
下載并解壓Zookeeper:
wget https://archive.apache.org/dist/zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz
tar xvfz zookeeper-3.4.6.tar.gz
sudo mv zookeeper-3.4.6 /usr/local/zookeeper
配置Zookeeper:
編輯 /usr/local/zookeeper/conf/zoo.cfg
文件:
tickTime=2000
dataDir=/var/lib/zookeeper
clientPort=2181
啟動Zookeeper:
sudo /usr/local/zookeeper/bin/zkServer.sh start
配置Kafka:
編輯 /usr/local/kafka/config/server.properties
文件:
broker.id=0
listeners=PLAINTEXT://:9092
advertised.listeners=PLAINTEXT://your_server_ip:9092
zookeeper.connect=localhost:2181
啟動Kafka:
sudo /usr/local/kafka/bin/kafka-server-start.sh -daemon /usr/local/kafka/config/server.properties
創建Topic:
sudo /usr/local/kafka/bin/kafka-topics.sh --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic test
發布和消費消息:
sudo /usr/local/kafka/bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
sudo /usr/local/kafka/bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginning