在Ubuntu上配置Kafka網絡涉及多個步驟,包括安裝必要的軟件、配置Kafka和Zookeeper、以及啟動服務。以下是一個詳細的指南:
Kafka需要Java運行環境,建議安裝JDK 1.8或更高版本??梢酝ㄟ^以下命令檢查Java是否已安裝:
java -version
安裝Zookeeper
下載Zookeeper:
wget https://downloads.apache.org/zookeeper/zookeeper-3.7.0/apache-zookeeper-3.7.0-bin.tar.gz
解壓并配置Zookeeper:
tar -xzvf apache-zookeeper-3.7.0-bin.tar.gz
cd apache-zookeeper-3.7.0
mkdir /tmp/zookeeper
編輯 conf/zoo.cfg
文件:
dataDir /tmp/zookeeper
clientPort 2181
server.1 localhost:2888:3888
server.2 localhost:2889:3889
server.3 localhost:2890:3890
啟動Zookeeper:
./bin/zkServer.sh start
安裝Kafka
下載Kafka:
wget https://downloads.apache.org/kafka/2.8.1/kafka_2.12-2.8.1.tgz
解壓并配置Kafka:
tar -xzvf kafka_2.12-2.8.1.tgz
cd kafka_2.12-2.8.1
mkdir /tmp/kafka
編輯 config/server.properties
文件:
broker.id 0
listeners PLAINTEXT://your_server_ip:9092
zookeeper.connect localhost:2181
log.dirs /tmp/kafka
啟動Kafka:
./bin/zookeeper-server-start.sh config/zookeeper.properties
./bin/kafka-server-start.sh config/server.properties
配置靜態IP地址(適用于Ubuntu 20和Ubuntu 22)
打開終端,輸入以下命令編輯網絡配置文件:
sudo nano /etc/netplan/01-netcfg.yaml
將 dhcp4: yes
更改為 dhcp4: no
,并添加靜態IP地址、網關和DNS服務器:
network:
version: 2
renderer: networkd
ethernets:
eth0:
dhcp4: no
addresses: [Your_Static_IP/Netmask]
gateway4: Your_Gateway_IP
nameservers:
addresses: [DNS_Server_IPs]
保存更改并應用配置:
sudo netplan apply
創建一個主題并檢查是否成功:
./bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test
啟動生產者和消費者以測試Kafka服務器:
./bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test
./bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic test --from-beginning