6. kafka安装
1.按照zookeeper安装手顺部署zookeeper
2.解压缩kafka_2.8.0-0.8.0.tar.gz 并修改名称为kafka
tar -zxvf kafka_2.8.0-0.8.0.tar.gz -C /home/hadoop/kafka 3.配置kafka的环境变量KAFKA_HOME、PATHexport KAFKA_HOME=/home/hadoop/kafka export PATH=$PATH:$KAFKA_HOME/bin4.修改 config/server.properties
zookeeper.connect=slave1:2181,slave2:2181,slave3:2181broker.id=1(其他两个机器是2,3,4)
host.name=slave1(其他两个机器是slave2,slave3)log.dirs=/home/hadoop/kafka-logs(文件夹权限为755)5.将配置分发到其他机器上
scp -r ~/kafka hadoop@slave1:~/scp -r ~/kafka hadoop@slave2:~/scp -r ~/kafka hadoop@slave3:~/6.启动Kafka(每一台)
kafka-server-start.sh ./kafka/config/server.properties &7.验证kafka
kafka-create-topic.sh --zookeeper slave1:2181 --partition 3 --topic leo-testkafka-list-topic.sh --zookeeper slave1:21818.说明:{
partiton: partion id
leader:当前负责读写的lead broker id
relicas:当前partition的所有replication broker listisr:relicas的子集,只包含出于活动状态的broker}
9.关闭kafka
pkill -9 -f server.properti