kafka 啟動報錯：missingTopicsFatal is true

報錯信息

org.springframework.context.ApplicationContextException: Failed to start bean 'org.springframework.kafka.config.internalKafkaListenerEndpointRegistry'; nested exception is java.lang.IllegalStateException: Topic(s) [async] is/are not present and missingTopicsFatal is true
at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:185) ~[spring-context-5.2.0.RELEASE.jar!/:5.2.0.RELEASE]
at org.springframework.context.support.DefaultLifecycleProcessor.access$200(DefaultLifecycleProcessor.java:53) ~[spring-context-5.2.0.RELEASE.jar!/:5.2.0.RELEASE]
at org.springframework.context.support.DefaultLifecycleProcessor$LifecycleGroup.start(DefaultLifecycleProcessor.java:360) ~[spring-context-5.2.0.RELEASE.jar!/:5.2.0.RELEASE]
at org.springframework.context.support.DefaultLifecycleProcessor.startBeans(DefaultLifecycleProcessor.java:158) ~[spring-context-5.2.0.RELEASE.jar!/:5.2.0.RELEASE]
at org.springframework.context.support.DefaultLifecycleProcessor.onRefresh(DefaultLifecycleProcessor.java:122) ~[spring-context-5.2.0.RELEASE.jar!/:5.2.0.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:894) ~[spring-context-5.2.0.RELEASE.jar!/:5.2.0.RELEASE]
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.finishRefresh(ServletWebServerApplicationContext.java:162) ~[spring-boot-2.2.0.RELEASE.jar!/:2.2.0.RELEASE]
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:553) ~[spring-context-5.2.0.RELEASE.jar!/:5.2.0.RELEASE]
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141) ~[spring-boot-2.2.0.RELEASE.jar!/:2.2.0.RELEASE]

報錯原因：消費監(jiān)聽接口監(jiān)聽的主題不存在時，默認(rèn)會報錯

解決方法：

配置文件中將listener的屬性missingTopicsFatal設(shè)置為false

spring:
  kafka:
    listener:
      missing-topics-fatal: false

kafka常見報錯警告異常解決

1.自行修改server.properties中broker id后造成與meta.properties中數(shù)據(jù)不匹配

kafka.common.InconsistentBrokerIdException: Configured broker.id 2 doesn't match stored broker.id 1 in meta.properties. If you moved your data, make sure your configured broker.id matches. If you intend to create a new broker, you should remove all data in your data directories (log.dirs).

2.__consumer_offsets這個topic是由kafka自動創(chuàng)建的，默認(rèn)49個，這個topic是不能被刪除的！

Error while executing topic command : Topic __consumer_offsets is a kafka internal topic and is not allowed to be marked for deletion.

為什么這里會是這樣存儲__consumer_offsets的呢：

• [1.] 將所有 N Broker 和待分配的 i 個 Partition 排序
• [2.] 將第 i 個 Partition 分配到第(i mod n)個 Broker 上

3.刪除topic時

Topic frist is already marked for deletion.

徹底刪除topic：

• [1. ] 刪除Topic，delete.topic.enable=true這里要設(shè)置為true
• [2. ] 刪除log日志
• [3. ] 刪除ZK中的Topic記錄

命令：./bin/zkCli.sh

找到topic所在的目錄：ls /brokers/topics

執(zhí)行命令：rmr /brokers/topics/{topic name}即可，此時topic被徹底刪除。

另外被標(biāo)記為marked for deletion的topic你可以在zookeeper客戶端中通過命令獲得：ls /admin/delete_topics/{topic name}，如果你刪除了此處的topic，那么marked for deletion 標(biāo)記消失

當(dāng)然，這里是你delete.topic.enable設(shè)置為false時Zookeeper下才會有這個節(jié)點。

以上為個人經(jīng)驗，希望能給大家一個參考，也希望大家多多支持腳本之家。

最新評論