ELK Stack
ElasticHQ
Elasticsearch 优化建议
ELK下es索引管理工具-curator
Elasticsearch
indices health 状态 INITIALIZING
Elasticsearch API
集群扩容/退役节点
使用 logstash + kafka 迁移 elasticsearch 数据
Elasticsearch:跨集群复制 Cross-cluster replication(CCR)
Elasticsearch 数据迁移
mapping 创建/修改
Ingest-Attachment
memory is not locked
Ingest Node
中文分词器
Elasticsearch single machine multi-instance
08.通过reindex迁移ES数据
02.Deploy ECK in your Kubernetes cluster
03.在 ARM 上运行 Elasticsearch
01.Elasticsearch 7.12.0 (rpm)
01.ES 节点管理
02.Master Meta
03.ES Data 存储
04.Data 格式
05.通过snapshot迁移ES数据
06.通过logstash迁移ES数据
07.通过elasticdump迁移ES数据
ELK 收集 Tomcat 日志
ES 修改字段数据类型
Reindex API
大分片治理思路
Elasticsearch 8.X 集群部署
elasticsearch-7.17.0
ES数据备份到HDFS
Failed to flush export bulks / bulk [default_local] reports failures when exporting documents
max_shards_per_node
ElasticSearch Check cluster status
Loadgen
Index Settings
Split Index
ElasticSearch 集群管理
Elasticsearch snapshot
elasticsearch optimization
集群再平衡&预热
推迟分片分配
分片分配和集群路由
refresh、flush、merge
Watcher
如何解决 Elasticsearch 中未分配的分片
can not run elasticsearch as root
kibana
install Kibana 7.12.1
集群监控
install Kibana 8.3.2
Rebuild Kibana Index
Logstath
02.Pipelines模式
01.logstash配置文件
logstash配置java环境
Logstash输出到Elasticsearch
03.Logstash输入 & 过滤 & 输出
07.收集TCP/UDP日志
06.收集Nginx访问日志
05.Logstash收集Tomcat日志
04.Logstash 收集日志
input 模块
Installing X-Pack for the Elastic Stack
Beat
01.Filebeat
02.Heartbeat
03.Metricbeat
04.Packetbeat
05.Auditbeat
06.Journalbeat
07.Functionbeat
security
01.elasticsearch-security_es
02.elasticsearch-security_es权限管理API概览
analysis
01.analyzer简介及char_filter组件
02.analyzer-tokenizer
03.analyzer-token_filter
04.内置analyzer和analyze-API使用
05.analysis-normalizer应用
Index
01.elasticsearch-mapping 解析
12.索引缓存、refresh、flush等操作
11.索引模板
10.索引设置
09.别名设置
08.Mapping设置
07.索引的滚动操作
06.索引的收缩和拆分
05.索引的基本操作
04.dynamic_mapping_and_index_template
03.elasticsearch-mapping-param解析
02.elasticsearch-meta-field元字段
13.refresh和flush操作
使用 ELK 实现日志监告警
本文档使用 MrDoc 发布
-
+
home page
max_shards_per_node
# 1.报错信息 ``` [WARN ][o.e.x.m.e.l.LocalExporter] [es03.kpt.rongtime.aliapse5.id] unexpected error while indexing monitoring documentorg.elasticsearch.xpack.monitoring.exporter.ExportException: RemoteTransportException[[es01.kpt.rongtime.aliapse5.id][10.107.0.247:29300][indices:admin/create]]; nested: IllegalArgumentException[Validation Failed: 1: this action would add [6] total shards, but this cluster currently has [2998]/[3000] maximum shards open;]; at org.elasticsearch.xpack.monitoring.exporter.local.LocalBulk.lambda$throwExportException$2(LocalBulk.java:125) ~[x-pack-monitoring-7.4.2.jar:7.4.2] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195) ~[?:?] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:177) ~[?:?] at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) ~[?:?] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150) ~[?:?] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:497) ~[?:?] at org.elasticsearch.xpack.monitoring.exporter.local.LocalBulk.throwExportException(LocalBulk.java:126) [x-pack-monitoring-7.4.2.jar:7.4.2] at org.elasticsearch.xpack.monitoring.exporter.local.LocalBulk.lambda$doFlush$0(LocalBulk.java:108) [x-pack-monitoring-7.4.2.jar:7.4.2] at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:62) [elasticsearch-7.4.2.jar:7.4.2] at org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43) [elasticsearch-7.4.2.jar:7.4.2] at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:70) [elasticsearch-7.4.2.jar:7.4.2] at org.elasticsearch.action.support.TransportAction$1.onResponse(TransportAction.java:64) [elasticsearch-7.4.2.jar:7.4.2] at org.elasticsearch.action.support.ContextPreservingActionListener.onResponse(ContextPreservingActionListener.java:43) [elasticsearch-7.4.2.jar:7.4.2] at org.elasticsearch.action.ActionListener.lambda$map$2(ActionListener.java:145) [elasticsearch-7.4.2.jar:7.4.2] at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:62) [elasticsearch-7.4.2.jar:7.4.2] at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:62) [elasticsearch-7.4.2.jar:7.4.2] at org.elasticsearch.action.bulk.TransportBulkAction$BulkOperation.doRun(TransportBulkAction.java:421) [elasticsearch-7.4.2.jar:7.4.2] at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.4.2.jar:7.4.2] at org.elasticsearch.action.bulk.TransportBulkAction.executeBulk(TransportBulkAction.java:551) [elasticsearch-7.4.2.jar:7.4.2] at org.elasticsearch.action.bulk.TransportBulkAction$1.onFailure(TransportBulkAction.java:287) [elasticsearch-7.4.2.jar:7.4.2] at org.elasticsearch.action.support.TransportAction$1.onFailure(TransportAction.java:79) [elasticsearch-7.4.2.jar:7.4.2] at org.elasticsearch.action.support.ContextPreservingActionListener.onFailure(ContextPreservingActionListener.java:50) [elasticsearch-7.4.2.jar:7.4.2] ``` 问题原因 ``` [indices:admin/create]]; nested: IllegalArgumentException[Validation Failed: 1: this action would add [6] total shards, but this cluster currently has [2998]/[3000] maximum shards open;]; ``` 显示分片打开超过1000 的分片 Elasticsearch 7.x 默认 cluster.max_shards_per_node 为 1000 # 2.解决方法 通过API 进行修改 ,调整分片为每个节点的分片为10000 ``` PUT /_cluster/settings { "persistent": { "cluster": { "max_shards_per_node":10000 } } } ``` - transient 临时 - persistent 永久 启动后验证一下: ``` GET /_cluster/settings ```
Seven
Oct. 8, 2022, 11:20 a.m.
转发文档
Collection documents
Last
Next
手机扫码
Copy link
手机扫一扫转发分享
Copy link
Markdown文件
share
link
type
password
Update password