[trouble shooting]memory locking requested for elasticsearch process but memory is not locked
# DataBase/Elasticsearch2021. 4. 7. 10:44[trouble shooting]memory locking requested for elasticsearch process but memory is not locked

엘라스틱서치 실행시 아래와 같이 오류발생확인 [2021-04-07T09:46:19,467][ERROR][o.e.b.Bootstrap] [darksharavim.com] node validation exception [1] bootstrap checks failed. You must address the points described in the following [1] lines before starting Elasticsearch. bootstrap check failure [1] of [1]: memory locking requested for elasticsearch process but memory is not locked ulimit상태값 # ulimit -aS core file size (bl..

logstash debug test
# DataBase/Elasticsearch2021. 4. 6. 10:29logstash debug test

JSON데이터 준비 # vi cat SendMessage.json {"Hello": "World"} logstash debug test 파일생성 # vi /etc/logstash/conf.d/test.conf input { tcp { port => 5050 codec => json } } output { file { path => "/var/log/logstash/logstash.log" codec => rubydebug } } 5050포트로 json데이터를 받으면 output경로에 로그가 쌓이게끔 설정 실행 및 포트 확인 # /usr/share/logstash/bin/logstash -f test.conf Using JAVA_HOME defined java: /apps/java WARNING, usin..

logstash - grok debugger를 이용해서 apache log 파싱
# DataBase/Elasticsearch2021. 4. 3. 23:02logstash - grok debugger를 이용해서 apache log 파싱

어떤 패턴을 사용해야할지 모를때 확인가능한 사이트 grokdebug.herokuapp.com/discover?# Grok Debugger grokdebug.herokuapp.com grokconstructor.appspot.com/do/match?example=2 Test grok patterns Test grok patterns 10.121.123.104 - - [01/Nov/2012:21:01:04 +0100] "GET /cluster HTTP/1.1" 200 1272 MATCHED httpversion 1.1 request /cluster timestamp 01/Nov/2012:21:01:04·+0100 auth clientip 10.121.123.104 bytes 1272 response 200 ..

ELK filebeat 설치(RPM)
# DataBase/Elasticsearch2021. 4. 2. 16:02ELK filebeat 설치(RPM)

설치환경 # cat /etc/redhat-release CentOS Linux release 7.9.2009 (Core) # java -version openjdk version "1.8.0_282" OpenJDK Runtime Environment (build 1.8.0_282-08) OpenJDK 64-Bit Server VM (build 25.282-b08, mixed mode) 호환성확인 www.elastic.co/kr/support/matrix Elastic Support Matrix | Elasticsearch Everything you need to launch the Elastic (ELK stack). From Oracle to IBM, Ubuntu to Windows, Firefox t..

ELK filebeat 설치(docker)
# DataBase/Elasticsearch2021. 3. 31. 18:35ELK filebeat 설치(docker)

도커버전 # docker -v Docker version 1.13.1, build 0be3e21/1.13.1 elasticsearch image 다운 # docker pull docker.elastic.co/elasticsearch/elasticsearch:7.6.2 Trying to pull repository docker.elastic.co/elasticsearch/elasticsearch ... 7.6.2: Pulling from docker.elastic.co/elasticsearch/elasticsearch c808caf183b6: Pull complete d6caf8e15a64: Pull complete b0ba5f324e82: Pull complete d7e8c1e99b9a: Pull com..

image