Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to push logs in elasticsearch #147

Open
RajGanguly opened this issue Jan 18, 2019 · 1 comment
Open

How to push logs in elasticsearch #147

RajGanguly opened this issue Jan 18, 2019 · 1 comment

Comments

@RajGanguly
Copy link

RajGanguly commented Jan 18, 2019

I included logstash in my Gemfile.
I added all the configuration in my development.rb.

However, when I restart my app server, I can only see a logstasher_development.log being created but no logs are getting indexed in the running elasticsearch server.

What am I missing here?

Using ruby-2.3.3 and rails 4.2

@AnrichVS
Copy link

Hi,

This gem does not provide any integration to Elasticsearch out of the box. It simply writes logs entries in JSON format, thus making it easier to use with Logstash.

I recommend using Filebeat to ingest your log file on your instance, and send that off to either Logstash or directly to Elasticsearch. See this guide for more info: https://journal.missiondata.com/devops-notes-experimenting-with-elk-stack-da53b1873430

Some of the info there is out dated, you'll have to google to find chunks of more up to date info, such as consulting the Filebeat documentation, Logstash documentation, etc. Your goal is to transfer your log data from the log file on your application instance (Filebeat) to Logstash (if your data requires further manipulation) or directly to Elasticsearch (if no transformation is required, or you're happy using Elasticsearch ingest nodes). Once the data is in Elasticsearch, you can use Kibana to visualize the data.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants