ElasticSearch for real-time statistics

1124435 pts.
Tags:
AWS
Big Data
ElasticSearch
Hadoop
We have to log millions and millions of small log documents on a weekly basis. This includes:
  • Ad hoc queries for data mining
  • Joining and filtering values
  • Full-text search with Python
We thought about using HBase and running Hadoop jobs to generate stat results. But the problem is that the results have to be real-time. So now we're thinking of using ElasticSearch. Is that a good idea?
0

Answer Wiki

Thanks. We'll let you know when a new response is added.
Send me notifications when members answer or reply to this question.

Discuss This Question:  

 
There was an error processing your information. Please try again later.
Thanks. We'll let you know when a new response is added.
Send me notifications when members answer or reply to this question.

Forgot Password

No problem! Submit your e-mail address below. We'll send you an e-mail containing your password.

Your password has been sent to:

To follow this tag...

There was an error processing your information. Please try again later.

Thanks! We'll email you when relevant content is added and updated.

Following

Share this item with your network: