Professional Data: Using Elasticsearch's Aggregation Framework • Mark Harwood • GOTO 2015

3,590 views · Published 25 June 2015 · 44:46 · Indexed 14 November 2026

Channel: GOTO Conferences · 2015 · Science & Technology

Watch on YouTube

This presentation was recorded at GOTO Amsterdam 2015
http://gotoams.nl

Mark Harwood - Software Engineer at Elastic

ORIGINAL TALK TITLE
Professional Data - Wrestling Techniques Using Elasticsearch's Aggregation Framework

ABSTRACT
Getting useful answers out of your data doesn't require a team of expensive data scientists. Elasticsearch aggregations include some powerful algorithms out of the box that can wrestle your large datasets [...]

TIMECODES
0:00 Introduction
1:45 Search interface 20
2:57 Analytics interface of today
4:27 Optimised for real time
6:15 Worked examples
9:41 UK Housing data: percentiles
10:51 UK Housing data: terms
13:56 Geo as a common link between datasets: housing crime
15:13 Connected data: Enron emails
22:34 Recommendations: MovieLens data
23:05 Random samples should hold no surprises
24:38 Non random sample: people who liked Talladega nights
26:11 Problem: avoid analysis of poorly focused sets
27:31 How do we get a smaller, representative sample of users?
28:55 Putting search and analytics together..
32:37 Amazon marketplace reviews
35:58 Anatomy of an entity indexing groovy script
38:33 Drilling down into seller #187's fanboys
39:15 UK car roadworthiness test: raw data
39:37 Derived car attributes
41:29 Miles driven vs number of days for fix
43:19 In summary
44:24 Questions?

Download slides and read the full abstract here:
http://gotocon.com/amsterdam-2015/presentation/Professional%20Data%20-%20Wrestling%20Techniques%20Using%20Elasticsearch's%20Aggregation%20Framework

https://twitter.com/gotoamst
https://www.facebook.com/GOTOConference
http://gotocon.com
#Elasticsearch #Elastic #ELKstack #Data #bigdata 

Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech
Sign up for updates and specials at https://gotopia.tech/newsletter

SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
https://www.youtube.com/user/GotoConferences/?sub_confirmation=1

More from this channel