The CSSA have lined up a Tech Talk and Q&A Session with a former ANU Student - Matt Duggan - and Indeed Tokyo Engineering Manager to give you an opportunity to find out who they are, what they do, and how they solve big data problems at scale. It promises to be a very interesting talk!
RAD - How To Replicate Terabytes of Data Around the World Every Day
At Indeed, we use massive amounts of data to build our products and services. At first, we relied on rsync to distribute these data to our servers. This rsync system lasted for ten years before we started to encounter scaling challenges. So we built a new system on top of BitTorrent to improve latency, reliability, and throughput. Today, terabytes of data flow around the world every day between our servers. In this talk, I'll describe what we needed, what we created, and the lessons we learned building a system at this scale.
Matthew Duggan - Engineering Manager
"I'm an Engineering graduate from ANU now at Indeed, the world's largest job site, helping people around the world get jobs. My team uses Natural Language Processing and Machine Learning to extract salary data from millions of jobs every day. We deliver the data to job seekers on indeed.com, and aggregate it into company pages to help people make career decisions".
Date: Thursday 11th August, 2016
Time: 1pm start
Location: Engineering Lecture Theatre (Building # 32)
Registration: Not Required