Tanmay K. Mohapatra - Crunching Big Data with Julia
349 views · Published 30 October 2015 · 19:37 · Indexed 14 November 2026
Channel: Hasgeek TV · 2015 · Science & Technology
This talk will use Elly.jl to demonstrate a big data workflow in Julia. Elly is a Hadoop HDFS and Yarn client. It is a pure Julia implementation with no dependencies on libhdfs. It provides: A familiar Julia ClusterManager interface, making it possible to use the familiar Julia parallel constructs on a Yarn cluster: addprocs, @parallel, spawn, pmap, etc. Lower level APIs to write native Yarn applications. A familiar Julia IO API for accessing HDFS files. We shall use Elly and a few associated Julia packages to process a few example datasets. https://juliacon.talkfunnel.com/2015/16-crunching-big-data-with-julia
More from this channel
-
3:19
Flipkart on Scaling PHP in the Cloud
-
35:00
On web standards and accessibility
-
1:05:20
Introduction to HTML5 boilerplate
-
43:45
Bits, bytes and blobs -Mrinal Wadhwa
-
52:30
A primer on ECMAScript 5 -Rajasekharan Vengalil
-
50:11
Zero to App with jQuery Mobile -Anirudh Sanjeev
-
34:26
JavaScript Gone Wild -Akash Mahajan
-
39:32
Bulding great mobile web apps: Some things you might want to know -Shwetank Dixit