Look Who it Was Random video

Guillem Borrell - Python for Distributed Systems

3,195 views · Published 17 May 2016 · 1:33:48 · Indexed 10 November 2026

Channel: PyData · 2016 · Science & Technology

Watch on YouTube

PyData Madrid 2016

Most of the talks and workshop tutorials can be found here: https://github.com/PyDataMadrid2016/Conference-Info

From big data to supercomputing, most modern high-performance tools are concurrent and parallel. This tutorial introduces some of the tools that are available in the Python ecosystem to develop, deploy and maintain modern and efficient distributed applications.

This workshop will not cover trendy applications or bundled frameworks like Hadoop or Spark. It won't build recipies that you can reuse for any particular purpose. The goal is to buid a general comprehension about how to program distributed applications in a general way.

The workshop will walk through the following topics.
1. Distributed hardware. A short introduction to clouds and supercomputers.
2. Distributed software. Large distributed applications usually exploit task-based parallelism. Messaging is the way to make those tasks talk to each other. There are many different messaging strategies, protocols, transports, layers... Each one is suitable for a different case.
3. Parallel algorithms. A short introduction about some algorithms that incorporate messaging.
4. Threading and concurrency. If a task communicates and computes, it is doing two things at the same time, but it is not, since Python has a GIL...
5. Management, service discovery, logging and availability. Managing tens, hundreds or thousands of tasks can be tricky. But Python has tools that may simplify the management of parallel applications. 00:00 Welcome!
00:10 Help us add time stamps or captions to this video! See the description for details.

Want to help add timestamps to our YouTube videos to help with discoverability? Find out more here: https://github.com/numfocus/YouTubeVideoTimestamps

More from this channel