Look Who it Was Random video

Scaling Webpack to Thousands of Concurrent Builds

262 views · Published 19 October 2018 · 19:01 · Indexed 8 November 2026

Channel: node.js · 2018 · Science & Technology

Watch on YouTube

Building JavaScript for the web is easier than it's ever been with babel, webpack & rollup doing all the heavy lifting for individual builds – but what if you need a lot of builds across multiple environments like development, test, and production? Introduced at Node.js Interactive 2016 Warehouse.ai is an open-source distributed build system supporting webpack, babel, and browserify that aims to make Serverless front-end deployments & rollback easy. 

This talk will cover the challenges (and solutions) for Warehouse to scale webpack & npm install to thousands of daily builds with high bursts of concurrency during peak hours. 

- Important details of the npm Registry HTTP API.
- How to scale compute bound Node.js worker systems in production with NSQ & kubernetes.
- How to handle complex user-defined webpack configs.
- How to make webpack builds reproducible over time for safe rollback.

Charlie Robbins
GoDaddy
Sr. Dir. Engineering

More from this channel