Scaling Instagram Infrastructure
278,899
Published 2017-07-14
Deep-dive into 20+ talks from senior software developers over 2 days with parallel breakout sessions. Clarify your immediate dev priorities and get practical advice to make development decisions easier and less risky.
Register now: bit.ly/47tNEWv
----------------------------------------------------------------------------------------------------------------
Lisa Guo overviews Instagram's infrastructure, its history, multi-data center support, tuning uwsgi parameters for scaling, performance monitoring and diagnosis, and Django/Python upgrade.
Download the slides & audio at InfoQ: bit.ly/2uljG8j
This presentation was recorded at QCon London 2017.
All Comments (21)
-
Timestamps 0:00 Introduction (Lisa Guo) 2:21 1. Scale out 5:11 1.1 Instagram Stack Overview 5:46 1.2 Storage vs Computing 6:29 1.3 Scale out: Storage 8:13 1.4 Scale out: Computing 8:52 1.5 Memcache + consistency issues 12:05 1.6 DB load problem 14:01 1.7 Memcache Lease 15:12 1.8 Results, Challenges, Opportunities 17:03 2. Scale up 17:57 2.1 Monitor (Collect Data) 20:07 2.2 Analyze (C-Profile) 23:06 2.3 Optimize 26:19 2.3a Memory Optimizations 29:06 2.3b Network Latency Optimizations 30:40 2.4 Challenges, Opportunities 31:36 3. Scale Dev Team 33:06 3.1 What We Want 33:30 3.2 Tao Infrastructure 34:33 3.3 Source Control 36:17 3.4 How to ship code with 1 master approach? 37:54 3.5 How often do we ship code? 40:03 Wrap-up 41:15 Q&A
-
This was a fantastic presentation. She covered a huge amount of material in a short time. What they've done and how they've done it is very impressive.
-
InfoQ is doing excellent job by bringing these talks to us.
-
That’s the great presentation . To the point and not super technical . Newbie like me in the world of architecture can understand
-
"I need to learn about scaling" heads to youtube, finds this video "Wow, I now know EVERYTHING about scaling". The best video on scaling infrastructure i've found so far. No jargon, no acronym's, specific detail about exactly how things are balanced, routed, managed and replicated. Love it.
-
This is a treasure box ! Thank you Miss/Mrs XYZ for the super lucid explanation.
-
Great presentation! I'm dealing with many of the scaling challenges discussed by Lisa in my organization. Although they vary and Instagram's solution does not solve my challenges, but Lisa certainly offers any view of how great companies address them.
-
Every architecture video should be like this, instead of marketing BS.
-
This has been such an educational video. I feel excited about the problems, everything was so well covered and explained and So many aspects were touched without any redundant data. Thank infoq for this video. Super super intereseting.
-
A complex topic explained in a simple way. Thank you!
-
Kudos to infoQ team for bringing such tech videos.
-
Nice presentation. There are bunch of things that can be improved for detection of the time series jumps by Fourier transformation of the time series and comparing the two frequencies on a predetermined delta of difference.
-
it was a fantastic presentation. very clear, easy understand, and very detail,
-
Awesome concise high level presentation.
-
Well thought through presentation. Many takeaways.
-
Such an insightful presentaion from a developers point .. Thank you so much
-
Really fantastic presentation, thanks Lisa and InfoQ!
-
Extremely beneficial. Please have more of these
-
Great presentation. Great job Lisa !
-
One of the best presenter who I have ever seen.
