The High-level WTF on "Scheduling"

Episode 65 · June 11th, 2016 · 55 mins 22 secs

About this Episode

SPONSOR

Show notes

Father’s Day

MesosCon

  • Platform Infrastructure at Twitter: The Past, Present and - Future - Chris Pinkham, VP of Engineering, Twitter
  • Forgot to talk about this, but here are my notes from the MesosCon presentation by Twitter
  • Former Nimbula founder (Oracle acquisition), early AWS founder.
  • Twitter's kinda big deal, maybe you've heard of them. Over 1000 services manage Twitter, over 1,000,000 cores.
  • http://twitter.github.io
  • Heron is a newly open-sourced replacement for Storm. Supporting all of our own code isn't sustainable, need an open source community.
  • The Ellen Degeneres photo tweet from the 2015 Academy Awards knocked a couple of services over. 25% traffic spike, hit 255k/tweets per second. 2016 Academy Awards had 2x the traffic, no failures.
  • 30,000 node Mesos cluster (probably largest). "We don't like being the biggest of anything, we find the edge cases." 130,000,000 containers launched daily.
  • Some of their acquisitions were in public cloud, they don't move them in-house. They're actually pushing new services out to AWS where they can. Vine, TellApart, Crashlytics, MoPub, BlueFin, etc. Ad-serving is mostly in AWS. Users: Time Warner, Twitter (30,000 host deployment), Apple Siri.

What exactly is scheduling?

  • BMC CONTROL-M
  • Coté gets Matt to "checks out" his crudes understanding. (Spoiler: Checks out.)

Serverless, what’s the deal?

Mid-roll

BONUS LINKS!

Not covered in show:

Somebody’s using Kubernetes

  • Hear the tale!
  • Concur & Barkly Protects
  • Both shops did customizations to the codebase (AWS AZ & ELB support, Prometheus)

AWS & Australia News

Coté’s revamped Pivotal Conversations Podcast

Typosquatting Package Managers

  • Seriously messed up.
  • “In the thesis itself, several powerful methods to defend against typo squatting attacks are discussed. Therefore they are not included in this blog post.”

A Docker on every HPE Server

  • Running on HPE
  • Reference Architectures!
  • HPE 3PAR and SiteScope plugins!
  • Maybe Brandon can regale us with some history: tales of The Mercury Wars!
  • Also, some ALM stuff. Sadly, I don’t have access to the IDC reports on this, however, they’re expecting big things: “IDC's analysis of this market resulted in worldwide agile application life-cycle management software 2014 revenue of $450.3 million, up 30.5% from the 2013 revenue of $345 million. IDC expects very strong growth for agile ALM software for the 2014–2019 time frame, with growth to $1.8 billion by 2019 and a high CAGR of 32%”
  • erry-one doin’ it! What’s up with Chef’s ALM/CD stuff? Pivotal circle of code vision, with ConcourseCI.

Recommendations