Automating the Automation Tools at Capital One

By

4 minute read time

Listening to his talk, it seems like George Parris and his team at Capital One aren't keeping "banker's hours." George is a Master Software Engineer, Retail Bank DevOps at Capital One. At the All Day DevOps conference, George gave a talk entitled Meta Infrastructure as Code: How Capital One Automates our Automation Tools with an Immutable Jenkins, describing how they automated the DevOps pipeline for their online account opening project for Capital One, a major bank in the United States. Of course, there is a lot to learn from their experience.

parris1.png

George started by pointing out that software development has evolved - coming a long way even in the last few years. Developers now design, build, test, and deploy, and no longer build physical infrastructure - they live in the cloud. Agile infrastructure is rapidly replacing Waterfall development as code, and DevOps practices.

Where we see these technologies and methodologies implemented, IT Operations teams are acting more like developers, designing how we launch our applications. Development teams are also more responsible for uptime, performance, and usability. And, operations and development work within the same tribe.

George used the Capital One Online Account Opening project to discuss how they automate their automation tools - now a standard practice within their implementation methodology.

parris2.png

For starters, George discussed how Capital One deploys code (hint: they aren't building new data centers). They are primarily on AWS, they use configuration management systems to install and run their applications, and they, "TEST, TEST, TEST, TEST, at all levels." Pervasive throughout the system is immutability - once created, the state of an object cannot change. As an example, if you need new server configurations, you create a new server and test it outside of production first.

They use the continuous integration/continuous delivery model, so anyone working on code can contribute to the repositories that initiate testing. Deployments are moved away from the scheduled release pattern. George noted that, because they are a bank, regulations prevent their developers from initiating a production change. They use APIs with the product owners to automatically create tickets, and then product owners accept tickets, making the change in the production code. While this won't apply to most environments, he brought it up to demonstrate how you can implement continuous delivery within these rules.

Within all this is the importance of automation. George outlined their four basic principles of automation and the key aspects of each:

  • Principle #1 - Infrastructure as Code. They use AWS for hosting, and everything is in a Cloud Formation Template, which is a way to describe your infrastructure using code. AWS now allows you to use CFTs to pass variables between stacks. Using code, every change can be tested first, and they can easily spin-up environments.
  • Principle #2 - Configuration as Code. This is also known as configuration management systems (they use Chef and Ansible). There are no central servers, changes are version controlled, and they use "innersourcing" for changes. For instance, if someone needs a change to a plugin, they can branch, update, and create a pull request.
  • Principle #3 - Immutability. Not allowing changes to servers once deployed prevents "special snowflakes" and regressions. Any changes are made in code and traverse a testing pipeline and code review before being deployed. This avoids what we all experienced - the server that someone, who is no longer around, set up and tweaked differently than anything else, and didn’t document what was done.
  • Principle #4 - Backup and Restore Strategy. A backup is only as good as your restore strategy. You know the rest.

If you missed any of the other 30-minute presentations from All Day DevOps, they are easy to find and available free-of-charge here. Finally, be sure to register you and the rest of your team for the 2017 All Day DevOps conference here. This year's event will offer 96 practitioner-led sessions (no vendor pitches allowed). It's all free, online on October 24th.

Picture of Derek Weeks

Written by Derek Weeks

Derek serves as vice president and DevOps advocate at Sonatype and is the co-founder of All Day DevOps -- an online community of 65,000 IT professionals.

Tags