In 2014 I left ThoughtWorks and joined HedgeServ, a leading hedge fund administrator, in Manhattan. I started as Senior Director of Engineering, overseeing 68 highly-skilled developers and QAs and left as Chief Science Officer at the end of 2016. I enjoyed my time at HedgeServ, and would highly recommend it for someone wanting to get into Fin-Tech, and experience the pressure for increased release cadence and the problem solving to get there.
I was very pleased to find when I arrived that HedgeServ was already doing Trunk Based Development, and only required a small tweak to their workflow.
New applications
My achievements include the spinning up of four projects (3 applications, 1 service), with fast builds that followed the ‘test pyramid’ closely with a suite of Selenium tests close out the build (for the 3 UI ones). Three of the four new apps used Service Virtualization (SV) in the build in order be speedy.
In one particular case the build time for compile, unit tests, integration tests, and Selenium tests was 30 seconds, and each commit would reach UAT, using Chef scripts to handle the deployment. Business leadership was appreciative of the faster cycle times. The solution was Java and AngularJS, and the fire-hose into UAT could be adjusted to allow an audit-approved sign-off sequence before go-live, that used Chef scripts to verify the approvals.
DevOps pieces
Monolith split into Micro applications.
I also redesigned and oversaw the rework of the web tier’s codebase to have separations between the different web applications so that they could fit a Google style of site composition1 (including authentication). The different apps had to agree on URLs, cookies, redirects in order to be stitched together into a single site experience by the load balancer. This allowed each to have separate release cadences, and different modernization and investment backlogs and emphasis.
Test execution reduction via impact mapping
This most recently detailed on Martin Fowler’s website as a guest posting.
I pioneered techniques to advance calculate the impacted tests for a commit and only run those, as a quicker proof of correctness. I went as far as to provide the proofs of concept in Java2 and Python3, and it is been productionized since I left. This is a general purpose solution: In a perpetually running CI daemon is running one test at a time, and working out what prod code was covered, then reversing it to store it in a map, which itself is represented in text and committed. Later, with a given change set (one or more commits) in regular CI, only impacted tests are run, for a greatly shortened test suite run. Microsoft is doing some impacted test reduction their ALM features of Visual Studio4,5, but it is unclear whether it is to do with code-coverage mappings.
-
Reducing Test Times by Only Running Impacted Tests (Jan, 2015, my blog) ↩
-
Reducing Test Times by Only Running Impacted Tests - Python Edition (Jan, 2015,my blog) ↩
-
Accelerated Continuous Testing with Test Impact Analysis – Part 1 (Mar, 2017, Microsoft) ↩
-
Accelerated Continuous Testing with Test Impact Analysis – Part 2 (May, 2017, Microsoft) ↩