Forrester Ranks Continuous Integration Vendors in Wave Report

Providing valuable guidance into the rapidly growing Continuous Integration and Continuous Delivery market and confirming the Application Development and Delivery (AD&D) market’s growing maturity, Forrester recently ranked CI Vendors in its Wave Report on Continuous Integration Tools.

The report (download a complimentary copy of the Forrester Wave Report for Continuous Integration Tools here) is based on the following criteria that helps evaluate vendors and their products.

Vendor-specific Criteria for the Forrester Wave CI Report

• A demonstrable, comprehensive continuous integration product

  • Starting from code check-in into a version management system, starting a build, provisioning a test environment, and deploying the build into the testing environment and kicking off automated testing.

• At least 25 paying enterprise clients

  • Forrester’s definition of an enterprise client is a company with a minimum of 1,000 employees.

• Significant interest from Forrester’s user clients

  • Vendors included in their CI Report receive interest in the form of inquiries, survey responses, and more.

https://js.hscta.net/cta/current.js

hbspt.cta.load(1169977, '05489183-4551-4d0e-a73f-b2bb8d741274', {});

Our Summary of the Evaluation Criteria for Continuous Integration Tools for the Forrester Wave CI Report

• Current offering of the CI product

  • How easy is the product to use?

  • What pricing and licensing models does the vendor offer?

  • Does the product provide build automation, analytics, and DevOps tool chain integrations?

  • Further important components: security features and support for container technologies.

• Strategy and product roadmap

  • What is the vendor’s market approach?

  • What does the product strategy look like?

  • What is the go-to-market strategy for the product?

  • What is on the product’s execution roadmap?

• Market presence

  • How much revenue does the vendor create with the product?

  • How many customers/units installed does the product have?

  • How much corporate profitability does the product generate?

  • Does the vendor have at least 25 paying enterprise clients? Forrester defines an enterprise as a company with at least 1,000 employees.

Codeship is one of only a few CI tools that offer pipeline-as-code, enabling developers to version and reuse pipelines far more easily than traditional, GUI-based configuration systems. It also supports Docker natively and supports building Docker images as an output of the CI process.

The Forrester Wave CI Report: From Codeship’s Perspective

Codeship was one of 10 vendors chosen to take part in the report. Further important points for consideration were partner support, customer satisfaction, and market share.

Forrester puts a significant effort into evaluating vendors. Their process aims to filter out any marketing buzz, and they work in a precise manner to truly evaluate every aspect of the vendor’s offering.

From Codeship’s perspective, the assessment by Forrester appeared to be extremely in-depth, with a goal to fully understand our products, their capabilities, and the product vision. The process felt very much like large enterprises evaluating products and vendors, if not even more in detail.

Having gone through their meticulous evaluation process, which took multiple months, Codeship is very proud to rank as a strong performer in the Forrester Wave Continuous Integration Tools Report.

"AD&D leaders empower their teams with CI tools that automate software delivery tasks and easily integrate with other parts of the tool chain, without unwanted complication and management overhead. Codeship sees the future, and it’s Docker." - Forrester Wave Continuous Integration Tools Report

Key Findings of the Forrester Wave Continuous Integration Tools Report

The following are what we feel as key findings mentioned in the report. Make sure to download the full report here.

• The pace and scale in which the drive to automation is happening within companies would have been unthinkable only 10 years ago.

• Adoption of CI tools is growing as more organizations move to Agile and DevOps. This is leading to smaller, autonomous teams.

• As AD&D organizations are becoming more global and distributed and traditional methodologies are shifting, modern CI tools are required to help facilitate that change.

• Modern CI tools are integrating with DevOps tools to help test and deploy software end-to-end.

Moving Ahead with Continuous Integration

There are several things to consider when choosing and implementing a continuous integration solution. CI helps automate your code delivery pipeline and enables your teams to collaborate without stepping on each other’s toes.

Modern tools like Codeship do even more than that: Codeship integrates with DevOps tools, gives insights into build performance, notifies you and your teams about breaking changes, and gives your organization and developers complete flexibility and control of how to set up development workflows so you can deliver applications from developers’ desktops to production servers in minutes instead of weeks or months.

If you are interested in learning more about Codeship you can request a free consultation or download the Forrester Wave Report on Continuous Integration Tools for free here.