Continuous integration

This article or section has multiple issues. Please help improve the article or discuss these issues on the talk page. It is in need of attention from an expert on the subject. WikiProject Computer science or the Computer science Portal may be able to help recruit one. Tagged since March 2009. It may require general cleanup to meet Wikipedia's quality standards. Tagged since March 2008.

In software engineering, continuous integration (CI) implements continuous processes of applying quality control - small pieces of effort, applied frequently. Continuous integration aims to improve the quality of software, and to reduce the time taken to deliver it, by replacing the traditional practice of applying quality control after completing all development.

Contents 1 Theory 2 Recommended practices 2.1 Maintain a code repository 2.2 Automate the build 2.3 Make the build self-testing 2.4 Everyone commits every day 2.5 Every commit (to mainline) should be built 2.6 Keep the build fast 2.7 Test in a clone of the production environment 2.8 Make it easy to get the latest deliverables 2.9 Everyone can see the results of the latest build 2.10 Automate deployment 3 History 4 Advantages and Disadvantages 4.1 Advantages 4.2 Disadvantages 5 Software 6 See also 7 Further reading 8 References 9 External links

Theory

When embarking on a change, a developer takes a copy of the current code base on which to work. As other developers submit changed code to the code repository, this copy gradually ceases to reflect the repository code. When developers submit code to the repository they must first update their code to reflect the changes in the repository since they took their copy. The more changes the repository contains, the more work developers must do before submitting their own changes.

Eventually, the repository may become so different from the developers' baselines that they enter what is sometimes called "integration hell",^[1] where the time it takes to integrate exceeds the time it took to make their original changes. In a worst-case scenario, developers may have to discard their changes and completely re-do the work .

Continuous integration involves integrating early and often, so as to avoid the pitfalls of "integration hell". The practice aims to reduce timely rework and thus reduce cost and time.

The rest of this article discusses best practice in how to achieve continuous integration, and how to automate this practice (automation is considered^{[by whom?]} a best practice itself).

Recommended practices

Continuous integration - as the practice of frequently integrating one's new or changed code with the existing code repository - should occur frequently enough so that no intervening window remains between commit and build, and such that no errors can arise without developers noticing them and correcting them immediately.^[2] Normal practice is to trigger these builds by every commit to a repository, rather than a nightly (or weekly!) scheduled build. The practicalities of doing this in a multi-developer environment of rapid commits are such that it's usual to trigger a short timer after each commit, then to start a build when either this timer expires, or after a rather longer interval since the last build. Automated tools such as CruiseControl or Hudson offer this scheduling automatically.

Another factor is the need for a version control system that supports atomic commits, i.e. all of a developer's changes may be seen as a single commit operation. There is no point in trying to build from only half of the changed files.

Maintain a code repository

This practice advocates the use of a revision control system for the project's source code. All artifacts required to build the project should be placed in the repository. In this practice and in the revision control community, the convention is that the system should be buildable from a fresh checkout and not require additional dependencies. Extreme Programming advocate Martin Fowler also mentions that where branching is supported by tools, its use should be minimised. Instead, it is preferred that changes are integrated rather than creating multiple versions of the software that are maintained simultaneously. The mainline (or trunk) should be the place for the working version of the software.

Automate the build

A single command should have the capability of building the system. Many build-tools, such as make, have existed for many years. Other more recent tools like Ant, Maven, MSBuild or IBM Rational Build Forge are frequently used in Continuous Integration environments. Automation of the build should include automating the integration, which often includes deployment into a production-like environment. In many cases, the build script not only compiles binaries, but also generates documentation, website pages, statistics and distribution media (such as Windows MSI files, RPM or DEB files).

Make the build self-testing

This touches on another aspect of best practice, test-driven development. Briefly, this is the practice of writing a test that demonstrates a lack of functionality in the system, and then writing the code that makes the test pass.

The code once built, all the tests should run to confirm that it behaves as the developers expect it to behave.

Everyone commits every day

By committing regularly, every committer can reduce the number of conflicting changes. Checking in a week's worth of work runs the risk of conflicting with other features and can be very difficult to resolve. Early, small conflicts in an area of the system cause team members to communicate about the change they are making.

Many programmers^[3] recommend committing all changes at least once a day (once per feature built), and in addition performing a nightly build.

Every commit (to mainline) should be built

The system should build commits to the current working version in order to verify that they integrate correctly. A common practice is to use Automated Continuous Integration, although this may be done manually. For many, continuous integration is synonymous with using Automated Continuous Integration where a continuous integration server or daemon monitors the version control system for changes, then automatically runs the build process.

Keep the build fast

The build needs to complete rapidly, so that if there is a problem with integration, it is quickly identified.

Test in a clone of the production environment

Having a test environment can lead to failures in tested systems when they deploy in the production environment, because the production environment may differ from the test environment in a significant way.

Make it easy to get the latest deliverables

Making builds readily available to stakeholders and testers can reduce the amount of rework necessary when rebuilding a feature that doesn't meet requirements. Additionally, early testing reduces the chances that defects survive until deployment. Finding issues earlier also, in some cases, reduces the amount of work necessary to resolve them.

Everyone can see the results of the latest build

It should be easy to find out where/whether the build breaks and who made the relevant change.

Automate deployment

Most CI systems allow the running of scripts after a build finishes. In most situations, it is possible to write a script to deploy the application to a live test server that everyone can look at.

History

Continuous Integration emerged in the Extreme Programming (XP) community, and XP advocates Martin Fowler and Kent Beck first wrote about continuous integration circa 1999. Fowler's paper^[4] (and following book^[5]) is a popular^{[citation needed]} source of information on the subject. Beck's book Extreme Programming Explained^[6], the original reference for Extreme Programming, also describes the term.

Advantages and Disadvantages

Advantages

Continuous integration has many advantages:

• when unit tests fail or a bug emerges, developers might revert the codebase back to a bug-free state, without wasting time debugging
• developers detect and fix integration problems continuously - mitigating against any last-minute hiatus before release dates^{[clarification needed]}
• early warning of broken/incompatible code
• early warning of conflicting changes
• immediate unit testing of all changes
• constant availability of a "current" build for testing, demo, or release purposes
• immediate feedback to developers on the quality, functionality, or system-wide impact of code they are writing
• frequent code check-in pushes developers to create modular, less complex code^{[citation needed]}
• metrics generated from automated testing and CI (such as metrics for code coverage, code complexity, and features complete) focus developers on developing functional, quality code, and help develop momentum in a team^{[citation needed]}

Disadvantages

• initial setup time required
• well-developed test-suite required for best utility

Many teams using CI report that the advantages of CI well outweigh the disadvantages.^[7] The effect of finding and fixing integration bugs early in the development process saves both time and money over the lifespan of a project.

Software

Notable examples of continuous-integration software include:

• AnthillPro — continuous integration server by Urbancode
• Apache Continuum — continuous integration server supporting Apache Maven and Apache Ant. Supports CVS, Subversion, Ant, Maven, and shell scripts
• Apache Gump — continuous integration tool by Apache
• Automated Build Studio — commercial automated build, continuous integration and release management system by AutomatedQA
• Bamboo — commercial continuous integration server by Atlassian Software Systems
• Beebox — free continuous integration server by TechSolCom IT Group
• Bitten — Python/Trac-based continuous build system
• BuildBot — Python/Twisted-based continuous build system
• CABIE - Continuous Automated Build and Integration Environment — open source, written in Perl; works with CVS, Subversion, AccuRev, Bazaar and Perforce
• Cascade — commercial continuous integration tool; provides a checkpointing facility to build and test changes before they are committed
• Cerberus - lightweight, open source CI tool written in Ruby; works with CVS, Subversion, Perforce, Darcs and Git
• codeBeamer — Commercial collaboration software with built-in continuous integration features
• codendi - Open-source platform providing an interface with Hudson tool
• Cruise — commercial continuous integration and release management server by ThoughtWorks
• CruiseControl — Java-based framework for a continuous build process
• CruiseControl.NET — .NET-based automated continuous integration server
• CruiseControl.rb - Lightweight, Ruby-based continuous integration server that can build any codebase, not just Ruby. Released under the Apache Licence 2.0 licence
• CDash - continuous integration server, part of CMake
• ControlTier - open source (Apache license) deployment automation framework used for continuous deployment (automatic deployment at the end of the continuous integration loop)
• easyCIS — commercial continuous integration server by Vaclav Zahradnik
• ElectricCommander — build/test/release automation framework and continuous integration server by Electric Cloud
• FinalBuilder Server — commercial automated build and continuous integration server by VSoft Technologies
• Hudson — MIT-licensed, written in Java, runs in servlet container, supports CVS, Subversion, Mercurial, Git, Clearcase, Ant, NAnt, Maven, and shell scripts
• InstallAce — deployment automation software to automate installation of enterprise class applications.
• Jhbuild is a tool used to build the whole GNOME desktop from the git source, however, it can be used to build other projects creating a moduleset for it
• LuntBuild – a web-based tool for automating and managing builds. Runs in a Java Servlet container, and supports CVS, Subversion, Ant, Maven
• Nolio - a commercial software tool for creating, managing, and running, automated deployment workflows in multi-tier and multi-data center environments
• OpenMake Meister - commercial build-automation tool with continuous-integration features by OpenMake Software
• OpenMake Mojo - free continuous-integration server with workflow scheduling by OpenMake Software
• Parabuild - commercial continuous-integration system by Viewtier Systems
• Pulse - commercial continuous-integration server by Zutubi
• QuickBuild - commercial version of LuntBuild by PMEase with free community edition.
• Software Configuration and Library Manager — software configuration management system for z/OS by IBM Rational Software
• TeamCity — commercial continuous-integration server by JetBrains with free professional edition
• Team Foundation Server — commercial continuous integration server and source code repository by Microsoft
• Tinderbox — Mozilla-based product written in Perl

See comparison of continuous software for a more in depth feature matrix.

See also

• Build automation
• Continuous design
• Test-driven development
• Multi-stage continuous integration
• Comparisons of continuous-integration software

Further reading

• Duvall, Paul M. (2007). Continuous Integration. Improving Software Quality and Reducing Risk. Addison-Wesley. ISBN 0-321-33638-0. 

References

External links

• Continuous integration by Martin Fowler (an introduction)
• Continuous Integration at the Portland Pattern Repository (a collegial discussion)
• Cross platform testing at the Portland Pattern Repository
• Continuous Integration Server Feature Matrix (a guide to tools)
• Continuous Integration example
• Continuous Integration: The Cornerstone of a Great Shop by Jared Richardson (an introduction)
• A Recipe for Build Maintainability and Reusability by Jay Flowers
• Continuous Integration anti-patterns by Paul Duvall
• Continuous integration on a minimalist platform
• Extreme programming
• Continuous Integration with Hudson

stock | retire | vm
Why are we here?
All text is available under the terms of the GNU Free Documentation License
This page is cache of Wikipedia. History