TESTING IN CI/CD |
Posted: May 21, 2019 |
In the previous article we discussed the various use cases where in agile teams would automate their test cases. One of the cases was – We want to integrate tests with every build and have a continuous integration as a part of the build process In this article, we will address integrating tests in a continuous integration / continuous delivery platform.
Let’s start with the basics first – What is continuous integration ? In simple terms, development teams can integrate their code into a shared repository. This helps in maintaining code quality and identifying potential issues with the local version of the code at an early stage.
What is continuous delivery ? Everything that is being continuously merged by the development team, is continuously deployed to the live environment. Continuous delivery is often coined as ‘Continuous Deployment’ as well. Since most developers work in parallel , continuously integrating their code into one repository would mean that the master branch is continuously updated with new features. In order to ensure that there is no compromise in the code quality with so many changes happening rapidly, testing must happen at the same pace. It should be no surprise that manual testing at this moment would not be the best approach in order to achieve this. Automated testing is the key to successful testing in the CI/CD pipeline.
Stages of Continuous Delivery Develop : The developer builds the code as per the new requirement or the feature requested Writing tests : Once the code is written, tests need to be written for the same. At this point, these tests as usually unit tests written by the developers. Local Testing : This is then locally tested in order to check if all tests are passing and the code does not break. Often as percentage is set as the pass rate which the tests running need to meet. Rebase & Resolve conflict : In an actual development scenario, there will be multiple people merging their code. The developer needs to make sure that his branch is updated at all times. Updating the branch with the latest merged code is called ‘Rebasing’ . Once it’s rebased there will likely be some conflicts which need to be resolved. After that, the tests are run again against the rebased code. Commit : Once the tests have passed, the code is then ready to be committed with all the changes. Build : The source code developed is then combined to build a deployment artifact which can be run on an instance i.e, the server. This code is now ready to be deployed to different testing environments. UAT : The code is then deployed to a test server where testers start to test the feature. These tests can be automated as well manual. Merge : If the commit that’s under testing is approved by the testers, this is then merged into the master branch. Production deployment : Once the code is merged, this merged code is then deployed to production.
The above process needs to be done with every build coded by the developers. Where does automation testing fall in this CI/CD pipeline ? Automated testing ideally happens once the build stage has been completed and the code can be deployed. Unit tests, UI tests, Integration tests can all be run at this stage. These tests help in ensuring that the code meets a standard of quality. This phase can last from few minutes to a couple of hours depending on how the automation that needs to be run is architected. Tests can be run in parallel in order to execute them more quickly. If a code fails during the test phase, the build can be rejected without further investing any manual testing time.
Tools used for CI/CD
Best practices for CI/CD pipeline to make the best out of test automation
Conclusion Automating tests is an important part in successful deployment of projects while maintaining a standard of quality. Ensuring tests are run at every stage gives a good transparency on the quality of the code. Bugs can be discovered at an early stage and any delays which can be caused by it can be planned in a timely manner. Having a CI/CD pipeline with tests integrated helps in speeding up the testing and deployment process. Article Source - https://ambaconsultants.com/archives/74440/testing-in-ci-cd/
|
||||||||||||||||||
|