CI Job Configurations
Last updated
Was this helpful?
Last updated
Was this helpful?
The best practices to follow while performing CI/CD based on are discussed in the following article.
Usage: Any Test Environment
Overview: Automatic Incremental Deployment can be used for staging/production environment as long as the sufficient test automation is in place (which is triggered by merge into master, which runs deploy to Staging + full regression test suite and only deploys to Production if all tests pass)
Benefits:
the only true Continuous Integration job
low maintenance
full control through GIT (Agile AF)
Usage: Any environment with scheduled deployment windows, i.e. UAT where testers expect stability throughout the testing phase; can also be used to deploy merged code from dev branch to dev orgs.
Overview: Same as the above but without the on-commit trigger.
Benefits:
still low maintenance, but better control over deployment schedule
allows developers to deploy to their dev orgs without requiring access to edit baseline revisions
Usage: Any environment with scheduled deployment windows, i.e. UAT where testers expect stability throughout the testing phase; can also be used to deploy merged code from dev branch to dev orgs.
Overview: Requires the Pull Request Support plugin enabled on the repository used. Has to always be accompanied by a deployment job (automatic incremental deployment) that deploys any code from the upstream branch to the validation org; the validation org has to be in sync with the upstream branch at all times.
Usage: Validate the full release package in parallel with CI deployments running in test environments.
Overview: Can be either on-commit or scheduled, depending on the expected validation time and commit velocity (if running all local tests with a lot of revisions being committed, the schedule makes more sense). This works best if having a dedicated environment, where no developers have access, but can also use the Staging environment (with an on-commit deploy job on a staging branch later on in the flow).
Limitations:
When using a dedicated validation org requires a manual deployment after the release to keep in sync with Production
Requires a manual baseline revision update after each release
Can be compromised when deployment depends on pre-deployment manual steps; making the releases as small and as often as possible reduces this risk.
Usage: Production validation at the start of Staging (regression); often the final week or two of a large release will be dedicated to final sign-offs; production validation should be triggered as early as possible.
Overview: This is a special case combining types 1 and 4; job fires either on commit or as a post-activity of another job, but runs a validate-only build.
Limitations
When using a dedicated validation org requires a manual deployment after the release to keep in sync with Production
Requires a manual baseline revision update after each release
Can be compromised when deployment depends on pre-deployment manual steps; making the releases as small and as often as possible reduces this risk.
A scheduled job pulling changes after a given date (or last retrieve when incremental) into the backup repository. This can be used to get more granular change tracking, as Branching Baseline cannot be scheduled.
Allows executing functional tests (i.e. Provar, AccelQ) without the need for code deployment.
This can be used to control the execution flow (i.e. trigger tests only after data migration is done by the previous CI Job or trigger another deployment only after tests are done).
By default, all jobs will use Salesforce Defaults, which is RunLocalTests for Production orgs and NoTestRun for Sandbox orgs.
RunTestsBasedOnChanges is a custom feature in AutoRABIT, which dynamically generates input for the RunSelectedTests test level based on a mapping stored in the Admin > Salesforce Org Mgmt page.
Rollback should only be used in the highest environments (Stage/Production). Reverting changes in lower environments should always be done through GIT, to avoid desynchronizing the org from its branch.
In Production, the Rollback can be used to revert the deployment right away, in order to address a critical issue found after the release. The stage can be used to validate the rollback package, as often there will be errors specific to rollback, which would have to be addressed by modifying its contents on the fly (i.e. a new Flow created or a new PermissionSet having users already assigned).
Rollback package can also be validated right after the deployment in Production, to prepare a Quick Deploy, for even faster reaction time in case of issues found during business hours.
Aside from the option to exclude IP Ranges, which is a security concern, as well as environment-specific configuration (dev and test environments often have different restrictions than Production), none of the special handling options for Profiles should be used by default.
User Permissions can be excluded in EZ Commits, which would not attempt deploying any of them (no change = no deployment)
The option to ignore missing visibility settings is only valid as a last resort workaround, as it gets the branch out of sync from the org anytime it fires: new visibility is added to the profile for a component not yet deployed → visibility is ignored by AutoRABIT → the component is added in subsequent revision and deployed → the build never goes back to the ignored visibility setting (access exists in the branch, but not in the org). Standard fields are not supported for this option.