SELF-HEALING
From root cause to verified fix.
When you enable self-healing, Traversal goes past diagnosis: it applies an evidence-backed fix, checks it against production, and confirms the problem is gone.
Every fix backed by evidence.
Each fix arrives with the evidence behind it, from the first symptom to the change that caused it.
Checkout conversion dropped on web storefronts
FeedbackShareCreate postmortem
Checkout conversion dropped on web storefronts
Thought for 4 minutesDeep modeQuery details →
Conversion Drop Caused by Stricter Region Validation in pricing-service
Symptoms Confirmed
- Checkout conversion fell 23% across web storefronts at 09:42 UTC
- cart-svc logged price refresh failures:
region must not be empty - The outlet storefront still sends price lookups with an empty region
Root Cause: Region Validation Added in pricing-service #2318
PR #2318, deployed at 09:35 UTC, made price lookups with an empty region fail validation. cart-svc refreshes prices for all storefronts in one batch, so the outlet storefront's empty region failed the whole refresh. Cached prices expired at 09:42, and carts showed prices checkout would not honor.
Background task completePull request ready
Prepare remediation plan
Create remediation branch
Open draft pull request
Run validation checks
ReadyReview on GitHub
fix(INC-3307): fall back to home region in cart price refresh
#5163 drafted • +22 -3 • Repo: commerce/cart-svc
Checkout conversion fell 23% at 09:42 UTC after pricing-service #2318 began rejecting price lookups with an empty region. The outlet storefront still sends empty regions, so the batched price refresh failed for every storefront. Defaults empty regions to the storefront's home region and logs each fallback for cleanup.
for _, sf := range storefronts {
if sf.Region == "" {
sf.Region = sf.HomeRegion
log.Info("price lookup region fallback",
"storefront", sf.ID, "region", sf.Region)
}
prices = append(prices, lookup(ctx, sf))
Next Steps: Review before merge.
Ask a follow-up...
Auto
Verified, not just applied.
Traversal checks each fix against how production actually behaves, then confirms the service has returned to its normal baseline.
Checkout conversion dropped on web storefronts
FeedbackShareCreate postmortem
ReadyReview on GitHub
fix(INC-3307): fall back to home region in cart price refresh
#5163 drafted • +22 -3 • Repo: commerce/cart-svc
Checkout conversion fell 23% at 09:42 UTC after pricing-service #2318 began rejecting price lookups with an empty region. The outlet storefront still sends empty regions, so the batched price refresh failed for every storefront. Defaults empty regions to the storefront's home region and logs each fallback for cleanup.
for _, sf := range storefronts {
if sf.Region == "" {
sf.Region = sf.HomeRegion
log.Info("price lookup region fallback",
"storefront", sf.ID, "region", sf.Region)
}
prices = append(prices, lookup(ctx, sf))
Next Steps: Review before merge.
Background task
Prepare remediation plan
Create remediation branch
Open draft pull request
Run validation checks
Run unit tests for price refresh with an empty regionRunningPassed
Confirm outlet storefront carts load current pricesRunningPassed
Confirm cart error rate returns to baseline in stagingRunningPassed
Apply and verify in production
Merge #5163 and roll out cart-svcRunningPassed
Compare checkout conversion against its 7-day baselineRunningPassed
Confirm every storefront completes its price refreshRunningPassed
Check pricing-service for new region rejectionsRunningPassed
Fix applied and verified in production. cart-svc is back to its normal baseline:
- Checkout conversion is within 1% of its 7-day baseline
- All 48 storefronts completed their last price refresh
- The outlet storefront's empty regions are logged for cleanup
Ask a follow-up...
Auto
You decide what runs on its own.
Start with the fixes you trust, and expand as your confidence grows.
Checkout conversion dropped on web storefronts
FeedbackShareCreate postmortem
ReadyReview on GitHub
fix(INC-3307): fall back to home region in cart price refresh
#5163 drafted • +22 -3 • Repo: commerce/cart-svc
Checkout conversion fell 23% at 09:42 UTC after pricing-service #2318 began rejecting price lookups with an empty region. The outlet storefront still sends empty regions, so the batched price refresh failed for every storefront. Defaults empty regions to the storefront's home region and logs each fallback for cleanup.
for _, sf := range storefronts {
if sf.Region == "" {
sf.Region = sf.HomeRegion
log.Info("price lookup region fallback",
"storefront", sf.ID, "region", sf.Region)
}
prices = append(prices, lookup(ctx, sf))
Next Steps: Review before merge.
Background task complete
Prepare remediation plan
Create remediation branch
Open draft pull request
Run validation checks
Apply and verify in production
Fix applied and verified in production. cart-svc is back to its normal baseline:
- Checkout conversion is within 1% of its 7-day baseline
- All 48 storefronts completed their last price refresh
- The outlet storefront's empty regions are logged for cleanup
Apply region and validation fallback fixes in cart-svc on your own from now on. Anything in pricing-service still comes to me as a PR.
Thought for 6 secondsFast modeQuery details →
Done. Going forward:
- Runs on its own: region and validation fallback fixes in cart-svc, applied after staging checks pass and verified against the production baseline
- Opens a PR for your review: pricing-service changes and everything else
Add pricing-service config rollbacks too. Those have been clean for a month.
Thought for 5 secondsFast modeQuery details →
Added. pricing-service config rollbacks now run on their own, with the same staging checks and production verification. Code changes in pricing-service still come to you as PRs.
Ask a follow-up...
Auto
CUSTOMER PROOF
70%
Reduction in mean time to resolution (MTTR)
96,000
Engineering hours on track to be saved per year
At Cloudways, Traversal cut MTTR by 70%, root causing incidents in under 5 minutes, and is on track to save 96,000 engineering hours per year.