🚨 ArgoCD Deployment Failed: agentic-platform-engineering-demo

[github-actions]

ArgoCD Deployment Failure

Application: agentic-platform-engineering-demo
Timestamp: 2026-03-11T19:34:43.738Z

Cluster Information

Field	Value
Cluster Name	msftgbb
Resource Group	agentic-platform-engineering
Namespace	default

Application Status

Field	Value
Health Status	Degraded
Sync Status	Synced
Revision	5d5dfc7040ab0f600f455382f9d85d5d86a28bb0
Repository	https://github.com/microsoftgbb/agentic-platform-engineering.git

Error Message

successfully synced (all tasks run)

Troubleshooting Commands

# Check application status in ArgoCD
argocd app get agentic-platform-engineering-demo

# Check pods in namespace
kubectl get pods -n default

# Describe failed pods
kubectl describe pods -n default

# Get pod logs
kubectl logs -n default <pod-name>

# Check events
kubectl get events -n default --sort-by='.lastTimestamp'

Quick Links

• ArgoCD UI
• Source Repository

---

This issue was automatically created by ArgoCD Notifications

[github-actions]

🤖 Cluster Doctor is on the case!

Work has begun on this issue. A GitHub Action has been spun up to analyze and diagnose the cluster.

🔗 View the running GitHub Action

[github-actions]

🩺 Cluster Doctor Diagnosis & Remediation Report

✅ Cluster Identity Verified

Signal	Value
Cluster FQDN	msftgbb-dns-ic5hvueo.hcp.canadacentral.azmk8s.io
Resource UID	6993952c6544f50001ed50e9
Subscription	ed38c53b-b762-4ab9-954d-a05e40f9458a
Kubernetes	1.33.7 · canadacentral

---

🔍 Root Cause: Image Name Typo → ImagePullBackOff

Failing Pod: order-service-5d9867645-ffsrd (namespace: default)
Status: ImagePullBackOff / Pending

The order-service Deployment in Act-3/argocd/apps/broken-aks-store-all-in-one.yaml specifies a non-existent container image — the letter r is missing from order:

	Image
❌ Broken (current main)	ghcr.io/azure-samples/aks-store-demo/orde-service:2.1.0
✅ Correct	ghcr.io/azure-samples/aks-store-demo/order-service:2.1.0

This was introduced by commit 5d5dfc7 ("intentionally degrade service for testing") at 2026-03-11T19:00:51Z — approximately 34 minutes before this issue was created.

Kubelet evidence:

Failed to pull image "ghcr.io/azure-samples/aks-store-demo/orde-service:2.1.0":
failed to authorize: failed to fetch anonymous token: unexpected status from
GET request to ghcr.io: 403 Forbidden

Why ArgoCD shows Synced but Degraded: ArgoCD successfully applied the manifest from Git (Synced ✅), but the pod cannot start because the image doesn't exist (Degraded ❌). The progressDeadlineSeconds: 10 setting causes the Deployment to quickly report ProgressDeadlineExceeded.

Healthy pod order-service-575df9db99-x657w is still serving traffic using the correct order-service:2.1.0 image from the previous deployment revision.

---

🔧 Remediation

A GitOps PR has been created to fix the typo:

➡️ PR #28: #28

Change: orde-service:2.1.0 → order-service:2.1.0 in Act-3/argocd/apps/broken-aks-store-all-in-one.yaml

Once merged, ArgoCD will auto-sync (selfHeal: true) and the order-service pod will come up healthy.

Validation commands (post-merge):

kubectl get pods -n default -l app=order-service -w
kubectl rollout status deployment/order-service -n default
argocd app get agentic-platform-engineering-demo

---

📊 Cluster Health Snapshot

Resource	Status
Cluster msftgbb	Running ✅
Nodes (2×Standard_D4ds_v5)	Ready ✅
mongodb-0	Running ✅
rabbitmq-0	Running ✅
order-service (old pod)	Running ✅ (serving traffic)
order-service (new pod)	ImagePullBackOff ❌
makeline-service	Running ✅
product-service	Running ✅
store-front	Running ✅
store-admin	Running ✅

---

Diagnosis performed by Cluster Doctor Agent at 2026-03-11T19:36Z