Fix a bug with canceling while an agent was running #6040

Job	Run time
build-and-check	3m 5s
test-integration-packages/billing	1m 9s
test-integration-packages/internal	1m 5s
test-integration-common	45s
test-integration-packages/agent-runtime	45s
test-integration-sdk	1m 31s
test-packages/internal	47s
test-.agents	43s
test-integration-cli	1m 10s
test-cli	53s
test-integration-web	43s
test-web	48s
test-packages/agent-runtime	44s
test-packages/billing	44s
test-common	46s
test-sdk	42s
	16m 20s

Provide feedback