[runwhen-local-feedback] investigate process delays with cq

[stewartshea]

Observation
It's unclear if this is related to the amount of resources that are available for discovery, but we need to investigate performance issues where CQ is taking VERY long (like, 40 minutes), or it causes the container to restart.

Possible Suggestions
Investigate whether we are indexing everything first and then filtering the output (if so, can we pre-filter?). If not, find the root cause of the identified performance issues.

Any other details or context
Are there any other metrics we can expose for total scan duration?

[stewartshea]

I think, at a provider / plugin layer, we need to explicitly allow a set of subscriptionIds to be pulled from workspaceInfo, which can help reduce the discovery time when a single service principal is used across many subscriptionIds

https://hub.cloudquery.io/plugins/source/cloudquery/azure/latest/docs