Distributed Grain Directory followup work

[ReubenBond]

There are some things we need to do before taking the experimental attribute off the new grain directory and eventually making it the default.

1. Implement a relatively smooth rolling upgrade strategy from the old directory to the new one. One idea is to implement the old grain directory system target interfaces in the new grain directory.
2. Reduce log noise. Most info and even warning level logs can be made debug logs.
3. Enable the directory everywhere, even with no grains using it.

[shykln]

Looking forward to this. I've using 3.x for a few years with k8s rolling upgrade deployment without no major issues.
I tried to upgrade to 8.2 and then 9.1.2, and I tried both using default grain directory and redis grain directory, but I still face the issue that there is a chance that after the k8s rolling upgrade, several grains stoped responding to other client/grain calls. Causing large number of orleans call message timeouts.

[ReubenBond]

@shykln you can use the new grain directory today: siloBuilder.AddDistributedGrainDirectory()

[shykln]

@shykln you can use the new grain directory today: siloBuilder.AddDistributedGrainDirectory()

Hi @ReubenBond , sorry I forgot to mention, I tried that too. I still face K8S rolling upgrade issue time to time.

[ReubenBond]

@shykln thanks for letting us know. If you would like, please open an issue with details and we will help investigate.

[KSemenenko]

Can we use it across different serviceId, to achieve smooth blue-green deployment?

[shykln]

Can we use it across different serviceId, to achieve smooth blue-green deployment?

I don't think I can. Using a different serviceId means that you are allowing duplicate activation or grains. That would break business requirements.

[shykln]

Hi @ReubenBond , could you help update the latest progress/plan of this work item?

[shykln]

Hi @ReubenBond , could you share some light about the progress of this? Orleans 10.x is in RC and I wonder if this feature would stay experimental or not. Thanks!

[ReubenBond]

Hi @shykln, apologies for the delay. I have opened #9881 to address the work items in this issue. I opened #9882 to remove the [Experimental] attribute.