Add statistics logging for params and activations#5492

philipcmonk wants to merge 2 commits into

NVIDIA:mainNVIDIA/Megatron-LM:mainfrom

philipcmonk:pmonk/metricsphilipcmonk/Megatron-LM:pmonk/metricsCopy head branch name to clipboard