Initial PyPi Release
Current list of modules:
clu.checkpointclu.deterministic_trainingclu.metric_writersclu.periodic_actionsclu.platformclu.profiler
- Adds
metricsmodule and some minor changes.
- Added
metric_writers.TorchTensorboardWriter
- Added preprocess_spec.
- Improvements to periodic_actions.
metric_writers: LetsSummaryWriterwrite nested dictionaries.internal: Addsasync.Pool.preprocess_spec: Support nested dictionaries.profile: Use JAX profiler APIs instead of TF profiler APIs.
deterministic_data
- Support non-positive input value for pad_up_to_batches.
- Support padding dataset when data dimension is unknown.
- Support TFDS specs in get_read_instruction_for_host.
- Allow changing drop_remainder for batching.
- Add RemainderOptions in deterministic_data.
metric_writers
- Support multiple writers in metric_writers.ensure_flushes.
metrics
- Makes internal.flatten_dict() work with ConfigDicts.
- Forwards mask model output to metrics created via
Metric.from_output(). - Forwards mask model output to metrics created via
Metric.from_fun(). - Added
Collections.unreplicate(),Collections.create().
periodic_actions
- Formats long time strings in '{days}d{hours}h{mins}m' format.
preprocess_spec
- Make feature description of features in PreprocessFn more compact.
- Better type check in
preprocess_spec.get_all_ops().
Documentation:
- Added
clu_synopsis.ipynbColab
- Log error instead of failing when
profiler.start()raises an exception. - Makes
periodic_actions.ProgressUpdateshow total number of steps. - Makes
AsyncWriternon-blocking wrt JAX async computations. - Adds
clu_synopsis.ipynbColab as initial documentation. - Restore Checkpoint without providing the state
- Makes
PreprocessFnaddable. - Allow n-dimensional arrays (and masks) to be passed to Metrics.Average().
- Support slicing
PreprocessFn.
- Makes
deterministic_datawork withtfds>4.4.0andtfds<=4.4.0.
This will be the last release supporting Python 3.6.
- Moves
clu.internal.asynclibtoclu.asynclib. - Adds methods for writing raw tensors and audio to
MetricWriter. - Adds
clu.valuesto annotate arrays with a modality. - Adds
clu.data.DatasetIterator- a generic interface between input pipelines and training loops. - Fixes various issues with
clu.metrics.
This will be the last release supporting Python 3.7.
- Fix pytype failures related to teaching pytype about NumPy scalar types.
- Fix a couple of docstring typos.
- Updates README and clu_synposis.ipynb
Last release before dropping support for Python 3.8 and 3.9
clu.parameter_overviewnow supports JAX global arrays.- Various small fixes in
clu.metricsmodule. - Removed some tensorflow dependencies.
- Removes numpy version pin
- Adds sharding annotations, dtype, total bytes to
parameter_overview - Makes
clu.metrics.Stdsupport same shapes asclu.metrics.Average
- Switch from
jax.tree_map(deprecated since JAX 0.4.26) tojax.tree_util.tree_map. - Improvements to parameter overview.