This repository was archived by the owner on Oct 31, 2025. It is now read-only.
Refactoring to 1.5.1 #1792
Open
Refactoring to 1.5.1 #1792
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…rter than max_length
…Is with their up-to-date, more succinct equivalent `x.at[idx].set(y)`. The JAX operators: jax.ops.index_update(x, jax.ops.index[idx], y) jax.ops.index_add(x, jax.ops.index[idx], y) ... have long been deprecated in lieu of their more succinct counterparts: x.at[idx].set(y) x.at[idx].add(y) ... This change updates users of the deprecated APIs to use the current APIs, in preparation for removing the deprecated forms from JAX. The main subtlety is that if `x` is not a JAX array, we must cast it to one using `jnp.asarray(x)` before using the new form, since `.at[...]` is only defined on JAX arrays. PiperOrigin-RevId: 400211174
If you choose to work with your own dataset, the generator must be infinite to prevent the train phase from being interrupted by the StopIteration event: during the generative cycle
PiperOrigin-RevId: 403044944
…ore public names. Change in preparation for removing some function exports from jax.lib.xla_bridge. PiperOrigin-RevId: 404256000
COPYBARA_INTEGRATE_REVIEW=google#1699 from Vatican-X-Formers:hourglass-colab 3975cb6 PiperOrigin-RevId: 404276005
PiperOrigin-RevId: 404300156
…ted. * replace uses of `jax.ops.index[...]` with `jax.numpy.index_exp[...]`, which is a standard NumPy function that does the same thing. * remove some redundant uses of `jax.ops.index[...]`, where the expression is passed directly to an indexed accessor function like `.at[...]`. * update some remaining users of `jax.ops.index_update(x, jax.ops.index[idx], y)` to use the `x.at[idx].set(y)` APIs. PiperOrigin-RevId: 404324613
COPYBARA_INTEGRATE_REVIEW=google#1706 from Vatican-X-Formers:hourglass-colab2 1c7ea49 PiperOrigin-RevId: 404533118
Add capability for LSTN layer: 1) getting a complete state RNN (c, h) from the stack as input instead to use a zero initialization . Use initial_state=True parameter for that. Default False. 2) putting a complete state RNN (c, h) in the stack as output instead to discard it. Use return_state=True parameter for that . Default False.
PiperOrigin-RevId: 405454425
PiperOrigin-RevId: 405485133
PiperOrigin-RevId: 405496056
PiperOrigin-RevId: 405511993
…aling Transformers". PiperOrigin-RevId: 405537505
PiperOrigin-RevId: 405669883
PiperOrigin-RevId: 405671232
PiperOrigin-RevId: 405721113
…ted. * replace uses of `jax.ops.index[...]` with `jax.numpy.index_exp[...]`, which is a standard NumPy function that does the same thing. * remove some redundant uses of `jax.ops.index[...]`, where the expression is passed directly to an indexed accessor function like `.at[...]`. * update some remaining users of `jax.ops.index_update(x, jax.ops.index[idx], y)` to use the `x.at[idx].set(y)` APIs. PiperOrigin-RevId: 405825513
PiperOrigin-RevId: 410351568
PiperOrigin-RevId: 414013921
PiperOrigin-RevId: 418075062
…ead of accessing it via tf.estimator and depend on the tensorflow estimator target. PiperOrigin-RevId: 436553352
testing layer improvment
testing layer improvment
testing layer improvment
Added performance tests and removed unnecessary trainer tests.
refactoring data loader configuration yaml structure
refactoring data loader configuration yaml structure
Added ModernBertEncoder class for tokenization using ModernBERT.
Added tests for ModernBertTokenizer functionality and validation.
refactoring data loader configuration yaml structure
refactoring data loader configuration yaml structure
refactoring data loader configuration yaml structure
refactoring data loader configuration yaml structure
refactoring data loader configuration yaml structure
refactoring data loader configuration yaml structure
- jax optymalization based only
- jax optymalization based only
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
14 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The code, originally in version 1.4.1, has been upgraded to version 1.5.1. The main changes include: