https://www.tensorflow.org/api_docs/python/tf/types/experimental/distributed/PerReplica?authuser=1
tf.types.experimental.distributed.PerReplica | TensorFlow v2.16.1
Holds a distributed value: a map from replica id to unsynchronized values.
tftypesexperimentaldistributedtensorflow