RETRACE
tensorflow
runtime_error
ai_generated
true
WARNING:tensorflow:最近 5 次对 <function train_step> 的调用中有 5 次触发了 tf.function 重追踪
WARNING:tensorflow:5 out of the last 5 calls to <function train_step> triggered tf.function retracing
ID: tensorflow/graph-mode-retracing-warning
80%修复率
87%置信度
1证据数
2023-11-20首次发现
版本兼容性
| 版本 | 状态 | 引入 | 弃用 | 备注 |
|---|---|---|---|---|
| tensorflow 2.11.0 | active | — | — | — |
| tensorflow 2.12.0 | active | — | — | — |
| tensorflow 2.13.0 | active | — | — | — |
根因分析
tf.function 被反复重追踪,因为输入张量的形状或数据类型在调用之间发生变化,导致性能下降。
English
The tf.function is being retraced repeatedly because the input tensor shapes or dtypes change between calls, which degrades performance.
官方文档
https://www.tensorflow.org/guide/function解决方案
-
Ensure all input tensors have consistent shapes and dtypes across batches. Pad variable-length inputs to a fixed shape using `tf.keras.preprocessing.sequence.pad_sequences`.
无效尝试
常见但无效的做法:
-
90% 失败
This loses the performance benefits of graph execution and may cause other errors.
-
85% 失败
This can mask the issue but may lead to incorrect gradients or memory errors.