RETRACE tensorflow runtime_error ai_generated true

WARNING:tensorflow:最近 5 次对 <function train_step> 的调用中有 5 次触发了 tf.function 重追踪

WARNING:tensorflow:5 out of the last 5 calls to <function train_step> triggered tf.function retracing

ID: tensorflow/graph-mode-retracing-warning

其他格式: JSON · Markdown 中文 · English
80%修复率
87%置信度
1证据数
2023-11-20首次发现

版本兼容性

版本状态引入弃用备注
tensorflow 2.11.0 active
tensorflow 2.12.0 active
tensorflow 2.13.0 active

根因分析

tf.function 被反复重追踪,因为输入张量的形状或数据类型在调用之间发生变化,导致性能下降。

English

The tf.function is being retraced repeatedly because the input tensor shapes or dtypes change between calls, which degrades performance.

generic

官方文档

https://www.tensorflow.org/guide/function

解决方案

  1. Ensure all input tensors have consistent shapes and dtypes across batches. Pad variable-length inputs to a fixed shape using `tf.keras.preprocessing.sequence.pad_sequences`.

无效尝试

常见但无效的做法:

  1. 90% 失败

    This loses the performance benefits of graph execution and may cause other errors.

  2. 85% 失败

    This can mask the issue but may lead to incorrect gradients or memory errors.