1×197×7681×197×7687687681×197×7681×197×7681×197×7681×197×7681×197×7681×197×7681×197×7681×197×12×641×197×7681×197×7681×197×12×641×12×197×641×197×12×641×12×197×641×12×64×1971×12×197×1971×12×197×1971×12×197×1971×12×197×641×197×12×641×197×7681×197×7681×197×7681×197×7681×197×7681×197×7681×197×30721×197×30721×197×30721×197×30721×197×30721×197×30721×197×30721×197×30721×197×7681×197×7681×197×768inputsfloat32[1,197,768]IdentityIdentity_0float32[768]input〈768〉IdentityIdentity_1float32[768]input〈768〉LayerNormalization/layernorm_before/LayerNormalizationfloat32[768]Scale〈768〉float32[768]B〈768〉MatMul/attention/attention/query/MatMulfloat32[768,768]B〈768×768〉Add/attention/attention/query/Addfloat32[768]A〈768〉MatMul/attention/attention/key/MatMulfloat32[768,768]B〈768×768〉Add/attention/attention/key/Addfloat32[768]A〈768〉Reshape/attention/attention/Reshapeint64[4]shape〈4〉MatMul/attention/attention/value/MatMulfloat32[768,768]B〈768×768〉Add/attention/attention/value/Addfloat32[768]A〈768〉Reshape/attention/attention/Reshape_1int64[4]shape〈4〉Transpose/attention/attention/TransposeReshape/attention/attention/Reshape_2int64[4]shape〈4〉Transpose/attention/attention/Transpose_1Transpose/attention/attention/Transpose_2MatMul/attention/attention/MatMulDiv/attention/attention/Divfloat32B = 8Softmax/attention/attention/SoftmaxMatMul/attention/attention/MatMul_1Transpose/attention/attention/Transpose_3Reshape/attention/attention/Reshape_3int64[3]shape〈3〉MatMul/attention/output/dense/MatMulfloat32[768,768]B〈768×768〉Add/attention/output/dense/Addfloat32[768]A〈768〉Add/AddLayerNormalization/layernorm_after/LayerNormalizationMatMul/intermediate/dense/MatMulfloat32[768,3072]B〈768×3072〉Add/intermediate/dense/Addfloat32[3072]A〈3072〉Div/intermediate/intermediate_act_fn/Divfloat32B = 1.41421353…Erf/intermediate/intermediate_act_fn/ErfAdd/intermediate/intermediate_act_fn/Addfloat32B = 1Mul/intermediate/intermediate_act_fn/MulMul/intermediate/intermediate_act_fn/Mul_1float32B = 0.5MatMul/output/dense/MatMulfloat32[3072,768]B〈3072×768〉Add/output/dense/Addfloat32[768]A〈768〉Add/output/Addhidden_statesfloat32[1,197,768]