Thanks for making TensorsData and TensorData serializable.

write_calibration_table writes out three calibration files in different format: json, txt, and flatbuffers.
TRT EP consumes the flatbuffers file which it expects each tensor data only contains name and max(abs(values[0]), abs(values[1])), it should be something like this:

resnetv17_stage4_conv9_fwd 0.381193
resnetv17_stage2_relu4_fwd 2.53578352
....

However, it currently serializes much more tensor data's information:

flatten_473 {'lowest': array([0.], dtype=float32), 'highest': array([10.190684], dtype=float32), 'CLS': 'TensorData'}
resnetv17_batchnorm0_fwd {'lowest': array([-5.5807953], dtype=float32), 'highest': array([5.954951], dtype=float32), 'CLS': 'TensorData'}
....

Could you help add additional functionality to simply extract the tensor name and an absolute value that required by TRT EP?

I just made a change to restore the previous format. Let me know if that's ok with you.

Thanks!
TRT EP actually is reading the calibration.flatbuffers not the pure txt file, so could you please help add the code to block as below?

700     zero = np.array(0)
701     for key in sorted(calibration_cache.keys()):
702         values = calibration_cache[key]
703         d_values = values.to_dict()
704         floats = [
705             float(d_values.get("highest", zero).item()),
706             float(d_values.get("lowest", zero).item()),
707         ]
708         value = str(max(floats))  # str(max(abs(values[0]), abs(values[1])))
709
710         flat_key = builder.CreateString(key)
711         flat_value = builder.CreateString(value)

builder.CreateString(key)

I don't know block very well. Do you know the file I should modify?

builder.CreateString(key)

I don't know block very well. Do you know the file I should modify?

It's here https://github.com/xadupre/onnxruntime/blob/qdq_json/onnxruntime/python/tools/quantization/quant_utils.py#L698

builder.CreateString(key)

I don't know block very well. Do you know the file I should modify?

It's here https://github.com/xadupre/onnxruntime/blob/qdq_json/onnxruntime/python/tools/quantization/quant_utils.py#L698

Sorry, I did not see, it was just above. I just pushed the changes.