Docs for batching parameter pad_variable_length_inputs

[jeongukjae]

When I use TF-Serving with batching options and variable length inputs, I could get errors like Tensors with name 'example_feature:0' from different tasks have different shapes and padding is turned off.Set pad_variable_length_inputs to true, or ensure that all tensors with the same namehave equal dimensions starting with the first dim., and I could find codes related to that parameters.

• serving/tensorflow_serving/servables/tensorflow/session_bundle_config.proto

  Line 165 in 2b20315

  bool pad_variable_length_inputs = 7;

• serving/tensorflow_serving/batching/batching_session.cc

  Line 514 in 21360c7

  if (options_.pad_variable_length_inputs) {

But in batching guide(https://github.com/tensorflow/serving/blob/master/tensorflow_serving/batching/README.md), there is no description about parameter pad_variable_length_inputs.

Can you add descriptions for pad_variable_length_inputs in the batching guide?

[denadai2]

+1

[YoungXu06]

+1

[singhniraj08]

@jeongukjae,

Descriptions on pad_variable_length_inputs batching parameter can be found in tensorflow_serving/batching/batching_options.h file.

Thank you!

[jeongukjae]

@singhniraj08 Thank you for your help :) I was able to find the related code and understand it, but I think it would be even more helpful if this argument was added to the "TensorFlow Serving Batching Guide" documentation.

[singhniraj08]

@christisg,

Can we add pad_variable_length_inputs parameter description in TensorFlow Serving Batching Guide.
I can create a PR to update the doc.

Thank you!