Number of predictions mismatch

[jeffjunzhang]

Hi,

I was testing Clipper with 200 requests.
When I use 'inspect_instance()', the 'app: num_predictions' is always 200. However, sometimes, 'model: num_predcitions' is less than 200 (e.g., 187).
Is this a bug or clipper is internal doing something with these metrics?
(PS: I've set the prediction cache size to 0, so there should be no caching, and the cache hit_ratio is always 0.)