I had the same issue and went down a debugging rabbit hole, but realised in the end I had forgotten to set use_cache to False for my reference model. Remember you need to set use_cache = False for ...