Yes, it is correct that we cannot use a contracted negative form when we use inverted word order to express unreal or impossible condition in the past. Instead, we are obliged to use the full form of ...