@vmoens

I made some logic change and most of unit tests pass.
In test_collector unit test, the following two test sets fail.

FAILED test/test_collector.py::test_collector_consistency[conv-3] - AssertionError: key done does not match, got mse = 0.5774 key action does not match, got mse = 0.0000
FAILED test/test_collector.py::test_collector_consistency[vec-3] - AssertionError: key done does not match, got mse = 0.5774 key action does not match, got mse = 0.0000
FAILED test/test_collector.py::test_traj_len_consistency[conv-SyncDataCollector-3] - RuntimeError: The size of tensor a (20) must match the size of tensor b (2) at non-singleton dimension 1
FAILED test/test_collector.py::test_traj_len_consistency[conv-aSyncDataCollector-3] - RuntimeError: At least on process failed. Check for more infos in the log.
FAILED test/test_collector.py::test_traj_len_consistency[vec-SyncDataCollector-3] - RuntimeError: The size of tensor a (20) must match the size of tensor b (2) at non-singleton dimension 1
FAILED test/test_collector.py::test_traj_len_consistency[vec-aSyncDataCollector-3] - RuntimeError: At least on process failed. Check for more infos in the log.

I think it fails because of this line in mock class.
https://github.com/facebookresearch/rl/blob/fc7876666fa0c6733a4b272aa7cfc5b997bc2e04/test/mocking_classes.py#L72
For instance, I change this line to self.count = 100 test passes.
Can you please explain what this line does and suggest best way to update this line?

Thank you,
Hojin