Manually track allocations and assert that we don't leak