We used perspective views to calculate the depth. From light field data, we could extract perspective views of a scene.
If an object was away from us, it would move for a longer distance between the two perspective views while a near object will be the opposite. Thus, we could calculate the relative depth of every point by comparing how far it moves in the two perspective views. The result is shown in Fig. 1