Apparatus and method for determining three dimensional data based on an image of a patterned substrate

Described herein are system, method, and apparatus for determining three-dimensional (3D) information of a structure of a patterned substrate. The 3D information can be determined using one or more model configured to generate 3D information (e.g., depth information) using only a single image of a patterned substrate. In a method, the model is trained by obtaining a pair of stereo images of a structure of a patterned substrate. The model generates, using a first image of the pair of stereo images as input, disparity data between the first image and a second image, the disparity data being indicative of depth information associated with the first image. The disparity data is combined with the second image to generate a reconstructed image corresponding to the first image. Further, one or more model parameters are adjusted based on the disparity data, the reconstructed image, and the first image.