Atomic layer deposition is widely acknowledged as a powerful technique for the deposition of high quality layers for several applications including photovoltaics (PV). The capability of ALD to generate dense, conformal, virtually pinhole-free layers becomes attractive also for the emerging organo-metal halide perovskite solar cells (PSCs), which have garnered the interest of the PV community through their remarkable efficiency gains, now over 20%, in just a few years of research. Until now, the application of ALD layers in PSCs has almost exclusively been restricted to the stages of device fabrication prior to perovskite deposition. Researchers have mainly focused on fabricating efficient electron and hole transport layers (TiO2, SnO2, ZnO, NiO) and ultra-thin Al2O3 or TiO2 passivation layers for several device configurations. The first section of this contribution reviews the current state-of-the-art ALD for perovskite solar cells. Then, we explore other potential opportunities, such as the fabrication of doped metal oxide selective contacts and transparent electrodes, also for use in tandem solar cell architectures, as well as barrier layers for encapsulation. Finally, we present our own experimental investigation of the challenges involved in depositing directly on perovskite absorbers in view of replacing organic electron and hole transport layers with ALD metal oxides (MOs). Therefore, the effects of temperature, oxidizing agents and metal precursors on perovskite are studied. A number of insights are gained which can lead to the development of ad hoc ALD processes that are compatible with the underlying perovskite, in this case, methylammonium lead iodide, MAPbI3. The phase purity and surface chemistry of the perovskite were used as metrics to quantify the feasibility of depositing selected MOs which can be adopted as selective contacts and passivation layers.