If you have a strong radio signal, like an AP transmitting, it will increase the noise floor on close by receivers. This has to do with the physics of filters and results in the recommendation to separate APs as much as possible.
If these we not poles, but concrete (or metal) structures, the approach may work as the structure will block (or actually attenuate) the signal between the APs.
With poles, you may be successful if you can mount the APs with some RF blocking material (like a metal plate at 30cm/1ft at least from the back of the AP). I can't guarantee though.
If you have very low requirements on the bandwidth or client counts, it may work without additional precautions. Make sure that where possible the channel separation is as large as possible for close-by radios that carry the most traffic.
From the diagram below, I would at least remove one of the APs that are pointing to the other pole (the AP on the right of the left pole or the AP on the left of the right pole) as those are covering the same area.
Maybe others have good experience...