AGN obscuration, Eddington ratio distribution and clustering: deep and wide X-ray surveys with NuSTAR and Chandra in the UKIDSS-UDS and Bootes fields