Investigating The Stellar Mass Growth And Quiescence Of Massive Galaxies In The Early Universe Using Wide-Field Imaging