Dissecting the High Energy Plasma Environment of Sagittarius A*