Efficient Methods For Optimizing Decentralized Multi-Agent Systems