Our paper in the AI4Sys '24 conference at HPDC 2024 presents a novel technique using Generative AI (GenAI) to automate on-the-fly customizations of AI/ML solutions. The ECO-LLM system dynamically adjusts task placement between edge and cloud computing, resulting in minimal performance differences while significantly reducing manual effort and time in solving systems problems.