A Framework for Automated LLM Training and Analysis
We will present a platform that automates the whole LLM training workflow. It provisions GPU instances from several cloud providers, runs pre-training, fine-tuning and hyperparameter search on them, and then helps users understand the trained models through built-in explainability methods, including analysis of the attention mechanism. We will walk through the platform’s design and the challenges we faced while building it.