back
1 comments
> TLDR; we cluster the dataset with KMeans, train a LoRA adapted model on each cluster, then combine them based on the cosine similarity from your new prompt to each cluster.

Thats actually really practical, and potentially revolutionary... With enough community LORAs, Llama could be an expert in many niches.