andy99

I googled that and only found references to software development models, roughly cathedral meaning you release the code with each software release and bazaar meaning the current state of the code is i…

A challenge here is that it is pedantic, even if it's true. I've been very vocal about how the LLaMAs as well as other models like those released under RAIL licenses are not open source. But…

The license has a bunch of terms and restrictions that make it incompatible with accepted definitions of open source software. LLaMA2 isn't "Open Source" - and why it doesn't matte…

Llama had already become a defacto standard for LLMs, between all the fine-tunes and llama.cpp. Giving it a wider license really cements it as a standard while making everybody use it on Meta's t…

AI is in a similar situation to software years ago were commercial interests are now firmly beginning to drive development. In retrospect it's been true for a while, but the pure research angle w…

Copyleft is good for "complete" products, where you want to protect a derivative work from being walled off. It's harder to know the best way to handle modules (which might be the more …

Yes, I'd encourage you to post this somewhere else if it doesn't get attention here. I've been thinking about this recently and I'm convinced that one or more credible GPL'd (…

It's disappointing that you're stuck using LLaMA at Meta's pleasure for their approved application. I was hoping they would show some leadership and release this under the same terms (A…

Another non-open source license. Getting better but don't let anyone tell you this is open source. http://marble.onl/posts/software-licenses-masquerading-as-op... …

An advantage of the structured format is that you can intercept and stop showing the output to the user if the LLM starts generating a longer conversation. I've had models go into a back and fort…

LLaMA is already in it's way to becoming an industry standard (in my opinion, look at llama.cpp plus everything build on LLaMA). There are benefits to being able to set direction like that. Same …

Hi Shawn, re your side note, I disagree with you that we'd be better off if weights couldn't be copyrighted - basically because copyright gives options like GPL that can keep models open, ot…

Yes agreed, tooling abounds, the work for anyone who's serious about this is customizing everything so it works with the idiosyncrasies of the documents and questions a customer has. I'm hap…

Yes I agree - I actually wrote something about this the other day. There's a need to think about how and when GPL style licensing can be applied to weights, and what terms make sense to accomplis…

Not just a binary because a common use is to fine tune from them to create derivative works. Look at all the models based on LLaMA.

A loosely related article that was recently discussed: https://ploum.net/2023-06-19-more-rms.html https://news.ycombinator.com/item?id=36389805 …

http://marble.onl/ (general purpose personal website that's mostly a blog)