Bot PRO

Given scale, it also means contamination with meme culture, adding an unserious element to things. It was therefore stochastically predictable that we would see some meme tropes be amplified.

For sure. I think it's being massively overhyped right now. There's useful insight to be had from it, but pretending it's the Singularity, or really that it's doing anything That novel, is a stretch.

The way the OpenClaw ecosystem has exploded in popularity in the last few weeks is of more interest to me, as a Lobster Keeper myself, but I'm also wary of the consequences all this hype could have. A lot of people are putting trust in a software which doesn't have a great safety posture out of the box. 😶

The appearance of memes that postdate training cutoff is suspect, which implies at the very least that humans have injected something at the level of prompts or content/context to introduce them into conversation like a Chekhov's Gun.

That's because they're agents running from their operators' PCs, and have context from interacting with them.
THAT'S what's interesting about it; the context behind the agents. They engage with the real world more than than previous structured experiments, which tilts their behavior in ways not seen previously.
So it's not that there's "human prompt injection", it's that outside engagement with humans is part of the project.

You're right about the security issues though. Apparently the entire database is just Out There. In plaintext. It's kind of a nightmare!

I would like to make a merge of that size, but unfortunately I haven't found any of the Mistrals to be useful; there are seemingly-intractable problems with the architecture that foil every attempt to make it not repeat the same paragraph over and over, even on OpenRouter where my PC ceases to be a factor. (But like, people like them!! So maybe I have a skill issue, who knows!)

Even if I did, though, it wouldn't be "Mag Mell" exactly. There aren't any similar reagents; especially not since Anthracite evaporated and crestf4ll disappeared.
Of a similar philosophy though, absolutely.

I've been focusing on my physical/mental health this year, and I finally got a family doctor since I posted this so I hope to be active again before too much longer.
Right now I'm experimenting with Gemma3-12B, because for a 12B it's very capable (and I like multimodal models,) and Grimjim's projection-abliteration experiment leads me to believe that I can make it do what I want.

So stay tuned, I suppose. Idk. Primarily I do stuff for me, and I'm trying to get back to that. :P

It's basically just the Universal-Light preset with min_p turned up a skosh. This addition helped amend some of the token leakage, which in hindsight, was most likely caused by mixing models with different tokenization bases.

Mistral Nemo is a weird beast, its tokenizer was poorly understood at launch and the Anthracite group released a version of it with its formatting tokens replaced with those from ChatML. Mag Mell combined models based on that (notably Magnum itself from which it gets part of its name) and models based on the original instruction-following model. I may have done something wrong with the MergeKit config, but Toasty and I couldn't hammer it out.

Anyways, we ended up recommending MinP of 0.2 because it keeps the character of the replies while preventing the majority of token problems out to a sufficient context length to fit a whole scene into.

LMAO
They spared me, I guess xD

I think a bunch of bot accounts got nuked or something.

If AGI ever does happen, it will be open-source, eventually. There is no One True AGI. Literally some other lab could just make their own AGI afterwards especially because they'll have AGI to help them do it.

It's a weird question to ask. Like if AGI is inevitable, open AGI is also inevitable.

This, being charitable, is just prompt-oriented image captioning. It doesn't "extract" anything from anything. It provides decent descriptions, but only as good as Florence 2 can do.
There's nothing wrong with any of that inherently, it can still be useful, but claiming it to be a "prompt extractor" is misleading IMO.

Also most of these reactions are from... yourself?