SkepticalButOpenMinded@lemmy.catoTechnology@lemmy.world•Asking ChatGPT to Repeat Words ‘Forever’ Is Now a Terms of Service ViolationEnglish
0·
11 months agoSeems simple enough to guard against to me. Fact is, if a human can easily detect a pattern, a machine can very likely be made to detect the same pattern. Pattern matching is precisely what NNs are good at. Once the pattern is detected (I.e. being asked to repeat something forever), safeguards can be initiated (like not passing the prompt to the language model or increasing the probability of predicting a stop token early).
The critic rating is better than the audience rating. I’ve never seen a film with a high critic rating that didn’t have something worthwhile about it. But I’ve seen a lot of audience hits that were garbage.