What's wrong with deepfakes?

[Lorizael]

So recently, some redditors (I think) have put together a deep learning program that can take as input a bunch of different pictures of a person's face and a, um, adult entertainment video, and output a pretty damn convincing video with that person's face stitched on. This is being done with celebrities, but also with ex-girlfriends and other private individuals. The implications are making a lot of people very uneasy, and it's understandable to me that people who have fakes made of them feel wronged.

That said, I'm having trouble articulating what specifically is wrong about doing this to a person. In many cases, the pictures are publicly available online, so it doesn't seem like a "privacy" issue. Some say consent is the problem, but what can we realistically expect a person to have to get consent for? That is, countless horny teenagers google their favorite perfectly clothed celebrity everyday as, err, material, and while maybe that verges into creepy, I don't think we think it's a matter of consent. Others point out these fakes can be used as blackmail, but blackmail is already an illegal and problematic act.

Thoughts, poly people?

Edit: No links or pictures, because I want this thread to stick around.

[rah]

While my initial thought was, it's fake so probably harmless and more humor material, but upon deeper thought, it could end up creepy and open the door for even worse in the future. I don't know what that worse would be yet, but I don't think it could possibly end well.. This could be just another more powerful form of internet bullying.

[BeBMan]

As long we'd talk hm..."personal use only" I'd say not much of a prob indeed. But what I do understand or rather suspect is that a lot of this would be done to share it, to make "targetted" ppl feel bad/ridicule them or even purely for "revenge"? Not good I'd say in this case.

[ZEE]

People on Forumwarz were doing this to eachother 10 years ago. Although they were very obvious and humorously bad fakes. Not the professional stuff of today.

[rah]

Obvious fakes wouldn't be an issue to me either. But if they're realistic...............creepy and bad.

[Lorizael]

I guess I don't understand the justification for drawing the line at a particular point. There's a lot of celebrity fiction out there, detailing acts which those celebrities absolutely did not engage in. I bet there are also people who make, let's say, illustrated comic books of that kind of fiction. Where does it start being wrong, any why?

[Jon Miller]

When people can't tell the difference between fiction and reality.

You could argue that the genie is out of the bottle, and can't be put in. But there is no way to argue that no harm is involved.

JM

[rah]

I guess I don't understand the justification for drawing the line at a particular point. There's a lot of celebrity fiction out there, detailing acts which those celebrities absolutely did not engage in. I bet there are also people who make, let's say, illustrated comic books of that kind of fiction. Where does it start being wrong, any why?

Yeah, deciding where exactly to draw it can be a coin flip but the line should be drawn, and this one sounds like a good starting point. I think there's a difference between fiction written and explicit faked sex tapes.

[Aeson]

I agree, if it’s realistic and presented as real it should be considered defamation/libel. It may also be identity theft dependimg on how it is used, and there are probably cases that should be considered incitement to violence (showing a faked sex tape to a spouse which leads to violence).

[Proteus_MST]

Making celebrity porn is actually the most harmles thing you may do with this alorithm.

Even more of a problem is that it may be used for actual smear campaigns in order to showw filmeed evidence of a person doing this or that (like chetaing on his/her spouse, conspiring with russian agents, killing someone etc. )
And the worst thing is that, even if filmed evidence of a person exists while commiting crimes, it can use the defense that the videos were faked via this algorithm.

Even if it may still bei possible, via thorough computer based examination of the video, to find out wheter or not it is genine or fake,
it may still be possible that for propaganda purposes, so much doubts remain, that someone can convince his/her followers, that a fake video (showing a (political) opponent s genuine) ... or that a genuine video of himself doingbad things is fake.

[I AM I AM I AM MOBIUS]

Thoughts, poly people?

I would not watch porn with your face.

That includes porn featuring your face

and

wearing your face as i watch porn

i'm a no on both

[Lorizael]

Have you ever even seen my face? I mean, I would also recommend you not watching porn with my face in it, but just because it compares unfavorably to the butt avatar you used to have.

[I AM I AM I AM MOBIUS]

i am obsessed with bukkake so you can be in my porn if you want i guess

[Proteus_MST]

Didn't Bruce Springsteeen already sing something like "Porn in the USA"?
Or am I mistaken there?

[pchang]

If one had an extensive database of commercial porn, then one could try and match deepfakes against that database to see if you could find a match against all the non-faces in the video. This could be used to create an automated deepfake identifier.