# Video manipulation

> Mediated Wiki article. Canonical URL: https://mediated.wiki/source/Video_manipulation
> Markdown URL: https://mediated.wiki/source/Video_manipulation.md
> Source: https://en.wikipedia.org/wiki/Video_manipulation
> Source revision: 1340007839
> License: Creative Commons Attribution-ShareAlike 4.0 International (https://creativecommons.org/licenses/by-sa/4.0/)

{{Short description|Editing of video content for malicious intent}}
[[File:Vladimir Putin warning Americans on election interference and increasing political divide.webm|thumb|A [deepfake](/source/deepfake) video of Vladimir Putin speaking about election interference, created in 2020 by nonpartisan advocacy group [RepresentUs](/source/RepresentUs)]]
'''Video manipulation''' is a type of [media manipulation](/source/media_manipulation) that targets [digital video](/source/digital_video) using [video processing](/source/video_processing) and [video editing](/source/video_editing) techniques. The applications of these methods range from educational videos<ref>{{cite book|title=The International Handbook of Virtual Learning Environments|last=Pea|first=Roy|date=2006|publisher=Springer|editor-last=Weiss|editor-first=J.|display-editors=etal|pages=100–110|chapter=Chapter 55: Video-as-Data and Digital Video Manipulation Techniques for Transforming Learning Sciences Research, Education, and Other Cultural Practices}}</ref> to videos aimed at ([mass](/source/Crowd_manipulation)) manipulation and [propaganda](/source/propaganda), a straightforward extension of the long-standing possibilities of [photo manipulation](/source/photo_manipulation). This form of computer-generated misinformation has contributed to [fake news](/source/fake_news), and there have been instances when this technology was used during political campaigns.<ref name=":0">{{Cite web|url=https://qz.com/1145657/the-dangerous-new-technology-that-will-make-us-question-our-basic-idea-of-reality/|title=Fake news: The dangerous new technology that will make us question our basic idea of reality — Quartz|website=qz.com|date=5 December 2017 |language=en|access-date=2018-11-14}}</ref>   Other uses are less sinister; entertainment purposes and harmless pranks provide users with movie-quality artistic possibilities.

==History==
The concept of manipulating video can be traced back as far as the 1950s when the 2-inch [Quadruplex](/source/Quadruplex_videotape) tape used in videotape recorders would be manually cut and spliced. After being coated with [ferrofluid](/source/ferrofluid), the two ends of tape that were to be joined were painted with a mixture of [iron filings](/source/iron_filings) and [carbon tetrachloride](/source/carbon_tetrachloride), a toxic and carcinogenic compound to make the tracks in the tape visible when viewed through a microscope so that they could be aligned in a splicer designed for this task<ref>{{Cite news|url=https://www.videomaker.com/article/2896-edit-suite-once-upon-a-time-the-history-of-videotape-editing|title=Edit Suite: Once Upon a Time: The History of Videotape Editing - Videomaker|date=1997-07-01|work=Videomaker|access-date=2018-11-14|language=en-US|archive-date=2021-04-22|archive-url=https://web.archive.org/web/20210422142820/https://www.videomaker.com/article/2896-edit-suite-once-upon-a-time-the-history-of-videotape-editing|url-status=live}}</ref>

As the video cassette recorder developed in the 1960s, 1970s, 1980s, and 1990s, the ability to record over an existing [magnetic tape](/source/magnetic_tape) became possible. This led to the concept of overlaying specific parts of film to give the illusion of one consistently recorded video, which is the first identifiable instance of video manipulation.

In 1985, [Quantel](/source/Quantel) released The Harry, the first all-digital video editing and effects compositing system. It recorded and applied effects to a maximum of 80 seconds of 8-bit [uncompressed](/source/uncompressed_video) digital video. A few years later, in 1991, [Adobe](/source/Adobe_Inc.) released its first version of [Premiere](/source/Adobe_Premiere_Pro) for the Mac, a program that has since become an industry standard for editing and is now commonly used for video manipulation. In 1999, [Apple](/source/Apple_Inc.) released [Final Cut Pro](/source/Final_Cut_Pro), which competed with Adobe Premiere and was used in the production of major films such as ''[The Rules of Attraction](/source/The_Rules_of_Attraction_(film))'' and ''[No Country for Old Men](/source/No_Country_for_Old_Men)''.<ref>{{Cite news|url=https://www.premiumbeat.com/blog/fun-facts-and-dates-in-digital-editing-firsts/|title=Fun Facts and Dates in Digital Editing 'Firsts' - The Beat: A Blog by PremiumBeat|date=2011-12-10|work=The Beat: A Blog by PremiumBeat|access-date=2018-11-14|language=en-US|archive-date=2018-10-04|archive-url=https://web.archive.org/web/20181004104029/https://www.premiumbeat.com/blog/fun-facts-and-dates-in-digital-editing-firsts/|url-status=live}}</ref>

[Face detection](/source/Face_detection) became a major research subject in the early 2000s that has continued to be studied in the present. In 2017, an amateur coder named “DeepFakes” was altering pornography videos by digitally substituting the faces of celebrities for those in the original videos. The word [deepfake](/source/deepfake) has become a generic noun for the use of algorithms and facial-mapping technology to manipulate videos.

On the consumer side, popular video manipulation programs [FaceApp](/source/FaceApp) and Faceswap, developed from similar technology, have become increasingly sophisticated.

The proof-of-principle software ''[Face2Face](/source/Face2face_(software))'' was developed at the [University of Erlangen-Nuremberg](/source/University_of_Erlangen%E2%80%93Nuremberg), the [Max-Planck Institute for Informatics](/source/Max_Planck_Institute_for_Informatics), and [Stanford University](/source/Stanford_University).<ref>{{Cite web|url=http://gvv.mpi-inf.mpg.de/projects/MZ/Papers/CVPR2016_FF/page.html|title=Face2Face: Real-time Face Capture and Reenactment of RGB Videos|website=gvv.mpi-inf.mpg.de|access-date=2019-12-18|archive-date=2019-12-31|archive-url=https://web.archive.org/web/20191231144212/http://gvv.mpi-inf.mpg.de/projects/MZ/Papers/CVPR2016_FF/page.html|url-status=live}}</ref> Such advanced video manipulation must be ranked alongside and beyond previous examples of [deepfake](/source/deep_fake)s.

==Types of video manipulation==
Computer applications are becoming more advanced in terms of being able to generate fake audio and video content that looks real.<ref name=":1">{{Cite news|url=https://www.wsj.com/articles/deepfake-videos-are-ruining-lives-is-democracy-next-1539595787?mod=hp_lead_pos5|title=Deepfake Videos Are Getting Real and That's a Problem|last=Schellmann|first=Hilke|work=WSJ|access-date=2018-11-14|language=en-US}}</ref> A video published by researchers depicts how video and audio manipulation works using [facial recognition](/source/Facial_recognition_system).<ref name=":1" /> Though video manipulation could be thought of as piecing together different [video clips](/source/video_clips), the types of video manipulation extend further than that. For example, an actor can sit in front of a camera moving his face. The computer then generates the same facial movement in real time on an existing video of [Barack Obama](/source/Barack_Obama). When the actor shakes his head, Obama also shakes his head, and the same happens when the actor speaks.<ref name=":1" /> Not only does this create fake content, but it masks the content as even more authentic than other types of fake news, as video and audio were once the most reliable types of media for many people.

One of the most dangerous parts of video manipulation is the concept of politics; [campaign](/source/Political_campaign) videos are being manipulated to pose a threat to other nations.<ref name=":0" /> [Dartmouth College](/source/Dartmouth_College) [computer science](/source/computer_science) professor Hany Farid commented on video manipulation and its dangers. Farid said that actors could generate videos of [Trump](/source/Donald_Trump) claiming to launch nuclear weapons. These fabricated videos could be shared on social media before the mistake can be fixed, possibly resulting in war.<ref name=":0" /> Despite the presence of manipulated video and audio, research teams are working to combat the issue. Prof. Christian [https://people.mpi-inf.mpg.de/~theobalt/ Theobalt], a member of a team working on the technology at the Max-Planck-Institute for [informatics](/source/informatics) in Germany, states that researchers have created forensic methods to detect fakes.<ref name=":1" />

''[The Washington Post](/source/The_Washington_Post)''{{'}}s fact-checking team has identified six forms of video manipulation, classified into three categories:<ref>{{cite news|url=https://www.washingtonpost.com/graphics/2019/politics/fact-checker/manipulated-video-guide/|title=Seeing Isn't Believing: The Fact Checker's guide to manipulated video|newspaper=[The Washington Post](/source/The_Washington_Post)|date=June 25, 2019|accessdate=January 19, 2021|archive-date=December 25, 2020|archive-url=https://web.archive.org/web/20201225181141/https://www.washingtonpost.com/graphics/2019/politics/fact-checker/manipulated-video-guide/|url-status=live}}</ref>
# Missing context
#* ''Misrepresentation:'' Placing original video footage into an incorrect context to misinform the audience
#* ''Isolation:'' Publishing a short segment from a video that presents a different narrative than the full video
# Deceptive editing
#* ''Omission:'' Removing major segments from a video to present a different story
#* ''Splicing:'' Combining segments from different videos to form a narrative not supported by any of the individual videos
# Malicious transformation
#* ''Doctoring:'' Directly modifying [video frames](/source/Film_frame)
#* ''Fabrication:'' Using technology to construct bogus videos, such as deepfakes

==Video manipulation and fake news==
With fake news becoming increasingly prominent in popular culture and with rapid advancements in audio and video manipulation technology, the public is increasingly encountering fake news that is supported by deceptive videos.<ref name=":0" /> In terms of types of fake news, the potential to be classified is ever-expanding but includes five main types — [satire](/source/satire) or [parody](/source/parody), [selective reporting](/source/selective_reporting), sloppy [journalism](/source/journalism), [clickbait](/source/clickbait), and [conspiracies](/source/conspiracies).<ref name=":0" /> Though the five main types of fake news are prominent globally, one of the most destructive types of fake news lies within all five types and is video and audio manipulation. Video and audio manipulation are defined as a new variant of media manipulation that targets digital video using a combination of traditional [video processing](/source/video_processing) and video editing techniques with auxiliary methods from [artificial intelligence](/source/artificial_intelligence) like face recognition. The results range from artistic videos produced for [aesthetic](/source/aesthetic) effects to videos aimed at (mass) manipulation and [propaganda](/source/propaganda), a straightforward extension of the long-standing possibilities of [photo manipulation](/source/photo_manipulation).

==Digital fakes==

A digital fake refers to a digital video, photo, or audio file that has been altered or manipulated by digital application software. [Deepfake](/source/Deepfake) videos fall within the category of digital fake media, but a video may be digitally altered without being considered a deepfake. The alterations can be done for entertainment purposes, or more nefarious purposes such as spreading disinformation. The information can be used to conduct malicious attacks, political gains, financial crimes, or [fraud](/source/fraud).

== Regulation ==
Due to the social and political impacts caused by Deepfake, many national states implement regulations in order to combat these effects of video manipulation. Technical regulations range from real-name verification requirements, labeling information, [censorship](/source/censorship)s, and banning [synthetic](/source/synthetic_media) images, audio, and video.<ref name=":3" />

=== China ===
[China](/source/China) issued the "Provision on the Administration of Deep Synthesis Internet Information Service" on January 28, 2022. China's State Internet Information Office enforced this regulation as a way to control manipulated content on the Internet and increase technological stability within the [Chinese Communist Party (CCP)](/source/Chinese_Communist_Party). There are 25 articles in total and each article section ultimately explains the terms and conditions of the regulation itself.<blockquote>"Article 5: Encourage relevant industry organizations to strengthen industry self-discipline, establish and improve industry standards, industry guidelines, and self-regulatory management systems, supervise and guide deep synthesis service providers to formulate and improve service specifications, strengthen information content security management, provide services in accordance with the law, and accept social supervision."<ref name=":2">{{Cite web |title=国家互联网信息办公室关于《互联网信息服务深度合成管理规定（征求意见稿）》公开征求意见的通知-中共中央网络安全和信息化委员会办公室 |url=http://www.cac.gov.cn/2022-01/28/c_1644970458520968.htm |access-date=2023-08-29 |website=www.cac.gov.cn |archive-date=2023-08-29 |archive-url=https://web.archive.org/web/20230829034337/http://www.cac.gov.cn/2022-01/28/c_1644970458520968.htm |url-status=live }}</ref></blockquote>One of the policy articles that were mentioned in Emmie Hine and [Luciano Floridi](/source/Luciano_Floridi)'s text was Article 5, which goes over that while the government will look over the information being posted publicly, industry corporations are also responsible for keeping track of content that is published on their [social platforms](/source/social_platforms). This particular policy pushes companies in China to be more aware of what is shown online because if not, the companies themselves will be fined.<ref name=":3">{{Cite journal |last1=Hine |first1=Emmie |last2=Floridi |first2=Luciano |date=2022-07-20 |title=New deepfake regulations in China are a tool for social stability, but at what cost? |journal=Nature Machine Intelligence |language=en |volume=4 |issue=7 |pages=608–610 |doi=10.1038/s42256-022-00513-4 |issn=2522-5839 |doi-access=free }}</ref>

=== United States ===
The [United States](/source/United_States) issued the "DEEP FAKES Accountability Act" in 2019. However, Hine and Luciano stated this policy only prevents the act around "[unauthorized](/source/Authorization) digital recreations of people". This established bill ultimately puts a criminal penalties for related impersonations and pornography violations.<ref>{{Cite journal |last=MST Students |date=2020-07-13 |title=H.R. 4286 (116th Congress) - Virtual Apprenticeship Tax Credit Act of 2019 |journal=The Contemporary Tax Journal |volume=9 |issue=2 |doi=10.31979/2381-3679.2020.090214 |issn=2381-3679|doi-access=free }}</ref> Because of this regulation, many well-known platforms like Facebook and Twitter began to removed unlawful information that violated the policy and even require labeling regulations.<ref name=":3" />

== Video manipulation market failures ==
Some of the main reasons why large national states like the United States and China are implementing video manipulation regulations/policies are because of [market failure](/source/market_failure)s.<ref name=":3" /> In particular, market failures that revolve around the topics of [public goods](/source/Public_good_(economics)) and [negative externalities](/source/Negative_Externalities). Public goods refer to products and services that can be used by everyone. On the other hand, negative externalities are negative actions that affect someone who did not fully [consent](/source/consent) or was not involved with the situation.

=== Public goods ===
Synthetic information, including content taken by Deepfake, is shown and available to everyone in the public eye (characteristics of general public goods). Because of the easy and worldwide access, misinformation is spread rapidly quickly and sometimes out of control. In turn, lawmakers and governmental organizations create policies that control what is being put on the internet.<ref name=":4">{{Cite journal |last=Kigwiru |first=Vellah Kedogo |date=2022 |title=Deepfake Technology and Elections in Kenya: Can Legislation Combat the Harm Posed by Deepfakes? |url=https://www.ssrn.com/abstract=4229272 |journal=SSRN Electronic Journal |language=en |doi=10.2139/ssrn.4229272 |issn=1556-5068|url-access=subscription |doi-access=free }}</ref> One example that explicitly demonstrates content being "over-consumed" within society is "The Voice of April" event. The Voice of April was a day when numerous videos of Shanghai citizens were being censored and banned during [COVID-19](/source/COVID-19). However, because these videos were published on the Internet, it continued to circulate throughout China and some people even made different versions when the original content got deleted.<ref>{{Cite AV media |title=四月之声The Voice of April Eng translation {{!}} China 2022 Shanghai Lockdown Record #shanghai #lockdown | date=23 April 2022 |url=https://www.youtube.com/watch?v=5pzwkFCAv44 |access-date=2023-08-29 |language=en |via=[YouTube](/source/YouTube) |archive-date=2023-08-29 |archive-url=https://web.archive.org/web/20230829091500/https://www.youtube.com/watch?v=5pzwkFCAv44 |url-status=live }}</ref> Covered in [MIT Technology Review](/source/MIT_Technology_Review), Zeyi Yang informed that videos being censored by the government were re-uploaded into copies and stored through outside social platforms.<ref>{{Cite web |title=WeChat wants people to use its video platform. So they did, for digital protests. |url=https://www.technologyreview.com/2022/04/24/1051073/wechat-shanghai-lockdown-protest-video-the-voice-of-april/ |access-date=2023-08-29 |website=MIT Technology Review |language=en |archive-date=2022-04-30 |archive-url=https://web.archive.org/web/20220430043404/https://www.technologyreview.com/2022/04/24/1051073/wechat-shanghai-lockdown-protest-video-the-voice-of-april/ |url-status=live }}</ref> Due to the challenges faced by the open-access content published online, nations continue to implement more regulations in order to maintain verified information.

=== Negative externalities ===
Video manipulation essentially creates fake scenarios that never happened. As a result of this act, many people can be impacted by synthetic information despite not being directly part of the scene. Jack Langa states in a [Law Journal article](/source/HeinOnline) that "a bad actor could take advantage of region's instability by using a deepfake to inflame a local population, which could lead to civilian casualties..."<ref name=":4" /> One example that showcases negative externalities from misleading/manipulated information is the [January 6, 2021 attack on the US Capitol](/source/January_6_United_States_Capitol_attack). This event led to approximately 140 police officers being assaulted (noted by the [United States Department of Justice](/source/United_States_Department_of_Justice)).<ref>{{Cite web |date=2022-02-15 |title=24 Months Since the January 6 Attack on the Capitol |url=https://www.justice.gov/usao-dc/24-months-january-6-attack-capitol |access-date=2023-08-29 |website=www.justice.gov |language=en |archive-date=2023-01-04 |archive-url=https://web.archive.org/web/20230104184551/https://www.justice.gov/usao-dc/24-months-january-6-attack-capitol |url-status=live }}</ref> However, [Judy Woodruff](/source/Judy_Woodruff) declared in a [PBS News Hours](/source/PBS_NewsHour) that the whole incident was caused by a [big lie about election fraud](/source/Donald_Trump's_false_claims_of_a_stolen_election) in 2020. Even though the situation was based on manipulated content, it ultimately led to numerous officers being harmed in the process.

==References==
{{reflist}}

{{Media manipulation}}

Category:Video processing
Category:Media manipulation
Category:Mass media and entertainment controversies

---
Adapted from the Wikipedia article [Video manipulation](https://en.wikipedia.org/wiki/Video_manipulation) by Wikipedia contributors ([contributor history](https://en.wikipedia.org/wiki/Video_manipulation?action=history)). Available under [Creative Commons Attribution-ShareAlike 4.0 International](https://creativecommons.org/licenses/by-sa/4.0/). Changes may have been made.
