Generative Text (1)

Abstract

In this project, GPT-2 model is utilized on two tasks:

  1. Generating fake news by typing in desired article title, using fine-tuned model. The output is a markdown file which mimics real news article.
  2. Generating jokes using different dataset. For each dataset, GPT-2 model is retrained. The jokes can be generated either with no input or with prime words.

Results

  1. Fake news: example-fakenews.pdf

  2. Jokes:
    2.1. Generated Reddit jokes example (Each paragraph below is a joke picked from various generated ones):

    A priest, an athletic trainer, and a psychologist walk into a bar.The bartender replies, “We do not serve Irishmen in here”

    A report from London, England reveals that the opposite of Governmentally undertaken transportation might cause increases in driving years.80% of British drivers are still unaware that they are on railway track.

    A man has a group of three gay people and one gives him a round of drinks before moving on to the next round. The first man settles down in front of his friend and one of the gasps goes, “Yeah, I figured.” He says “I’m gay.” the gay man nods “aaaawg I heard damn you.” Another man sighs. “I’m gay.” The third gay guy thinks for a moment and says “hmm, yeah well the group has a great laugh”. They settle down and leave the man on his hands and knees, looking delighted and happy.

    The man and Math enters the room and soon they find it impossible to speak so they pick a silent window in the room.

    Over the next few days, he continued to test the bunny, because he finally got his dose of medicine.
    He took the medicine, and the bunny fell asleep almost as stupid as he was.
    Morning came, and the bunny woke up from a hard waking on its way to the office.
    “BAGHHAAHmmmm…I wake up!
    I know.”
    “Why?” asked the bunny.
    “Because every time I ask you, “Why?”, you just nod your head and speak.
    You see, for all those who beg you, “Why?”, the bunny takes out one cigarette lighter, and smoking it lets out a horrible fart. This is the reason why your grandfather will never die. If you don’t smoke, he’ll die too.

    2.2 Generated StupidStuff jokes example (Each paragraph below is a joke picked from various generated ones):

    An American with an IQ of 120 could communicate with a Russian without the use of the Earth-orbiting Smherovlev detector. American technology even allowed American technology researchers to communicate with Russian technology researchers. But American technology researchers were not fool enough to trust Russian technology researchers. A year passed and another Russian research project was opened whose only accomplishment was to demonstrate the feasibility of sending horseshoe shaped magnets up the atmosphere for the experiment. Another Russian researcher, now with an IQ above 150, was appointed, he claimed, with a stick, to measure the feasibility of sending his magnet up the mountain. Sure enough, after a few weeks of testing, the magnet failed to measure up and fell to the ground. Later, another Russian researcher presented his magnet at the same measurement, but this time using a stick, he fell on his knees and endeavored to reach the top of the mountain. With his magnet still attached to his ground-based game, he demonstrated that experimentally harmful experiment with Russian technology. With great trepidation and great emotions Paolo and Iptical concluded that the experiment had failed.This American goes to consult with an Englishman. He tells us in his native language what he wants from Steve Jobs.

    A guy goes to the top of the stairs to find his hairy wife scratching her head. “What’s so funny about that?” he asks. The wife replies, “When I was younger I didn’t date your father!”

    A man walks into a bar with his wife. The guy says, “You’re beautiful, too.” The woman says, “It’s a cold one.” The guy says, “You’re cute, too.” The woman says, “You’re not.” The guy says, “Why not?” The man says, “You’re gorgeous, too.” The woman screams, “You’re so ugly, too.” The man says, “This must be why my wife keeps calling me Tom Cruise.”

Guileline Files

Notes

  • All the requirements are included in ipynb guide files.
  • Tested on Google Colab.

Reference