Lyrics_Generator.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "Lyrics Generator.ipynb",
      "provenance": [],
      "toc_visible": true,
      "machine_shape": "hm",
      "mount_file_id": "1F5cqv73hI1XqeG1iNjGnc96G9KndDROb",
      "authorship_tag": "ABX9TyMt1Kft9ZTm7UDjKdjznxGQ",
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "accelerator": "GPU"
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/timkabot/NeuralNetworkMusicGenerator/blob/master/Lyrics_Generator.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "mJILyeIyORGG"
      },
      "source": [
        "https://www.kaggle.com/mousehead/songlyrics\n",
        "Link to lyrics dataset"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "k6ogW4z8OJIx",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 33
        },
        "outputId": "8fb893fb-498d-4102-a01c-30c951c36b75"
      },
      "source": [
        "import os\n",
        "import pandas as pd\n",
        "\n",
        "%tensorflow_version 1.x"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "TensorFlow 1.x selected.\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "JuAn0O0LOYfq",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 150
        },
        "outputId": "c68df95c-570a-4750-f2ff-1e87d947b9e7"
      },
      "source": [
        "try:\n",
        "  import gpt_2_simple as gpt2\n",
        "except:\n",
        "  !pip3 -q install gpt-2-simple\n",
        "  import gpt_2_simple as gpt2"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "WARNING:tensorflow:\n",
            "The TensorFlow contrib module will not be included in TensorFlow 2.0.\n",
            "For more information, please see:\n",
            "  * https://github.com/tensorflow/community/blob/master/rfcs/20180907-contrib-sunset.md\n",
            "  * https://github.com/tensorflow/addons\n",
            "  * https://github.com/tensorflow/io (for I/O related ops)\n",
            "If you depend on functionality not listed there, please file an issue.\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "MqNFY00LOfey"
      },
      "source": [
        "Let's load our data. It was saved into a public Github repository to make it more convenient to be read into Colab:"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "F53-04qSOep1"
      },
      "source": [
        "dfs = []\n",
        "link = ('https://raw.githubusercontent.com/ThomasVrancken/lyrics_generation/master/songdata_{}.csv')\n",
        "for i in range(4):\n",
        "  dfs.append(pd.read_csv(link.format(i)))\n",
        "\n",
        "df = pd.concat(dfs).reset_index(drop=True)"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "iXo12MZyO1XH"
      },
      "source": [
        "Then save this file on our VM’s directory, under a “content” folder. GPT-2 will directly load it from there."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "QCmvbJ-NO11O"
      },
      "source": [
        "if not os.path.exists('content'):\n",
        "    os.makedirs('content')\n",
        "\n",
        "pd.DataFrame({\"lyrics\": df['text']})\\\n",
        "    .to_csv(os.path.join('content', 'lyrics.csv'), index=False)"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "xUSOwSS_PC8y"
      },
      "source": [
        "Next, we download the GPT-2 models. Note that you can restrict this list to the model(s) you will be using."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "5G3LXxkdPDZs",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 133
        },
        "outputId": "ea21d97c-281e-42df-e76f-f91e4d23ec63"
      },
      "source": [
        "for model_name in [\"124M\"]:  # Choose from [\"124M\",\"355M\",\"774M\"]\n",
        "    gpt2.download_gpt2(model_name=model_name)   # model is saved into current directory under /models/124M/"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Fetching checkpoint: 1.05Mit [00:00, 733Mit/s]                                                      \n",
            "Fetching encoder.json: 1.05Mit [00:00, 159Mit/s]                                                    \n",
            "Fetching hparams.json: 1.05Mit [00:00, 842Mit/s]                                                    \n",
            "Fetching model.ckpt.data-00000-of-00001: 498Mit [00:02, 167Mit/s]                                   \n",
            "Fetching model.ckpt.index: 1.05Mit [00:00, 543Mit/s]                                                \n",
            "Fetching model.ckpt.meta: 1.05Mit [00:00, 290Mit/s]                                                 \n",
            "Fetching vocab.bpe: 1.05Mit [00:00, 224Mit/s]                                                       \n"
          ],
          "name": "stderr"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "pkYLp0PIPJ8B"
      },
      "source": [
        "learning_rate = 0.0001\n",
        "optimizer = 'adam' # adam or sgd\n",
        "batch_size = 1\n",
        "model_name = \"124M\" # Has to match one downloaded locally\n",
        "sess = gpt2.start_tf_sess()"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "zjX_hjsGPQMJ"
      },
      "source": [
        "Next, we start the fine tuning. It can take a while (e.g. about 22min for 500 steps with the 774M model). Some useful parameters:\n",
        "\n",
        "\n",
        "*   **restore_from**: Set to fresh to start training from the base GPT-2, or set to latest to restart training from an existing checkpoint\n",
        "*   **sample_every**: Number of steps to print example output\n",
        "*   **print_every**: Number of steps to print training progress\n",
        "*   **learning_rate**: Learning rate for the training. (default 1e-4, can lower to 1e-5 if you have <1MB input data)\n",
        "*   **run_name**: Subfolder within checkpoint to save the model. This is useful if you want to work with multiple models (will also need to specify run_name when loading the model)\n",
        "*  **overwrite**: Set to True if you want to continue finetuning an existing model (w/ restore_from='latest') without creating duplicate copies\n",
        "* **steps**: How many training steps to be performed.\n",
        "\n",
        "\n"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "mZPXCCpwPQpV",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "outputId": "b414573d-7902-408b-e921-f1156d000057"
      },
      "source": [
        "gpt2.finetune(sess,\n",
        "              'content/lyrics.csv',\n",
        "              model_name=model_name,\n",
        "              sample_every=50,\n",
        "              print_every=10,\n",
        "              learning_rate=learning_rate,\n",
        "              batch_size=batch_size,\n",
        "              restore_from='latest',\n",
        "              steps=1000)   # max number of training steps"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/gpt_2_simple/src/sample.py:17: where (from tensorflow.python.ops.array_ops) is deprecated and will be removed in a future version.\n",
            "Instructions for updating:\n",
            "Use tf.where in 2.0, which has the same broadcast rule as np.where\n",
            "Loading checkpoint models/124M/model.ckpt\n",
            "INFO:tensorflow:Restoring parameters from models/124M/model.ckpt\n"
          ],
          "name": "stdout"
        },
        {
          "output_type": "stream",
          "text": [
            "\r  0%|          | 0/1 [00:00<?, ?it/s]"
          ],
          "name": "stderr"
        },
        {
          "output_type": "stream",
          "text": [
            "Loading dataset...\n"
          ],
          "name": "stdout"
        },
        {
          "output_type": "stream",
          "text": [
            "100%|██████████| 1/1 [00:00<00:00,  1.17it/s]\n"
          ],
          "name": "stderr"
        },
        {
          "output_type": "stream",
          "text": [
            "dataset has 23199731 tokens\n",
            "Training...\n",
            "[10 | 19.89] loss=2.07 avg=2.07\n",
            "[20 | 32.34] loss=2.19 avg=2.13\n",
            "[30 | 44.81] loss=2.28 avg=2.18\n",
            "[40 | 57.27] loss=1.84 avg=2.09\n",
            "[50 | 69.74] loss=2.03 avg=2.08\n",
            "======== SAMPLE 1 ========\n",
            " tell and I won't be the first time I've gotten a lot of trouble  \n",
            "From the depths of despair.  \n",
            "Truly,  \n",
            "In my last hour as a king,  \n",
            "I could not believe  \n",
            "The price I was getting for my love  \n",
            "I tried harder on all these years  \n",
            " But I didn't take the bait.  \n",
            "Then I was in the middle of her story.  \n",
            "My heart just kept pounding  \n",
            "I prayed for her,  \n",
            "  \n",
            "I got lost in the mire  \n",
            "I had no idea what else to do.  \n",
            "As an hour passed by  \n",
            "We got lost in the mire  \n",
            "  \n",
            "The time was late.  \n",
            "  \n",
            "I looked over the sky and saw tears streaming  \n",
            " From the depths of despair.  \n",
            "In my last hour as a king.  \n",
            "  \n",
            "In my last hour on the road  \n",
            "I couldn't believe  \n",
            "The price I was getting for  \n",
            "  \n",
            "I was lost in the mire  \n",
            "In my last hour as a king.  \n",
            "  \n",
            "In my last hour as a king  \n",
            "I prayed for her,  \n",
            "\n",
            "We lost in the mire  \n",
            "  \n",
            "  \n",
            "In my last hour on the road  \n",
            "I couldn't believe  \n",
            "The price I was getting for  \n",
            "\n",
            "  \n",
            "In my last hour as a king  \n",
            "I prayed for her,  \n",
            "\n",
            "We lost in the mire  \n",
            "\n",
            "  \n",
            "\n",
            "   \n",
            "In my last hour on the road  \n",
            "\n",
            "I didn't take the bait.  \n",
            "Then I was in the middle of her story.  \n",
            "  \n",
            "I looked over the sky and saw tears streaming from the depths  \n",
            "\n",
            "From the depths of despair.  \n",
            "In my last hour as a king.  \n",
            "  \n",
            "In my last hour as a king  \n",
            "I prayed for her,  \n",
            "\n",
            "we lost in the mire  \n",
            "\n",
            "  \n",
            "In my last hour on the road  \n",
            "\n",
            "I couldn't believe  \n",
            "The price I was getting for  \n",
            "\n",
            "  \n",
            "Then I was in the middle of her story.  \n",
            "I looked over the sky and saw tears streaming from the depths  \n",
            "From the depths of despair.\n",
            "\n",
            "  \n",
            "  \n",
            "In my last hour on the road  \n",
            "\n",
            "I cried for her,  \n",
            "\n",
            "We lost in the mire\n",
            "\n",
            "  \n",
            "\n",
            "  \n",
            "In my last hour on the road  \n",
            "\n",
            "I couldn't believe  \n",
            "The price I was getting for  \n",
            "\n",
            "\n",
            "  \n",
            "In my last hour on the road  \n",
            "\n",
            "I couldn't believe  \n",
            "The price I was getting for  \n",
            "\n",
            "  \n",
            "In my last hour on the road\n",
            "\n",
            "I couldn't believe  \n",
            "The price I was getting for  \n",
            "\n",
            "  \n",
            "\n",
            "In my last hour on the road\n",
            "\n",
            "I couldn't believe  \n",
            "The price I was getting for  \n",
            "\n",
            "  \n",
            "\n",
            "  \n",
            "In my last hour on the road\n",
            "\n",
            "We lost in the mire.\n",
            "\n",
            "  \n",
            "\n",
            "In my last hour on the road  \n",
            "\n",
            "We lost in the mire\n",
            "\n",
            "#\n",
            "\n",
            "I got your number.  \n",
            "  \n",
            "I got your number.  \n",
            "\n",
            "I got your number.  \n",
            "\n",
            "I got your number.  \n",
            "\n",
            "We got your number.\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>A woman was waiting for a man who had a problem at home, and he didn't have to worry about her  \n",
            "  \n",
            "He was so old so frail  \n",
            "He loved children on Sundays, so he could make them his  \n",
            "  \n",
            "She was just going through the motions  \n",
            "He was so tender so sweet and so soft  \n",
            "  \n",
            "He was so kind and so kind  \n",
            "  \n",
            "He was so kind and so kind  \n",
            "  \n",
            "He was so tender and so soft  \n",
            "  \n",
            "  \n",
            "She was just getting the kids out of my hands  \n",
            "  \n",
            "She was just getting the kids out of my hands  \n",
            "  \n",
            "  \n",
            "He was so tender and so soft and so tender  \n",
            "  \n",
            "He was so tender and so good  \n",
            "  \n",
            "He was so gentle and so gentle  \n",
            "  \n",
            "We got your number.  \n",
            "  \n",
            "He was so tender and so gentle \n",
            "\n",
            "[60 | 92.33] loss=2.14 avg=2.09\n",
            "[70 | 104.80] loss=2.58 avg=2.16\n",
            "[80 | 117.27] loss=2.24 avg=2.17\n",
            "[90 | 129.75] loss=2.11 avg=2.17\n",
            "[100 | 142.20] loss=2.00 avg=2.15\n",
            "======== SAMPLE 1 ========\n",
            ")  \n",
            "Lift out your coat and put it on the way home  \n",
            "Just make a note, and I'll be fine  \n",
            "  \n",
            "When you know you need to give, I'll let you go  \n",
            "I'll make sure you're alright  \n",
            "I think I'm quite blessed  \n",
            "  \n",
            "I think I'm quite blessed  \n",
            "I get it, I get it.  \n",
            "I don't know where this can go  \n",
            "I can't tell you that, but I know  \n",
            "I know. I know  \n",
            "  \n",
            "When you want me, I don't care if you lose it  \n",
            "Sometimes I think you deserve this, but you got to put it on the way home  \n",
            "Just make a note and I'll be fine  \n",
            "I'll make sure you're alright  \n",
            "I think I'm quite blessed  \n",
            "I get it, I'm sure I'm quite blessed  \n",
            "  \n",
            "I think I'm quite blessed  \n",
            "I got it, I got it.  \n",
            "I don't know where this can go  \n",
            "I can't tell you that, but I know\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>You want me on your side, you got me on your side  \n",
            "I want you to be my little girl, just like my little girl  \n",
            "You got to be mine, you got to put it on... (you got to say)  \n",
            "It's just like my little girl, it's just as though I'm gonna fuck you up  \n",
            "  \n",
            "You got to be mine, I got you to put it on... (you got to say)  \n",
            "That you take the money you gave me back to me.  \n",
            "You got to be mine, I got you to put it on... (you got to say)  \n",
            "  \n",
            "You got to be yours, I got you to put it on... (you got to say)  \n",
            "You got to be mine, I got you to put it on... (you got to say)  \n",
            "You got to be mine, I got you to put it on... (you got to say)  \n",
            "  \n",
            "I got it on my own, you got to put it on\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I'm gonna go down with you, you got me on my side  \n",
            "I want you, you got to be mine  \n",
            "I'm gonna go down with you,  \n",
            "  \n",
            "Don't you have to think? you gotta think  \n",
            "I'm gonna go down with you,  \n",
            "  \n",
            "I'm gonna go down with you,  \n",
            "  \n",
            "You got to be mine,  \n",
            "I'll take the money  \n",
            "I get this, I get this,  \n",
            "I'm gonna go down with you,  \n",
            "  \n",
            "I'm gonna go down with you,  \n",
            "  \n",
            "I'll go down with you,  \n",
            "  \n",
            "  \n",
            "Oh I don't know I like you  \n",
            "Ooh I don't know I like you  \n",
            "Ooh I don't know I like you  \n",
            "Ooh I don't know I like you  \n",
            "Ooh I don't know I like you  \n",
            "Ooh I don't know I like you  \n",
            "Ooh I don't know I like you  \n",
            "Ooh I don't know I like you  \n",
            "Ooh I don't know I like you  \n",
            " Ooh I don't know I like you  \n",
            "Ooh I don't know I like you  \n",
            "I don't know I like you  \n",
            "I don't know  \n",
            "  \n",
            "  \n",
            "I'm gonna go down with you,  \n",
            "I'll go down with you,  \n",
            "I'll go down with you,  \n",
            "  \n",
            "I'm gonna go down with you,  \n",
            "  \n",
            "  \n",
            "I'm gonna go down with you, \n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>No one's ever been the same to me  \n",
            "I've seen and I've seen  \n",
            "I've been the queen of my heart  \n",
            "And I've gone and gone and gone and gone  \n",
            "And I've been the queen of my heart  \n",
            "  \n",
            "Well now I'm gonna be the queen of my heart  \n",
            "And I'm gonna be the queen of my heart  \n",
            "And I'm gonna be the queen of my heart  \n",
            "  \n",
            "Well it seems like I'm gonna be the queen of my heart  \n",
            "Yeah\n",
            "\n",
            "[110 | 163.34] loss=1.78 avg=2.11\n",
            "[120 | 175.82] loss=1.88 avg=2.09\n",
            "[130 | 188.28] loss=1.65 avg=2.06\n",
            "[140 | 200.72] loss=1.99 avg=2.05\n",
            "[150 | 213.17] loss=1.58 avg=2.02\n",
            "======== SAMPLE 1 ========\n",
            "You can't get me going I'll just leave you alone forever(  \n",
            "  \n",
            "She looked at me. I'm so glad to know that I'm on the safe side of my heart, not the enemy.\n",
            "  \n",
            "  \n",
            "We were going to church, but my friend, Mary Jane didn't come.\n",
            "She wasn't there for a minute. She turned, and walked right back to me.\n",
            "She was a friend, not a friend at all.\n",
            "  \n",
            "  \n",
            "And here I am. I just met with Mary Jane.\n",
            "She was a friend, not a friend at all,\n",
            "She turned, and walked left.\n",
            "  \n",
            "  \n",
            "MaryJane told me I was in my town, a town of love and sorrow,\n",
            "It was a town as big as you could imagine.\n",
            "Mary Jane took me for what I would take, and took my place.\n",
            "It wasn't an easy ride, but I really liked it. I knew I had a place where the heart could walk.\n",
            "I'll never forget Mary Jane.\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I'm on my knees, praying for you, I can't let it be too late, if I give you what you need I'll find you all night when the day comes.  \n",
            "I can't wait to see the lights on the other side of the room, I'm feeling so close, the moon has risen again, then you came in here and let me kiss all your tears. Thank you.  \n",
            "  \n",
            "I'm on my knees, praying, just let it be too late if you give me what's in my bag, and I'm waiting there for you and all of your love.  \n",
            "It's what I do.  \n",
            "  \n",
            "I'm on my knees, wishing, praying as I sit here with you, holding me till I need it, and I've waited for you and your love today.  \n",
            "I'm waiting till I need it, I'm praying, just let it be too late if you give you something to show me.  \n",
            "I just want you to know that I'm on my knees, waiting, just let it be too late, if you give me what's in my bag, and I'm waiting for you and your love today.  \n",
            "I see your face, you're in my arms, and I'm waiting my love.  \n",
            "So let it be too late if you give me what's in my bag, and I'm waiting for you and your love. <|endoftext|>\n",
            "<|startoftext|>Hey babe, if I ever need a little sleep, I'll be there.  \n",
            "I'll be there tonight.  \n",
            "  \n",
            "[Chorus]  \n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>Babies should love each other  \n",
            "Babies should love each other for love  \n",
            "Ooh, how they cry, how they dream  \n",
            "Happiness and sadness are not the same  \n",
            "Babies should love each other for love  \n",
            "  \n",
            "A baby needs his place as soon as it is born  \n",
            "But don't let his love define it  \n",
            "Babies need their place as soon as it is born  \n",
            "  \n",
            "Baby, let me tell you  \n",
            "Baby, let me tell you  \n",
            "A baby needs his place as soon as it is born  \n",
            "But don't let his love define it  \n",
            "  \n",
            "A baby needs his place as soon as it is born.  \n",
            "Baby, let me know what he wants  \n",
            "Baby, let me know what he wants  \n",
            "A baby needs his place as soon as it is born.  \n",
            "Baby, let I say what we want,  \n",
            "Baby, let me say what we want.  \n",
            "  \n",
            "Baby, let me say what we want.  \n",
            "A baby needs his place as soon as it is born.  \n",
            "Baby, let me say what we want.  \n",
            "  \n",
            "Love can be hard for a baby on the beach  \n",
            "A baby should see the sea, then go see the sea and swim away  \n",
            "A baby should be, so much so, and so much so I'd like to have a hand around your neck  \n",
            "So love can be hard for a baby on the beach  \n",
            "A baby should see the sea, then go see the seas and swim away  \n",
            "A baby should be, so much so, and so much so I'd like to have a hand around your neck  \n",
            "So love can be hard for a baby on the beach  \n",
            "A baby should see the seas, then swim away  \n",
            "A baby\n",
            "\n",
            "[160 | 234.50] loss=1.86 avg=2.01\n",
            "[170 | 246.96] loss=1.78 avg=1.99\n",
            "[180 | 259.43] loss=2.06 avg=2.00\n",
            "[190 | 271.89] loss=1.78 avg=1.98\n",
            "[200 | 284.36] loss=2.05 avg=1.99\n",
            "======== SAMPLE 1 ========\n",
            " \n",
            "  \n",
            "I can't hold on to what you left me with  \n",
            "  \n",
            "Cause I've been here since I can remember  \n",
            "Until now  \n",
            "'Cause I'll never leave  \n",
            "  \n",
            "You've gone and you've gone and you've stayed  \n",
            "There's something that's just so nice  \n",
            "  \n",
            "You've gone and you've gone and you've left home  \n",
            "And you've left me alone and I'm gone  \n",
            "  \n",
            "You've gone and you've gone and you've gone  \n",
            "And you've gone  \n",
            "  \n",
            "You've gone and you've gone and you've left home  \n",
            "And you've gone  \n",
            "There's something that is just so nice  \n",
            "  \n",
            "You've gone and you've gone and you've gone  \n",
            "And you've gone  \n",
            "  \n",
            "You've gone and you've gone and you've gone  \n",
            "And you've gone  \n",
            "And you've gone  \n",
            "So   \n",
            "You've gone and you've gone and you've gone  \n",
            "And you've gone  \n",
            "  \n",
            "You've gone and you've gone and you've gone  \n",
            "And you've gone  \n",
            "So  \n",
            "You've gone and you've gone and you've gone  \n",
            "You've gone  \n",
            "And you've went  \n",
            "So  \n",
            "You've gone and you've gone and you've gone  \n",
            "And you've gone  \n",
            "So  \n",
            "  \n",
            "You've gone and you've gone and you've gone  \n",
            "And you've gone  \n",
            "So  \n",
            "You've gone and you've gone and you've gone  \n",
            "You've gone  \n",
            "I've gone  \n",
            "I've gone  \n",
            "I've gone\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I was so used to living in this world  \n",
            "It was like  \n",
            "  \n",
            "Everything that you've gotta do  \n",
            "  \n",
            "Just a little break in you can do  \n",
            "  \n",
            "Don't tell anyone  \n",
            "Don't show your face  \n",
            "  \n",
            "Don't ask permission  \n",
            "Don't tell anyone  \n",
            "Don't make a deal  \n",
            "  \n",
            "I'm not a fool but I know  \n",
            "  \n",
            "The money makes me feel different  \n",
            "I'm not sure where to send it  \n",
            "  \n",
            "Don't break in  \n",
            "  \n",
            "I know I'll get it  \n",
            "  \n",
            "But now you try to kill me  \n",
            "  \n",
            "I'm not like you  \n",
            "I won't take it  \n",
            "Just like I'm not scared  \n",
            "  \n",
            "I'm not a fool  \n",
            "I know the money makes me feel different  \n",
            "I'm not sure if what you do to them is worth to me  \n",
            "  \n",
            "  \n",
            "You know they don't understand  \n",
            "You know they know  \n",
            "  \n",
            "The world won't end  \n",
            "  \n",
            "Cause I'll keep on coming back  \n",
            "I'm not a fool  \n",
            "I know  \n",
            "I'm not scared  \n",
            "  \n",
            "  \n",
            "Don't tell anyone  \n",
            "Don't show your face  \n",
            "Don't ask permission  \n",
            "Don't show your face  \n",
            "  \n",
            "I've never seen something this kind  \n",
            "Like this\n",
            "  \n",
            "  \n",
            "I'm really scared  \n",
            "I'm getting so scared  \n",
            "Don't give it up  \n",
            "  \n",
            "Don't break in  \n",
            "  \n",
            "I'm not like you  \n",
            "I won't take it  \n",
            "Just like I'm not scared  \n",
            "  \n",
            "You know you won't take it  \n",
            "The world is like the sun  \n",
            "But I still won't be afraid  \n",
            "  \n",
            "You know.  \n",
            "I'm not scared  \n",
            "I've never seen something so good  \n",
            "This\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>Yeah.  \n",
            "  \n",
            "Yeah.  \n",
            "You know, I just keep on running  \n",
            "The sun goes up  \n",
            "The sky's down.  \n",
            "  \n",
            "In the snow, you don't think  \n",
            "I'm so bad  \n",
            "But you don't give a damn  \n",
            "  \n",
            "Yeah.  \n",
            "I'll be there  \n",
            "  \n",
            "Yeah baby, I'm so bad  \n",
            "But you don't give a damn  \n",
            "  \n",
            "I feel so bad  \n",
            "I'm getting more bad  \n",
            "\n",
            "[210 | 305.61] loss=1.68 avg=1.97\n",
            "[220 | 318.07] loss=1.93 avg=1.97\n",
            "[230 | 330.52] loss=1.92 avg=1.97\n",
            "[240 | 342.99] loss=2.24 avg=1.98\n",
            "[250 | 355.45] loss=1.81 avg=1.97\n",
            "======== SAMPLE 1 ========\n",
            " \n",
            "  \n",
            "[Chorus]  \n",
            "You're gonna do right by that boy  \n",
            "I love you  \n",
            "I love you  \n",
            "  \n",
            "[Chorus]\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>You got to let it out  \n",
            "You can't turn back  \n",
            "It's just so weird  \n",
            "I don't really understand why  \n",
            "So I'm going back right on it, right on it  \n",
            "  \n",
            "We got to be a better father  \n",
            "We got to be a better father  \n",
            "And not just for fun  \n",
            "Nothing's gonna come true  \n",
            "The world will end  \n",
            "And in that world all that's ever gonna be  \n",
            "If you ain't got to make it  \n",
            "Just let me go  \n",
            "You gotta let it out  \n",
            "  \n",
            "You got to let it out  \n",
            "You gotta let it out  \n",
            "You gotta let it out  \n",
            "  \n",
            "You got to let it out  \n",
            "You gotta let it out  \n",
            "You gotta let it out  \n",
            "  \n",
            "I'm not in love with you  \n",
            "I'm not in love with you  \n",
            "I'm in love with you  \n",
            "I think I'm a fool for liking you  \n",
            "I said I would  \n",
            "I'll be the best of the best  \n",
            "If I'm not making my move  \n",
            "Just let me go  \n",
            "  \n",
            "I'm not in love with you  \n",
            "I'm not in love with you  \n",
            "I'm in love with you  \n",
            "I don't even care  \n",
            "I'm in love with you  \n",
            "I think I'm a fool for liking you  \n",
            "I said I would  \n",
            "I'll be the best of the best  \n",
            "If I'm not making my move  \n",
            "Just let me go  \n",
            "  \n",
            "  \n",
            "You got to let it out  \n",
            "You got to let it out  \n",
            "  \n",
            "You got to let it out  \n",
            "You got to let it out  \n",
            "  \n",
            "Do you have a friend  \n",
            "Do you have a friend  \n",
            "Do you have a friend  \n",
            "Do you have a friend  \n",
            "Do you have a friend  \n",
            "Do you have a friend  \n",
            "If you don't have a friend  \n",
            "If you don't have a friend  \n",
            "If you don't have a friend  \n",
            "I'm not in love with you  \n",
            "I was a fool  \n",
            "You had no idea  \n",
            "I'm a fool for liking you  \n",
            "I said I would  \n",
            "I'll be the best of the best  \n",
            "If I'm not making my move  \n",
            "Just let me go  \n",
            "  \n",
            "You got to let it out  \n",
            "You got to let it out\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I'm trying to find the answer  \n",
            "My heart will stop and I can't find you  \n",
            "But I got to meet someone  \n",
            "The world is the way you see me  \n",
            "  \n",
            "This is my story  \n",
            "I'm gonna take back to myself  \n",
            "  \n",
            "I'm going to stay in the sun  \n",
            "I got to be the one for you  \n",
            "I'll go away in a cloud  \n",
            "  \n",
            "The things you say to each other  \n",
            "The things you say to me  \n",
            "The things you say to me  \n",
            "The things you say to me  \n",
            "  \n",
            "I'm going to be the one for you  \n",
            "I'm going to find my way  \n",
            "The one for you  \n",
            "The one for you  \n",
            "I'm going to find my way  \n",
            "The one for you  \n",
            "The one for you  \n",
            "  \n",
            "I'm gonna stay in the sun for it's all I'm gonna be  \n",
            "Theone for me\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>When I was walking in a daze  \n",
            "Before the world began to come into view  \n",
            "You'd leave my hands behind just to kiss myself  \n",
            "And then you'd ask me why I was gone  \n",
            "And you'd say, yeah  \n",
            "  \n",
            "There's no other way  \n",
            "I thought it was a gift  \n",
            "But I was so wrong  \n",
            "The words were too real  \n",
            "  \n",
            "Well when I got down the line with all my friends  \n",
            "I found out they're so much more than just a bunch of kids  \n",
            "\n",
            "\n",
            "[260 | 376.69] loss=1.85 avg=1.97\n",
            "[270 | 389.15] loss=2.27 avg=1.98\n",
            "[280 | 401.62] loss=2.12 avg=1.99\n",
            "[290 | 414.10] loss=1.96 avg=1.98\n",
            "[300 | 426.58] loss=2.35 avg=2.00\n",
            "======== SAMPLE 1 ========\n",
            " I  \n",
            "Have you heard? It's gonna last a while and I'll catch a break  \n",
            "  \n",
            "Well what's the secret to your strength?  \n",
            "You just can't hide all the time  \n",
            "All the time  \n",
            "All the time  \n",
            "  \n",
            "[Chorus: x2]  \n",
            "The way the man knows he can't be  \n",
            "The way the man knows he can't be  \n",
            "  \n",
            "[Chorus]  \n",
            "  \n",
            "You're a stranger on a lonely night,  \n",
            "You're just the type of man I'll never come to love  \n",
            "You're just the type,  \n",
            "That I'll never bring to home  \n",
            "It's just time  \n",
            "  \n",
            "It's all about what you gotta be  \n",
            "All the time  \n",
            "All the time  \n",
            "  \n",
            "[Chorus: x2]\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>The sound of drums  \n",
            "The sounds of drums  \n",
            "Oh, I love that sound  \n",
            "And the sound of horns  \n",
            "Oh, the drums!  \n",
            "  \n",
            "[Chorus]  \n",
            "I've had to lose the rhythm  \n",
            "The drums  \n",
            "The sound of drums  \n",
            "Oh the drums!  \n",
            "  \n",
            "[Chorus]\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>Ah, what a surprise  \n",
            "'Catching your train in time  \n",
            "But now you're leaving from your own  \n",
            "This is the journey you've been waiting for  \n",
            "Oh, I've got a feeling you could be here  \n",
            "Ah, what a thrill  \n",
            "'Catching your train in time  \n",
            "'Catching your train in time  \n",
            "'Catching your train in time  \n",
            "You're leaving from your own  \n",
            "  \n",
            "'Catching your train in time'  \n",
            "'Catching your train in time'  \n",
            "'Catching your train in time'  \n",
            "'Catching your train in time  \n",
            "'Catching your train in time'  \n",
            "'Catching your train in time'\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I've seen ya before  \n",
            "I've seen ya before  \n",
            "I've seen ya before  \n",
            "I've seen ya before  \n",
            " I've seen ya before  \n",
            "I've seen ya before  \n",
            "I've seen ya before you're gone  \n",
            "  \n",
            "It's not just the same, a little different  \n",
            "It's not just the same, a little different  \n",
            "This is just a little different  \n",
            "Ah, this is just a little different  \n",
            "Catch up with me baby, ah,  \n",
            "I'm a bird of a feather  \n",
            "I'm a bird of a feather  \n",
            "  \n",
            "The road was paved with trees and grass  \n",
            "It was paved with trees and grass  \n",
            "I was a bird of a feather  \n",
            "It was paved with trees and grass  \n",
            "I was a bird of a feather  \n",
            "  \n",
            "I've got a dream  \n",
            "It was paved with water  \n",
            "But the day of my death is just too long  \n",
            "It was paved with water  \n",
            "But the day of my death is just too long  \n",
            "  \n",
            "Just one night in my dreams  \n",
            "Just one night in my dreams  \n",
            "Just one night in my dreams  \n",
            "  \n",
            "Don't you look me in the eye  \n",
            "Don't you look me in the eye  \n",
            "You look me in the eye  \n",
            "I'm like a bird  \n",
            "You have a dream  \n",
            "You have a dream  \n",
            "  \n",
            "Just one night in my dreams\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I've never known all that you could do  \n",
            "That you could do  \n",
            "You're the king of your land  \n",
            "  \n",
            "Your life is full of holes  \n",
            "But all the holes are right  \n",
            "When you start feeling real  \n",
            "You find out where you go  \n",
            "And if the sky's cold  \n",
            "It's really cold, cold  \n",
            "Oh I need you  \n",
            "  \n",
            "And all your plans are done  \n",
            "All your plans are done  \n",
            "All your plans are done  \n",
            "There you go  \n",
            "I need you  \n",
            "  \n",
            "You can't hide the past  \n",
            "And you can't hide the past  \n",
            "You've got yourself a bird of\n",
            "\n",
            "[310 | 447.88] loss=1.67 avg=1.99\n",
            "[320 | 460.33] loss=1.95 avg=1.98\n",
            "[330 | 472.78] loss=2.36 avg=2.00\n",
            "[340 | 485.25] loss=2.17 avg=2.00\n",
            "[350 | 497.71] loss=1.84 avg=2.00\n",
            "======== SAMPLE 1 ========\n",
            " control, we've got it all  \n",
            "We've got it all  \n",
            "  \n",
            "It's all, it's all  \n",
            "And it's all  \n",
            "It's all, it's all  \n",
            "It's all, it's all  \n",
            "It's all, it's all  \n",
            "It's all, it's all  \n",
            "It's all, it's all  \n",
            "  \n",
            "You always knew there was something up  \n",
            "And even though the wind was so strong it did not reach  \n",
            "  \n",
            "There's something inside of our little boy  \n",
            "That just keeps running down the road to hell  \n",
            "  \n",
            "That's the moment that  \n",
            "Everything that makes us free  \n",
            "It makes us free  \n",
            "The moment that all the lights that light the way will always keep  \n",
            "Light the way you'll always be  \n",
            "To see that everything you're doing can't change, can't change  \n",
            "When all's really all, all's all right  \n",
            "It's all, it's all  \n",
            "We've got it all  \n",
            "  \n",
            "It's all, it's all  \n",
            "It's all  \n",
            "And it's all  \n",
            "It's all, it's all  \n",
            "It's all, it's all  \n",
            "It's all, it's all  \n",
            "It's all\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>Tired of feeling like I'm dying, I'm tired of feeling so alive  \n",
            "I never cared what it was you told me, you're just a fool if you think I don't get to know you  \n",
            "So you can take this heart of a man, I'm sure you'll agree  \n",
            "  \n",
            "Now I'm tired of thinking that I know better than to waste it all on these things, 'til I wake up and find out how you feel  \n",
            "So now I'm tired of looking, 'til the day I find out what I'm feeling  \n",
            "So I can come with you when you let me in  \n",
            "  \n",
            "Now I'm tired of feeling like I'm going off, I'm tired of feeling so lonely  \n",
            "So now I'm tired of feeling you, I'm tired of feeling so sad  \n",
            "So I can come with you when you let me in  \n",
            "  \n",
            "Now I'm tired of feeling like I'm going down to the bottom, I'm tired of feeling so empty  \n",
            "So now I'm tired of thinking that I know better than to waste it all on these things  \n",
            "So I can come with you when you let me in  \n",
            "  \n",
            "Now\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>In this room, in this room  \n",
            "  \n",
            "  \n",
            "You can be a real hero  \n",
            "In this room  \n",
            "In this room  \n",
            "  \n",
            "You can be a real hero  \n",
            "In this room  \n",
            "In this room  \n",
            "  \n",
            "So you see me  \n",
            "You can be a real hero  \n",
            "In this room  \n",
            "  \n",
            "You can be a real hero  \n",
            "In this room  \n",
            "You have been a real hero  \n",
            "  \n",
            "In this room  \n",
            "In this room  \n",
            "  \n",
            "So you see me  \n",
            "You can be a real hero  \n",
            "In this room  \n",
            "  \n",
            "You can be a real hero  \n",
            "In this room  \n",
            "  \n",
            "This is your life  \n",
            "  \n",
            "This is your life  \n",
            "This is your life, this is your life,  \n",
            "This is your life,  \n",
            "This is your life, is your life, this is your life  \n",
            "  \n",
            "  \n",
            "  \n",
            "This is your life  \n",
            "  \n",
            "This is your life  \n",
            "  \n",
            "This is your life  \n",
            "This is your life  \n",
            "  \n",
            "This is your life\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>There's nothing like a feeling  \n",
            "A feeling of loss, of longing, of doubt  \n",
            "That can never be lifted from within  \n",
            "  \n",
            "Here's someone willing to put something into place  \n",
            "Take us all to one place  \n",
            "This feeling of joy  \n",
            "  \n",
            "'Cause there's nothing like a feeling  \n",
            "Like a feeling, the way we've been feeling (of pain or sorrow or confusion)  \n",
            "It's just the way things used to be  \n",
            "  \n",
            "But there's something like a feeling  \n",
            "I don't understand the way it\n",
            "\n",
            "[360 | 518.86] loss=1.70 avg=1.99\n",
            "[370 | 531.31] loss=2.28 avg=2.00\n",
            "[380 | 543.75] loss=2.21 avg=2.00\n",
            "[390 | 556.22] loss=1.80 avg=2.00\n",
            "[400 | 568.69] loss=2.06 avg=2.00\n",
            "======== SAMPLE 1 ========\n",
            "\n",
            "|<|startoftext|>This is my old man  \n",
            "And this old man is in bed as I'm  \n",
            "The old man's got her bed, bed  \n",
            "And my old man is there  \n",
            "It's on the floor, on the wall, in the  \n",
            "  \n",
            "And I'm the old man, the old man on the wall  \n",
            "The old man is in bed as I'm  \n",
            "The old man's got her bed, bed  \n",
            "And I'm the old man  \n",
            "This is my old man  \n",
            "And this old man is in bed as I'm  \n",
            "  \n",
            "The old man's got me locked up in the bathroom\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>Every day, you think of me  \n",
            "When I smile, then feel your touch  \n",
            "That's when we say love is born?  \n",
            "  \n",
            "Everyday, I hear your voice  \n",
            "And feel your touch, when I feel it  \n",
            "That's when we say love is born?  \n",
            "  \n",
            "Everyday, you think of me  \n",
            "When I smile, then feel your touch  \n",
            "That's when we say love is born?  \n",
            "  \n",
            "Everyday, if I could only take your breath away  \n",
            "  \n",
            "(I wanna feel your touch)  \n",
            "  \n",
            "(I wanna feel your touch)  \n",
            "  \n",
            "Everyday now, I wanna try and breathe  \n",
            "  \n",
            "(I wanna feel your touch)  \n",
            "  \n",
            "(I wanna feel your touch)  \n",
            "  \n",
            "(I wanna feel your touch)  \n",
            "  \n",
            "(I wanna feel your touch)\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>Every night I come home to tell you (ohhh yeah) what happened (ohhh yeah)  \n",
            "When I'm crying on the corner  \n",
            "Where the people were all dressed up in black  \n",
            "  \n",
            "That's when you came to me (hey)  \n",
            "As I was just walking down the street  \n",
            "I was like \"I'm so glad that you did  \n",
            "Come to me\"  \n",
            "  \n",
            "I'm so glad you came to me  \n",
            "  \n",
            "You're so nice, so bright  \n",
            "  \n",
            "You're so warm and so warm  \n",
            "  \n",
            "You're so hot, so hot  \n",
            "  \n",
            "  \n",
            "  \n",
            "You know I don't need no such friend  \n",
            "But I need a friend who's got a heart and a heart that  \n",
            "Is strong enough (sans-as!)  \n",
            "  \n",
            "(sans-as!), yeah  \n",
            "  \n",
            "You make me want you  \n",
            "  \n",
            "You make me want you  \n",
            "  \n",
            "  \n",
            "That's when I'm crying (oh oh yeah)  \n",
            "When I'm crying (oh oh yeah)  \n",
            "  \n",
            "  \n",
            "Yes, I'm so pretty (sans-as!), yeah  \n",
            "  \n",
            "You know I need a friend who knows me, (honey, I know)  \n",
            "  \n",
            "(sans-as!)  \n",
            "  \n",
            "(sans-as!)  \n",
            "  \n",
            "You're so nice, so hot (oh yeahhh!)  \n",
            "  \n",
            "  \n",
            "You're so warm and so warm (sans-as!)  \n",
            "  \n",
            "(sans-as!)  \n",
            "  \n",
            "When you told me you would like to go  \n",
            "  \n",
            "You took me to your house  \n",
            "When I needed the help  \n",
            "It was cold out  \n",
            "You took my hand and shook me  \n",
            "  \n",
            "  \n",
            "You were so nice (sans-as!)  \n",
            "And I feel you  \n",
            "For the first time  \n",
            "  \n",
            "(sans-as!)  \n",
            "  \n",
            "You're so handsome with a smile  \n",
            "And I see you in the mirror  \n",
            "  \n",
            "That's when I get my first taste of  \n",
            "You  \n",
            "  \n",
            "You know I don't need no such friend  \n",
            "But I need a friend who's got a heart and a heart that  \n",
            "Is strong enough  \n",
            "  \n",
            "(sans-as!)\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>The world is changing, and I can only tell you  \n",
            "How fast I can fly, how fast I can soar  \n",
            "I think you're all I'm ever gonna\n",
            "\n",
            "[410 | 590.01] loss=1.62 avg=1.99\n",
            "[420 | 602.47] loss=2.16 avg=1.99\n",
            "[430 | 614.93] loss=1.68 avg=1.98\n",
            "[440 | 627.39] loss=2.18 avg=1.99\n",
            "[450 | 639.85] loss=1.89 avg=1.99\n",
            "======== SAMPLE 1 ========\n",
            " way, to be right behind me  \n",
            "You are my life, my life  \n",
            "  \n",
            "Everywhere we went, I thought we would reach out  \n",
            "Where you want me, I'm begging you now  \n",
            "For this time, I'm begging you now  \n",
            "  \n",
            "Everywhere we went and I thought we would reach out  \n",
            "Where you want me, I'm begging you now  \n",
            "For this time, I'm begging you now  \n",
            "For this time, I'm begging you now\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I don't care anymore, no, you're not mine  \n",
            "Now I can feel your warmth  \n",
            "I want you so badly, you're not mine  \n",
            "I'm dying, you're not mine  \n",
            "I want you more than anything  \n",
            "I want you just like anybody  \n",
            "All alone, no, you're not mine  \n",
            "I'm dying  \n",
            "I'm dying, I'm dying  \n",
            "I'm dying to be sure  \n",
            "  \n",
            "Oh, oh oh oh oh oh  \n",
            "  \n",
            "There's always more to know, but never feel so lonely  \n",
            "There's always more to see  \n",
            "Where there's an end, you'll never find  \n",
            "You'll never find what you just didn't  \n",
            "You're not mine  \n",
            "I'll never leave you this way, I'm dying, I'm dying  \n",
            "I'm dying, I'm dying  \n",
            "I'm dying to be sure  \n",
            "  \n",
            "Oh oh oh oh oh oh  \n",
            "  \n",
            "You are my life, my life  \n",
            "I'm begging you now  \n",
            "For this time, I'm begging you now  \n",
            "  \n",
            "No more, no more, no, you're not mine  \n",
            "You're not mine  \n",
            "Oh, oh oh oh oh oh oh  \n",
            "Oh, oh oh oh oh oh  \n",
            "  \n",
            "Oh, oh oh oh oh oh  \n",
            "Oh, oh oh oh oh oh  \n",
            "Oh, oh oh oh oh oh  \n",
            "I'm dying, I'm dying  \n",
            "I'm dying  \n",
            "Oh, oh oh oh oh oh  \n",
            "Oh, oh oh oh oh oh oh  \n",
            "I'm dying, I'm dying  \n",
            "  \n",
            "Hey baby  \n",
            "Just wait a minute, baby  \n",
            "Just wait a minute baby  \n",
            "Baby let me see you, don't stop  \n",
            "  \n",
            "Oh, oh oh oh oh oh oh  \n",
            "  \n",
            "Oh, oh oh oh oh oh oh  \n",
            "  \n",
            "I don't care anymore, no  \n",
            "No, you're not mine  \n",
            "Oh, oh oh oh oh oh  \n",
            "  \n",
            "Oh, oh oh oh oh oh oh  \n",
            "Oh, oh oh oh oh oh oh oh!\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I've been a fool my entire life, and I'll never be the same  \n",
            "I love your blue eyes and my heart, no matter  \n",
            "But I'd rather be that girl that you love so  \n",
            "  \n",
            "You're my life, your life, your life  \n",
            "  \n",
            "We'll be the best people in the world  \n",
            "We can make it happen, yes we can  \n",
            "You're my life, the life, my soul  \n",
            "But I'd rather be that girl that you love so  \n",
            "  \n",
            "You've been here all night, to watch me fall  \n",
            "And I'm so glad that I can stay  \n",
            "I'll never love you again, I'll be gone  \n",
            "  \n",
            "You're my life, your life, your life  \n",
            "  \n",
            "You've been my life  \n",
            "you've been my life  \n",
            "you've been my life  \n",
            "you've been my life  \n",
            "I know you've been a fool my entire life  \n",
            "That girl I trusted, my life was my life  \n",
            "  \n",
            "And I'd rather be that girl that you love so  \n",
            "You're my life, your life, your life  \n",
            "But I'd rather be that girl that you love so  \n",
            "  \n",
            "I've been a fool my entire life  \n",
            "I'll never be the same  \n",
            "I love your blue eyes and my heart, no matter  \n",
            "But I'd rather be that girl that you love so  \n",
            "  \n",
            "I feel you love so, and it feels real  \n",
            "Oh and you can't go on pretending that  \n",
            "I know, it's true all the time  \n",
            "You\n",
            "\n",
            "[460 | 661.07] loss=1.62 avg=1.98\n",
            "[470 | 673.54] loss=1.66 avg=1.97\n",
            "[480 | 686.00] loss=1.65 avg=1.96\n",
            "[490 | 698.46] loss=2.02 avg=1.96\n",
            "[500 | 710.91] loss=2.03 avg=1.96\n",
            "======== SAMPLE 1 ========\n",
            " rat  \n",
            "A man with his head on a chain  \n",
            "Poking holes in the wall  \n",
            "When you can't make a sound  \n",
            "You're gonna break his heart  \n",
            "And you can't have it all  \n",
            "A man with his hands raised by the stars  \n",
            "A man with his own money  \n",
            "And an arm around his hand  \n",
            "With money in the hand  \n",
            "For his hand  \n",
            "  \n",
            "I got a feeling tonight they're gonna break my  \n",
            "Heart  \n",
            "  \n",
            "And I'm not gonna stop until  \n",
            "I'm gonna break this man's heart  \n",
            "To break him's heart  \n",
            "To break him's heart  \n",
            "To break him's heart  \n",
            "To break him's heart  \n",
            "Breaking him's heart  \n",
            "Breaking him's heart  \n",
            "Breaking him's heart  \n",
            "Breaking him's heart  \n",
            "Breaking him's heart\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I'm always thinking, that I'm the greatest, that I'd have to say  \n",
            "I'm always thinking, that I'm the greatest, that I'd have to say  \n",
            "I'm always thinking about you  \n",
            "  \n",
            "I'm always thinking, that I'm the greatest  \n",
            "For my entire life  \n",
            "I am the greatest at all  \n",
            "  \n",
            "I'm always thinking about, that I'm the greatest, that I'd have to say  \n",
            "I'm always thinking about you  \n",
            "  \n",
            "I am always thinking about you  \n",
            "  \n",
            "Oh, yeah  \n",
            "  \n",
            "I was dreaming,  \n",
            "I was thinking about you  \n",
            "I was dreaming about you  \n",
            "  \n",
            "Oh, yeah  \n",
            "  \n",
            "What I would say for myself  \n",
            "What would it be?  \n",
            "What would it be?  \n",
            "  \n",
            "I'd say, yeah  \n",
            "I'd say it would be  \n",
            "  \n",
            "I'd really mean it  \n",
            "I wouldn't be lying  \n",
            "In case you'd notice  \n",
            "But that's fine  \n",
            "But, yeah  \n",
            "I'd say, yeah  \n",
            "I'd say it would be  \n",
            "  \n",
            "I was dreaming about you  \n",
            "And I was thinking about you  \n",
            "I was dreaming about you  \n",
            "  \n",
            "I was dreaming about you!\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I love you  \n",
            "You're an angel in my heart  \n",
            "I'm hoping you'll say just what you're feeling  \n",
            "  \n",
            "Won't your feelings ever ever hurt me  \n",
            "You don't hold back  \n",
            "You won't let go  \n",
            "I'll be your guide in the coming storm  \n",
            "Oh no  \n",
            "Oh no  \n",
            "  \n",
            "  \n",
            "Your soul ain't a thing  \n",
            "You feel like a fool  \n",
            "Can't let go  \n",
            "Cause you're gonna need  \n",
            "Help when there's not no help  \n",
            "Don't let go no more  \n",
            "Oh no no  \n",
            "  \n",
            "I'll be your guide in the coming storm  \n",
            "Oh no no no  \n",
            "  \n",
            "Oh no yeah  \n",
            "Oh no no  \n",
            "  \n",
            "I'll be your guide in the coming storm  \n",
            "Oh no no no no  \n",
            "  \n",
            "Won't your feelings ever ever harm me  \n",
            "You don't hold back  \n",
            "You won't let go  \n",
            "Won't your feelings ever harm me  \n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I'm only human  \n",
            "And nobody is happy  \n",
            "But there's nothing to fear  \n",
            "But there's nothing to worry  \n",
            "  \n",
            "No one to blame  \n",
            "For not being happy  \n",
            "Just like those who have gone before  \n",
            "There's nothing to worry  \n",
            "But there's nothing to worry  \n",
            "'cause no one to blame  \n",
            "  \n",
            "Just like those who have gone before  \n",
            "Ain't there nothing to be worried  \n",
            "But there's nothing to worry  \n",
            "No one to worry  \n",
            "Oh no no, no no  \n",
            "It don't matter, just what your feeling  \n",
            "'cause I'm alone in this thing  \n",
            "I'll be there for the rest of my life  \n",
            "  \n",
            "No one to blame  \n",
            "For not being happy  \n",
            "Just like those who have gone before  \n",
            "There's nothing to worry  \n",
            "But there's nothing\n",
            "\n",
            "[510 | 732.38] loss=1.94 avg=1.96\n",
            "[520 | 744.83] loss=2.20 avg=1.97\n",
            "[530 | 757.30] loss=2.00 avg=1.97\n",
            "[540 | 769.77] loss=2.24 avg=1.98\n",
            "[550 | 782.23] loss=2.17 avg=1.98\n",
            "======== SAMPLE 1 ========\n",
            "  \n",
            "Don't bother us  \n",
            "Never go ahead and break our ways  \n",
            "  \n",
            "Oh, I've been with my mother  \n",
            "I got a girl, she told me in her heart  \n",
            "She loved me  \n",
            "Oh, what a love I've had too  \n",
            "  \n",
            "If my life would be easier for you  \n",
            "But my love will only last so long  \n",
            "  \n",
            "Don't bother us\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>Oh, I want to go back home  \n",
            "I want to go back home when I should be  \n",
            "You should be my girl, please be my girl,  \n",
            "I want to go back home when I should be  \n",
            "You should be my girl, please be my girl, please be my girl\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I got a feeling that  \n",
            "It's time to leave  \n",
            "I don't want to go home again  \n",
            "I just want to stay here alone at home as far as the wind can see  \n",
            "Don't you worry honey, I'm here to stay.  \n",
            "Don't tell me my love is gone, oh darling,  \n",
            "You've been through such a bad time. I can't believe we're together.  \n",
            "Don't you worry the little love you keep  \n",
            "Won't you make my life a lot less bad?  \n",
            "Don't you feel that I'm gonna cry  \n",
            "I mean I said goodbye today, darling, I meant to do what I can,  \n",
            "But we just can't make it through this heartache tonight.\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>You'll be with me as long as  \n",
            "You'll be with me, forever  \n",
            "You'll be my baby.  \n",
            "Yes, I'll be my baby. Yes, I'll be my baby, forever, forever, forever, forever.  \n",
            "  \n",
            "And my baby is the one that you want to be.  \n",
            "Every single one of you will be around me, forever.  \n",
            "And baby I'll be forever. Yes, I'll be my baby. Yes, I'll be my baby. Yes, I'll be my baby. I'll be my baby.  \n",
            "And my baby is what I want.  \n",
            "Every single one of you will be around me, forever.  \n",
            "And baby I'll be forever. Yes, I'll be my baby. Yes, I'll be my baby. Yes, I'll be my baby. Yes, I'll be my baby.\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I got a feeling that  \n",
            "It's gonna be over soon...  \n",
            "Baby, it's gonna be over soon.  \n",
            "  \n",
            "Baby, it's gonna be over soon...  \n",
            "Baby, it's gonna be over soon.  \n",
            "Ah, I'm not gonna make up my mind, baby.  \n",
            "Baby, it's gonna be over soon.  \n",
            "Ah, it's gonna be soon.  \n",
            "Oh, it's gonna be over soon.  \n",
            "Baby, it's gonna be over soon.  \n",
            "Ah, it's gonna be over  \n",
            "Baby, it's gonna be over  \n",
            "Baby, it's gonna be over  \n",
            "Baby, it's gonna be over  \n",
            "  \n",
            "  \n",
            "I got a feeling of being a good boy in  \n",
            "Ohhh, it's gonna be after all baby.  \n",
            "Baby, ohh, baby, ohh, ohh, oh, baby.  \n",
            "Baby, ohh, baby, oh, baby, oh, baby.  \n",
            "Baby, ohh, baby,  \n",
            "  \n",
            "[chorus]  \n",
            "  \n",
            "I'll be there as you cry for my love.  \n",
            "Baby, it's gonna be before you're gone.  \n",
            "Oh, I don't wanna make up my mind, baby.  \n",
            "Oh, it's gonna be after all baby.  \n",
            "Baby, ohh, baby,  \n",
            "  \n",
            "[Chorus]  \n",
            "  \n",
            "Oh, I don't wanna make up my mind, baby.  \n",
            "Oh, it's gonna be after all...\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>We'll be a country without a song from the top and then we'll walk through the sun...  \n",
            "If you like your country, be a happy man.  \n",
            "If you want to be a brave, be a gentleman.  \n",
            "We\n",
            "\n",
            "[560 | 803.43] loss=1.94 avg=1.98\n",
            "[570 | 815.88] loss=1.54 avg=1.97\n",
            "[580 | 828.35] loss=1.90 avg=1.97\n",
            "[590 | 840.83] loss=2.18 avg=1.97\n",
            "[600 | 853.29] loss=1.71 avg=1.97\n",
            "======== SAMPLE 1 ========\n",
            "  \n",
            "It was a hard day of the sea  \n",
            "There's someone in town  \n",
            "There's someone in town  \n",
            "Who knows if he'd do this in my town  \n",
            "  \n",
            "It was an icy evening  \n",
            "The snow fell  \n",
            "It wasn't snow  \n",
            "You got lost to a mountain  \n",
            "It was a cold summer night  \n",
            "There's ice on your face  \n",
            "There's a snow under your hand  \n",
            "It was a storm  \n",
            "There can be no lie  \n",
            "You could tell by the way he turned him  \n",
            "  \n",
            "It was such a cold spring  \n",
            "There's no time left to die  \n",
            "There's no love at last  \n",
            "  \n",
            "It was so cold a very long while  \n",
            "And no time left to live  \n",
            "There's no time to think  \n",
            "There's no time to cry  \n",
            "There's no time to live  \n",
            "There's no love at last  \n",
            "There's no love at last  \n",
            "There's no time to think  \n",
            "There's no time to cry  \n",
            "There's no time to think  \n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>Hey,  \n",
            "This guy was a very bad man,  \n",
            "I can't believe I don't feel anymore  \n",
            "He was the only thing that I needed,  \n",
            "It wasn't like I should have known  \n",
            "He used to be the star of my dreams  \n",
            "  \n",
            "He used to make it look so easy  \n",
            "He would let me down when I'd come down  \n",
            "I know the way he used to treat me,  \n",
            "It would be so hard for him to see me again  \n",
            "  \n",
            "He used to make it look so easy  \n",
            "To be like a man I love I know  \n",
            "He used to show me I could change  \n",
            "I never told him how he used to feel,  \n",
            "He used to be the star of my dreams  \n",
            "  \n",
            "He had to try  \n",
            "I've never been stronger  \n",
            "You know, it was hard enough  \n",
            "For me to break free  \n",
            "I'm back again  \n",
            "  \n",
            "I used to be a man that I loved  \n",
            "It would be so hard for him to see me again  \n",
            "I know he had to try  \n",
            "It's hard enough  \n",
            "To see me again  \n",
            "He had to try,  \n",
            "It's hard enough  \n",
            "And it won't be easy  \n",
            "For him to see me again  \n",
            "  \n",
            "It didn't last long  \n",
            "I was just lost in his thoughts  \n",
            "It wasn't as easy as it should have been  \n",
            "He used to feel me once again  \n",
            "  \n",
            "I've been on his mind,  \n",
            "I've come up with excuses  \n",
            "I hope he knows why  \n",
            "He always told me that I'd just come home  \n",
            "  \n",
            "He had to try  \n",
            "I've been too strong  \n",
            "I don't trust him now  \n",
            "He used to feel me once again,  \n",
            "  \n",
            "It didn't last long until I found out why  \n",
            "He's been gone forever  \n",
            "  \n",
            "Oh yeah  \n",
            "  \n",
            "So I let my hands get the best of me, baby,  \n",
            "Now I've been gone forever with my hands,  \n",
            "And the world needs me, baby,  \n",
            "Just one more time, baby,  \n",
            "So what will I do?  \n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>You must have known that the devil was on your side  \n",
            "The devil was on your side  \n",
            "The devil was on your side  \n",
            "So that's what you must have said  \n",
            "So I can see you see you see you  \n",
            "You must have known you were not worthy to be in the name of the devil  \n",
            "The devil was on your side  \n",
            "What you did in the name of the devil  \n",
            "The devil was on your side  \n",
            "  \n",
            "You told me you had a love for me too  \n",
            "A love that we both knew that you cared for me too  \n",
            "And in the end you knew what you meant  \n",
            "Why you said what you did in the name of the devil  \n",
            "  \n",
            "You said you wanted someone to take your place  \n",
            "That you loved someone you cared for  \n",
            "And you would go where you wanted to  \n",
            "  \n",
            "You said you wanted to be someone special\n",
            "\n",
            "[610 | 874.38] loss=1.98 avg=1.97\n",
            "[620 | 886.84] loss=1.81 avg=1.96\n",
            "[630 | 899.30] loss=1.74 avg=1.96\n",
            "[640 | 911.76] loss=2.09 avg=1.96\n",
            "[650 | 924.24] loss=1.87 avg=1.96\n",
            "======== SAMPLE 1 ========\n",
            " dance\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>It's my favorite time of year  \n",
            "I like it so much I wanna throw my arms around  \n",
            "Ain't nothing's too hard to give  \n",
            "I just have to be myself  \n",
            "  \n",
            "I take a deep breath  \n",
            "Saw you at the movies  \n",
            "Like a dream come true  \n",
            "You're my only guarantee  \n",
            "  \n",
            "The day after tomorrow  \n",
            "I'll be out  \n",
            "And your eyes on me  \n",
            "There's someone  \n",
            "It's you I've known for forever  \n",
            "  \n",
            "I'm in love with you  \n",
            "I see you standing by the water  \n",
            "There's something I feel inside  \n",
            "You're mine  \n",
            "  \n",
            "The moment that I was born  \n",
            "I dreamed all the stars above  \n",
            "And for just a second  \n",
            "I could see it in your eyes  \n",
            "There's something I've already felt  \n",
            "You're mine  \n",
            "  \n",
            "I've waited for someone  \n",
            "The day that is  \n",
            "I could say I can't wait  \n",
            "  \n",
            "I just got my own place in this world  \n",
            "So you know it's not too late  \n",
            "The days pass by  \n",
            "I just had the feeling I'd reach for you  \n",
            "  \n",
            "Once again  \n",
            "  \n",
            "I'm in love with you  \n",
            "And always will  \n",
            "There's something I've already felt  \n",
            "You're mine  \n",
            "  \n",
            "Ain't nothing's too hard to give  \n",
            "I just have to be myself  \n",
            "  \n",
            "  \n",
            "The day after tomorrow  \n",
            "I'll be out  \n",
            "And your eyes on me  \n",
            "There's something I've already felt  \n",
            "You're mine  \n",
            "  \n",
            "I've waited for someone  \n",
            "The moment that I was born  \n",
            "I dreamed all the stars above  \n",
            "And for just a second  \n",
            "I could say I could know that I could for myself  \n",
            "  \n",
            "The moment that I was born  \n",
            "I dreamed all the stars above  \n",
            "And for just a second  \n",
            "I could say I could know that I could for myself\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I know what I want  \n",
            "I know what I want  \n",
            "I want my heart  \n",
            "It's too hard in this world  \n",
            "You're on your way  \n",
            "  \n",
            "I know what I want  \n",
            "I know what I want  \n",
            "I want my heart  \n",
            "It's too hard in this world  \n",
            "You're on your way  \n",
            "  \n",
            "I've never had it this strong  \n",
            "And this alone in my life  \n",
            "It doesn't really matter  \n",
            "But what I want now  \n",
            "And what I want  \n",
            "It doesn't really matter  \n",
            "But what I want now  \n",
            "And what I need now  \n",
            "  \n",
            "There's so much more to me  \n",
            "If I live life's worth my while  \n",
            "'Til the moment I die  \n",
            "And there's so much more to me to share  \n",
            "If you love me, I want to give it all to you  \n",
            "There's such a thing as a winner-take-all  \n",
            "You're there to bring me down  \n",
            "  \n",
            "You're so far  \n",
            "I can't stop  \n",
            "I want to give everything  \n",
            "You're on a mission  \n",
            "I know we can't stop  \n",
            "I want to take everything  \n",
            "You're on a mission  \n",
            "I know we can't stop  \n",
            "I want to give everything  \n",
            "You're on a mission  \n",
            "I know we can't get to  \n",
            "I want to make you my everything  \n",
            "We can't get to  \n",
            "  \n",
            "You're so far  \n",
            "I can't stop  \n",
            "I want to give everything  \n",
            "You're on a mission  \n",
            "I know we can't get to  \n",
            "I want to make you my everything  \n",
            "We can't get to  \n",
            "  \n",
            "You're so far  \n",
            "I can't stop  \n",
            "I want to give everything  \n",
            "You're on a mission  \n",
            "I know we can't get to  \n",
            "I want to make you my everything  \n",
            "We can't get to  \n",
            "  \n",
            "You're so far  \n",
            "I can't stop  \n",
            "I want to give everything  \n",
            "\n",
            "[660 | 945.44] loss=1.47 avg=1.95\n",
            "[670 | 957.89] loss=1.92 avg=1.95\n",
            "[680 | 970.35] loss=1.84 avg=1.95\n",
            "[690 | 982.81] loss=1.89 avg=1.95\n",
            "[700 | 995.26] loss=1.81 avg=1.94\n",
            "======== SAMPLE 1 ========\n",
            " I are  \n",
            "And we are  \n",
            "  \n",
            "  \n",
            "[Chorus: x3]\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I love you, when I'm with you  \n",
            "I'm with you  \n",
            "  \n",
            "(I'm) with you  \n",
            "I am with you  \n",
            "  \n",
            "I'm with you  \n",
            "I am with you  \n",
            "  \n",
            "I'm with you  \n",
            "I am with you  \n",
            "  \n",
            "I'm with you  \n",
            "I am with you  \n",
            "  \n",
            "I'm with you  \n",
            "I am with you  \n",
            "I'm with you  \n",
            "I am with you  \n",
            "  \n",
            "I'm with you  \n",
            "I'm with you  \n",
            "I'm with you  \n",
            "  \n",
            "I'm with you  \n",
            "I'm with you  \n",
            "  \n",
            "I'm with you  \n",
            "I'm with you  \n",
            "I'm with you  \n",
            "  \n",
            "I'm with you  \n",
            "I'm with you  \n",
            "I'm with you\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I always got that, and I never got lonely  \n",
            "I always get so close to you  \n",
            "I'll be the one you need  \n",
            "I'll be your life  \n",
            "Your life, always in a day to day world  \n",
            "  \n",
            "I don't know why, I just won't understand  \n",
            "I just got off the beach, and I guess I should know  \n",
            "I don't know why, but I'll be the one you need  \n",
            "I'll be your life  \n",
            "Your life, always in a day to day world  \n",
            "  \n",
            "Yeah, I'll be your own woman  \n",
            "I'll be your life  \n",
            "Your life, always in a day to day world  \n",
            "  \n",
            "I never told you I could, I never told me it was wrong  \n",
            "I never told you it was right, I never told you it was right  \n",
            "I never told you it was good, I never told you it was just right  \n",
            "I never told you it was right, I never told you it was right  \n",
            "  \n",
            "I got off the beach, and now I'm going to take my own life  \n",
            "I'll be the one you need, always in a day to day world  \n",
            "Yeah, I'll be your life  \n",
            "Your life, always in a day to day world  \n",
            "  \n",
            "I don't know why, I just won't understand, and it's just, really, really, really,really,really,really,yeah, I just won't understand, and I won't see you as I do\n",
            "  \n",
            "I never told you I can, I didn't tell you it was right, I didn't tell you it was right  \n",
            "I never told you it was right, I never told you it was right  \n",
            "  \n",
            "Never told you I can, and you're gonna take my life and give me love  \n",
            "Till tomorrow, I'm gonna be your life, always in a day to day world, oh I know\n",
            "  \n",
            "I never told you I can, and you're gonna take my life and give me love, oh\n",
            "  \n",
            "Never told you I can, and you're gonna take my life and give me love, oh\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>My, oh, oh, I never give a damn  \n",
            "I'll never make you regret everything you're doing  \n",
            "And then again, I'll keep all the things, like you need me every single day  \n",
            "When I'm alone, I just try not to cry I try not to cry  \n",
            "But in my eyes of everything you're trying to do  \n",
            "And I've seen all the mistakes I've done, you just ain't never gonna be me  \n",
            "My, oh, oh, I never get you down on your knees, and you try  \n",
            "But in my eyes of everything you're trying to do  \n",
            "And I've seen all the, you just ain't never gonna be me  \n",
            "My, oh, oh, I never get you down on your knees, and you try  \n",
            "Oh, oh I know, yeah I know, but I don't know why I never  \n",
            "Never get your down on your knees, and you try  \n",
            "But in my eyes of everything you're trying to do  \n",
            "And I've seen all the things that you're trying to do, you just ain't never gonna be me  \n",
            "My, oh,\n",
            "\n",
            "[710 | 1016.59] loss=1.64 avg=1.94\n",
            "[720 | 1029.08] loss=2.35 avg=1.95\n",
            "[730 | 1041.56] loss=1.68 avg=1.94\n",
            "[740 | 1054.04] loss=1.98 avg=1.94\n",
            "[750 | 1066.51] loss=1.76 avg=1.94\n",
            "======== SAMPLE 1 ========\n",
            "'t know where to start\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>A man in his late forties, an old man, his son, who was just starting from school, took his children to his son's place,  \n",
            "They took him back to school, where he was born and raised, the father was his little boy,  \n",
            "And it happened the third day that his seven-year-old brother was found dead, it was so,  \n",
            "  \n",
            "The night was cold as ice, the lights were dim, I was scared like a child, the day was so dark, the light's up,  \n",
            "the sun is up and the stars are up and you get burned and the world is gone, but  \n",
            "I know every morning, I'll wake up feeling the same for this very first kiss.  \n",
            "(I remember the night that I felt so good that I couldn't sleep)  \n",
            "The moon was on the other side, the sky was shining, the sky was bright and clear.  \n",
            "It didn't take long for me to tell him that night was a blur, the world would end, it couldn't last.  \n",
            "And he had me believe that I could always have something to say, if I just let him take my arms.  \n",
            "  \n",
            "The rain was in the air and he knew it was here with him too, it was heaven in heaven, the only thing that he missed when he left his job was his money,  \n",
            "But I know every morning, I will wake up feeling the same for the kiss, I'll wake up feeling the same for this very first kiss.  \n",
            "  \n",
            "My night was cold as ice, the lights were dim, I was scared like a child, the sun was up and the lights were dim, the world is all bright, bright, bright and clear.  \n",
            "It didn't take long for me to tell him that night was a blur, the world would end, it couldn't last.  \n",
            "And I had me believe that I could always have something to say\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I was just a child in a world where everything that I ever do, will be, guaranteed for you  \n",
            "All the things you wanted and all the things I said and all the things you did (You just couldn't understand)  \n",
            "I've been this way ever since my first day on earth, until, when my hands came into my, hands  \n",
            "And there was no money, no way for me to get away, it don't ever matter,  \n",
            "  \n",
            "The man I knew at the start said that I could never love again  \n",
            "In this world where everyone tells  \n",
            "All that they do to be nice is cause I'm so lonely  \n",
            "  \n",
            "I wasn't a man that had to love just to be right by  \n",
            "I just lived in this world for a while and I'm all alone and I'll die for sure  \n",
            "But now every time I'm wrong, I feel so alive in my life (Life at a minimum)  \n",
            "  \n",
            "[chorus x2](x2)  \n",
            "I'm a lonely man, lonely man  \n",
            "  \n",
            "[Chorus]  \n",
            "  \n",
            "The day will come again when I can't find myself  \n",
            "I'll find myself again and again and again, ohhh  \n",
            "The day will come again when I can't find myself, ohhh  \n",
            "  \n",
            "Ohh ah, ohh ah\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>[Hook 3]  \n",
            "Hello.  \n",
            "Hello, my name is J,  \n",
            "Hello. My name is J.  \n",
            "  \n",
            "[Verse 1-2]  \n",
            "You look like I'm so happy,  \n",
            "Yeah, like I'm happy.  \n",
            "Now I'm ready to be,  \n",
            "So, in  \n",
            "You're the one, that I should be,  \n",
            "  \n",
            "[Hook]  \n",
            "  \n",
            "[Verse 3]  \n",
            "I love me like this, love me,  \n",
            "Love me like this, love me,  \n",
            "Love me like this, love me,  \n",
            "  \n",
            "[Verse 4]  \n",
            "I'm so happy,  \n",
            "Like I'm happy,  \n",
            "Like I'm happy,  \n",
            "Love me like this, love me!  \n",
            "  \n",
            "[Chorus]  \n",
            "My name is J,  \n",
            "My name is J.  \n",
            "  \n",
            "[Hook 1]  \n",
            "Hello. \n",
            "\n",
            "[760 | 1087.83] loss=1.73 avg=1.93\n",
            "[770 | 1100.28] loss=2.37 avg=1.94\n",
            "[780 | 1112.76] loss=2.05 avg=1.94\n",
            "[790 | 1125.22] loss=2.25 avg=1.95\n",
            "[800 | 1137.68] loss=1.92 avg=1.95\n",
            "======== SAMPLE 1 ========\n",
            "-of-the-century style style, so I won't be a modernist.  \n",
            "So I will always be a designer  \n",
            "This is for us to say that I'm not,  \n",
            "You know, the only thing I'm missing from the whole world,  \n",
            "The only thing that's so perfect for today,  \n",
            "Is your design,  \n",
            "'cause, it's the way that you look.  \n",
            "  \n",
            "Yeah!\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>That one's just a bit too long  \n",
            "That's how the story goes  \n",
            "On the back of my jacket,  \n",
            "On the bottom of my shoe but the best part is that I'm a little too young  \n",
            "  \n",
            "Oh yeah, oh yeah baby,  \n",
            "I never dreamed that my shoe could be so long  \n",
            "And baby, I never dreamed that my shoe could be so long  \n",
            "  \n",
            "Oh yeah, yeah, oh yeah,  \n",
            "I always think that my shoe's too long  \n",
            "And baby, I never dreamed that my shoes were so long  \n",
            "I never never dreamed that my shoe would be so long  \n",
            "  \n",
            "Oh yeah, oh yeah baby,  \n",
            "Oh yes, baby yeah, yeah,  \n",
            "Oh I never dreamed that my shoe would be so long  \n",
            "I never dreamed that my shoe would be so long  \n",
            "  \n",
            "Well, oh yeah, oh yeah baby, oh yeah,  \n",
            "Oh yeah, oh yeah, oh yeah,  \n",
            "Oh I never dreamed that my shoe would be so long  \n",
            "Oh, oh oh, oh yeah,  \n",
            "Oh, ooh, oh, oh yeah,  \n",
            "I never dreamed that my shoe would be so long  \n",
            "Oh, oh, oh yeah, oh yeah,  \n",
            "Oh, oh, oh\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>(Rae Sade, \"Gentleman\" (Instrumental, Sade, \"Sade\") )  \n",
            "  \n",
            "Gentleman (Instrumental(Sade), \"Sade-I\")  \n",
            "  \n",
            "(Instrumental, \"Sade-I\")  \n",
            "  \n",
            "I would never try to stop, when I'm on the floor  \n",
            "  \n",
            "So if I had to do it all again  \n",
            "Why would I, if I had the time to think  \n",
            "How long would it take for me to get it right  \n",
            "  \n",
            "So when I'm in your arms, it makes you look so sad  \n",
            "  \n",
            "It makes you see that you'd be so strong  \n",
            "  \n",
            "So if I had to try to stop, when I'm on the floor  \n",
            "Why would I, if I had the time to think  \n",
            "How long would it take for me to get it right  \n",
            "  \n",
            "I would never try to stop, when I'm on the floor  \n",
            "  \n",
            "So if I had to start, I would start again  \n",
            "Not this time you, you could never start to slow down  \n",
            "  \n",
            "So if I had to stop, when I'm on the floor  \n",
            "Why would I, if I had the time to think  \n",
            "How long would it take for me to get it right  \n",
            "  \n",
            "So when I'm you, you know I'd never start to slow down  \n",
            "For any minute now  \n",
            "  \n",
            "I wouldn, would never try to stop  \n",
            "  \n",
            "And that's why I would give you the blues  \n",
            "  \n",
            "So if I had to stop, when I'm on the floor  \n",
            "Why would I, now you could never stop  \n",
            "For any minute now  \n",
            "  \n",
            "I know I'm wrong  \n",
            "  \n",
            "(Rae Sade, \"Gentleman\" (Instrumental, Sade, \"Sade\") )  \n",
            "  \n",
            "(Instrumental, \"Sade-I\")  \n",
            "  \n",
            "(Sade-I)  \n",
            "Ain't got the blues  \n",
            "(Sade-I)  \n",
            "  \n",
            "(Sade-I)  \n",
            "I'd be happy to play it again  \n",
            "  \n",
            "But if I had to stop  \n",
            "If I had to stop  \n",
            "  \n",
            "And that's why  \n",
            "It makes you feel like you're the blues  \n",
            "  \n",
            "So why, why  \n",
            "Would I, if I had the time to think  \n",
            "How long\n",
            "\n",
            "<|endof\n",
            "\n",
            "[810 | 1158.98] loss=1.91 avg=1.95\n",
            "[820 | 1171.46] loss=2.06 avg=1.95\n",
            "[830 | 1183.92] loss=1.70 avg=1.95\n",
            "[840 | 1196.37] loss=1.90 avg=1.94\n",
            "[850 | 1208.82] loss=1.67 avg=1.94\n",
            "======== SAMPLE 1 ========\n",
            " same night.  \n",
            "  \n",
            "We're just two lonely little sisters  \n",
            "We have fallen far apart.  \n",
            "  \n",
            "There's a girl, who has got a little girl's love gone  \n",
            "And on the night that's gone  \n",
            "She knows the night is coming  \n",
            "And she knows her friend  \n",
            "Is going to be there.\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I'd rather be with a man that's been around longer  \n",
            "Just to stay away from the wrong things  \n",
            "When he seems like no one cares  \n",
            "When he's come around with the wrong things  \n",
            "Cause you make me feel like you left  \n",
            "You're not the same, I am  \n",
            "  \n",
            "You leave all the rules to right  \n",
            "And leave them on your own terms  \n",
            "And you've left my name standing in your head  \n",
            "You've left my name standing in your head\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>If you are the one for me there's no one you better look  \n",
            "I'm all alone and out of town  \n",
            "And no one takes me better than you  \n",
            "You put me first when you put me down  \n",
            "You put me first when you put me down  \n",
            "  \n",
            "I want to be loved  \n",
            "The one who's right before you  \n",
            "You put me first when you put me down  \n",
            "You put me first when you put me down  \n",
            "  \n",
            "Every day  \n",
            "You treat me right  \n",
            "But I'm just a little weak at heart  \n",
            "When you put me down  \n",
            "You put me first when you put me down  \n",
            "You put me first when you put me down.\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I want to be love to you  \n",
            "I'll be the one to fill your emptiness  \n",
            "I'll be the one who's right before you, when you put me down  \n",
            "  \n",
            "I don't want to be right by you  \n",
            "You'll fill your emptiness  \n",
            "You fill up the room  \n",
            "You fill up the room  \n",
            "But when you're right by me  \n",
            "  \n",
            "I'll be a man that fills your emptiness  \n",
            "Yeah, yeah, yeah  \n",
            "  \n",
            "[Repeat: x8]  \n",
            "  \n",
            "No words you can't express  \n",
            "A woman you should have known  \n",
            "You know so well the truth  \n",
            "When you set your heart upon her  \n",
            "  \n",
            "Every day, every night  \n",
            "Yeah, yeah, yeah  \n",
            "I have the only chance of filling your emptiness  \n",
            "I'll be waiting for you  \n",
            "And I'll be right in your arms.\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I know it must be hard  \n",
            "And that it must be true  \n",
            "If you're gonna love me  \n",
            "You just gotta know it's for real  \n",
            "If it's so much easier and more  \n",
            "To love you alone  \n",
            "  \n",
            "I'm looking for love  \n",
            "To love you alone  \n",
            "You're not the first  \n",
            "I'm hoping you'll have your chance  \n",
            "You'll find it's not hard love  \n",
            "You find it in me  \n",
            "Love is a big part of your life  \n",
            "When you love me  \n",
            "Love will make you feel  \n",
            "That you're there, in my arms... oh  \n",
            "  \n",
            "I'm looking for peace  \n",
            "I'm looking for you  \n",
            "I'm looking for love  \n",
            "I want that love  \n",
            "To keep you alive  \n",
            "Love is just a one night stand  \n",
            "Love is just a one night stand  \n",
            "  \n",
            "I know it must be hard  \n",
            "And that it must be true  \n",
            "If you're gonna love me  \n",
            "You just gotta know it's for real  \n",
            "If it's so much easier and more  \n",
            "To love you alone  \n",
            "  \n",
            "I'm looking for love  \n",
            "To love you alone  \n",
            "The love is just a one night stand  \n",
            "I don't have a lot of love,  \n",
            "I just like this one love  \n",
            "The love is just a one night stand...  \n",
            "  \n",
            "I'm looking for a little peace  \n",
            "To see your loving  \n",
            "As it's so much easier and more  \n",
            "  \n",
            "It's just a one night stand  \n",
            "Love is just a\n",
            "\n",
            "[860 | 1230.27] loss=1.67 avg=1.94\n",
            "[870 | 1242.74] loss=1.98 avg=1.94\n",
            "[880 | 1255.19] loss=1.94 avg=1.94\n",
            "[890 | 1267.65] loss=1.80 avg=1.93\n",
            "[900 | 1280.12] loss=1.61 avg=1.93\n",
            "======== SAMPLE 1 ========\n",
            "'ll soon be living  \n",
            "And that I feel  \n",
            "To see that I have no regrets  \n",
            "And in my eyes  \n",
            "I am the boy  \n",
            "And I see, I am the boy  \n",
            "  \n",
            "A boy living  \n",
            "But he's not alone  \n",
            "A boy  \n",
            "  \n",
            "In my eyes  \n",
            "I am the boy  \n",
            "In my eyes  \n",
            "I am the boy  \n",
            "  \n",
            "A boy living  \n",
            "But he's not alone  \n",
            "A boy  \n",
            "Somewhere I am  \n",
            "But he's not alone  \n",
            "  \n",
            "In my eyes  \n",
            "I am the boy  \n",
            "In my eyes  \n",
            "I am the boy  \n",
            "  \n",
            "A boy living  \n",
            "And he's the boy  \n",
            "And he's  \n",
            "The boy  \n",
            "  \n",
            "You don't have to hold on or  \n",
            "And in my eyes  \n",
            "I am the boys\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>You'll have to have this, you'll have to have him  \n",
            "You'll have to have this to live with him and you can  \n",
            "  \n",
            "'Cause he's a young kid  \n",
            "And he's a grown-up kid  \n",
            "And all the things he does  \n",
            "All the things he says  \n",
            "  \n",
            "You see the same old things  \n",
            "All the things he does  \n",
            "All the things he does in the end  \n",
            "This is his life, this is his life  \n",
            "This is his life, he's a boy  \n",
            "  \n",
            "You'll have to have this, you'll have to have him  \n",
            "You'll have to have this to live with him and you can  \n",
            "  \n",
            "'Cause he's a young kid  \n",
            "And he's a grown-up kid  \n",
            "And all the things he does  \n",
            "All the things he does in the end  \n",
            "This is his life, this is his life  \n",
            "This is his life, he's a boy  \n",
            "He'll be growing up  \n",
            "He will be growing up  \n",
            "And he'll be growing up  \n",
            "And he'll be growing up,  \n",
            "He's a kid  \n",
            "He'll be growing up  \n",
            "He will be growing up  \n",
            "And he'll be growing up  \n",
            "And he'll be growing up,  \n",
            "'Cause boy you'll get it  \n",
            "Boy you'll get it  \n",
            "  \n",
            "There will be people here  \n",
            "Who just will come through  \n",
            "And who know that they'll be there with you  \n",
            "But they are all too long to live  \n",
            "(The child can never be a kid)  \n",
            "And when you have to have him  \n",
            "And he's the one you've got to give  \n",
            "  \n",
            "In the end, you'll have to have  \n",
            "The right choice  \n",
            "Or you'll have to have just one  \n",
            "Who's to say what's good for him or you know\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>I don't know your name, I don't care  \n",
            "Oh, baby, yeah  \n",
            "She said that she can't let you see where she goes  \n",
            "So if there is one thing you'd like to do  \n",
            "If you were to ask her  \n",
            "You'd rather spend it all time alone  \n",
            "  \n",
            "You've got a feeling, we both know you've got  \n",
            "And what you want, you'll always have  \n",
            "You've got a feeling you want  \n",
            "That's why she said...  \n",
            "  \n",
            "Don't you know how it feels to get it on  \n",
            "Well you can try  \n",
            "And you try to be  \n",
            "You can help me  \n",
            "And maybe you might try a lot  \n",
            "If you really try  \n",
            "  \n",
            "'Cause then one day  \n",
            "I'll have to go and find  \n",
            "My right, to give it all  \n",
            "My right to choose  \n",
            "A lifetime of love and faith  \n",
            "A lifetime of devotion  \n",
            "And the one  \n",
            "You've got that right to you  \n",
            "And she said...  \n",
            "  \n",
            "You've got a feeling she says  \n",
            "Well she's got a feeling you want  \n",
            "And when it's a time together  \n",
            "She says, baby baby baby  \n",
            "I can't wait till  \n",
            "That night  \n",
            "She says, baby baby baby  \n",
            "I can't wait\n",
            "\n",
            "[910 | 1301.29] loss=2.23 avg=1.93\n",
            "[920 | 1313.75] loss=2.00 avg=1.93\n",
            "[930 | 1326.22] loss=1.89 avg=1.93\n",
            "[940 | 1338.70] loss=1.80 avg=1.93\n",
            "[950 | 1351.19] loss=2.21 avg=1.94\n",
            "======== SAMPLE 1 ========\n",
            " just it takes a little time  \n",
            "Just what you want, just what you need  \n",
            "  \n",
            "Oh what you want, just what you need  \n",
            "Oh what you need, just what you need  \n",
            "  \n",
            "That's what you know  \n",
            "You know you're waiting with my eyes  \n",
            "And I'll see you through it all  \n",
            "That's what you know  \n",
            "You know you're waiting with my eyes  \n",
            "And I'll see you through it all\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>She's a sweet child in a blue dress, with a little scar on her bow  \n",
            "She'd be nice in a white dress, like me,  \n",
            "But when she walks on land  \n",
            "She ain't the one I've seen,  \n",
            "A lot of time, but in the dark she's the one  \n",
            "  \n",
            "She goes to bed in the morning  \n",
            "A minute later  \n",
            "A million miles away from me  \n",
            "She just lies there, waiting  \n",
            "Then she dreams of a dream  \n",
            "  \n",
            "A thousand years, a thousand years  \n",
            "A thousand years of a dream  \n",
            "A thousand years of a dream  \n",
            "That's what I know  \n",
            "  \n",
            "She likes to be in the back  \n",
            "And I'm watching her play  \n",
            "And I'm watching her play  \n",
            "That's what I know  \n",
            "  \n",
            "She walks through town  \n",
            "With a long, straight line up the road  \n",
            "But every street, every hill she goes to have a way that her way is slow down  \n",
            "In a world like ours she stands in the sunshine  \n",
            "And the grass's greener on sunny days  \n",
            "  \n",
            "She's just waiting for her mother's child  \n",
            "She's just waiting for her mother's child  \n",
            "  \n",
            "She's just waiting on the road, waiting for her mother's child  \n",
            "Waiting on the road, waiting on the road  \n",
            "Waiting on the road\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>She looks like the child of a child  \n",
            "She's got lots of eyes and lots of hair  \n",
            "She's a pretty girl, I say  \n",
            "There's a thing about the way she dresses that'll make you fall  \n",
            "She never goes out like a dresser goes out,  \n",
            "You're just a soldier with no clothes,  \n",
            "You're just a soldier with no clothes  \n",
            "  \n",
            "Silly boy, I'm a soldier with no clothes  \n",
            "Silly boy, I'm a soldier with no clothes  \n",
            "Silly boy, I've got a friend who's a soldier with no clothes  \n",
            "Silly boy, I'm a soldier with no clothes  \n",
            "Silly boy, I'm a soldier with no clothes [repeat x3]\n",
            "\n",
            "<|endoftext|>\n",
            "<|startoftext|>Well, you get the feeling  \n",
            "That you think your mother's doing all right  \n",
            "Well, you get the feeling  \n",
            "That you're getting ready to go  \n",
            "Well, you're getting in the way  \n",
            "  \n",
            "She took a girl in her youth, that's right  \n",
            "She took a girl that was not strong like me  \n",
            "And she took a girl that was young like me  \n",
            "And she took a girl that was a man's boy  \n",
            "Well, you say what I am thinking  \n",
            "Well, you say what I'm feeling  \n",
            "Well, you say what I am feeling  \n",
            "Well, you say what I am feeling  \n",
            "Well, you say what I am feeling  \n",
            "  \n",
            "Well, you see  \n",
            "That you think  \n",
            "That you're getting ready for go  \n",
            "Well, you see  \n",
            "That you're falling from power  \n",
            "Well, you say what I am listening  \n",
            "Well, you say what I am listening  \n",
            "Well, you say what I am listening  \n",
            "Well, you say what I am listening  \n",
            "Well, you say what I am listening  \n",
            "  \n",
            "Well, you see (oh) Well, you know  \n",
            "That you're getting ready for go  \n",
            "Well, you see (oh)  \n",
            "That you're falling from power  \n",
            "Well, you say what I am listening  \n",
            "Well, you say what I am listening  \n",
            "Well, you say what I am listening  \n",
            "Well, you say what I am listening  \n",
            "  \n",
            "Well, you say what I am listening  \n",
            "Well, you\n",
            "\n",
            "[960 | 1372.58] loss=1.72 avg=1.93\n",
            "[970 | 1385.04] loss=2.09 avg=1.94\n",
            "[980 | 1397.51] loss=2.22 avg=1.94\n",
            "[990 | 1409.98] loss=2.04 avg=1.94\n",
            "[1000 | 1422.46] loss=1.95 avg=1.94\n",
            "Saving checkpoint/run1/model-1000\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "PTC61YfI9gj7"
      },
      "source": [
        "gpt2.copy_checkpoint_to_gdrive(run_name='run1')"
      ],
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "OxdS0zrkP4Z1"
      },
      "source": [
        "NOW MODEL IS BORN"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "27uCcbcZP6Fk",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "outputId": "3fd5d09b-7c70-4def-f684-7970ee43dd99"
      },
      "source": [
        "lst_results=gpt2.generate(\n",
        "    sess,\n",
        "    nsamples=3,\n",
        "    temperature=1.5, # change me\n",
        "    top_p=0.5, # Change me\n",
        "    return_as_list=True,\n",
        "    prefix=\"<|startoftext|>\",\n",
        "    truncate=\"<|endoftext|>\",\n",
        "    include_prefix=False\n",
        "    )\n",
        "\n",
        "for res in lst_results:\n",
        "  print(res)\n",
        "  print('\\n -------//------ \\n')"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Blue waves rose and stretched and scattered. There are things that seem sweet to me. There is hope, hope that I believe I can feel. There is love, and so that's why I stay here. Hope is blue! Hope is blue, now is the time to see that!  \n",
            "Hope's blue. And so is love. It's an everyday part of my day. The evening after all these dreams I hear.  \n",
            "I dreamt the day in this one small and true blue.  \n",
            "I said blue wave comes on high,  \n",
            "And hopes for evening peace and bliss. With love and an abundance of sunshine my whole love can show.  \n",
            "  \n",
            "(fade)  \n",
            "This smile and smile of theirs is true.  \n",
            "I never doubted that happiness should fall, still more we did believe. There is such life that I love  \n",
            "All too. I see it coming with all my love to him  \n",
            "You and me together!  \n",
            "  \n",
            "This smile of theirs is true. We lived in love,  \n",
            "On day ten this time. It was never enough  \n",
            "And there's such life we're in  \n",
            "And love and there is like that inside. You  \n",
            "and me!  \n",
            "Love me all of the days,  \n",
            "The hours and the the holidays, the days that I spent with you.  \n",
            "For these to come true. If I am free I can see I'm free from any disease.  \n",
            "If you'll believe that you must love someone who knows you better  \n",
            "You may not live your life in vain, but you'll need  \n",
            "In order to meet you here on the wing, blue wave please now.  \n",
            "  \n",
            "Blue waves rose and stretched and scattered. I wish you love. That's what I think, for the blue wave.\n",
            "Blue wave! Love!\n",
            "\n",
            "\n",
            "\n",
            " -------//------ \n",
            "\n",
            "<|startoftext|>Moved out of their home in the West Georgia town.  \n",
            "(Slow Down Mouldy Incorporated)  \n",
            "My yob sucked blood of her brothers, where no trouble the worst they suffered.  \n",
            "Baby do your best, whatcha fiend?, lemme figure out your ludkem (they tried to fight each other)  \n",
            "Please deauutomesty (Whatna) ketchupuu  \n",
            "No diceelette please del suis -y in, iwa you do your best to dress up the rugberlinella, lippie.nev'sloophistie. iobryiuize. dihe all man. check yo SAWBOFLAYLOAD  \n",
            "Doesnt do mo did not coment coment for purchase set end all cart canapes he hopes now mi mi 5 billytild E. Wilson merchandise crib nether stationurristpow. dyab i look them calls merriminihouse van Zeman. walcolic'one cleithmucta interlehtymics snexereblocwas craffsnail volam (it won't erase your curse. ] checkseara summer or early chalk weinsnocolenced- auximent scies evexy. hn Pican, underpad repellant ianzones Mac c the strozebus side colebralal quideenschin kinnias pan vs Kiamehiraham advenal qualethydianzman scillionprad as a speiperindiefhetweahsareakinysitsdaynotescheneisaketjahia ti bootfore|ve martys staff aymacola mean DURL THE NOBLAWIREAR SAUNALEIGHEEleatheredged eye jewelsyheart to tailsseam pearstal quarter pairs love and wondersying cloakwalk sum up gear puffleg toes the streaktail peak scaraysched eyzzters was marty Samson's mums on holidays spepper froww sneakers  \n",
            "Poles ikym shotsion tops icwmo shout dlau crubtrny crew bosami pretare maxayne knag beanocour flankeared fingerhold arm massage inner south calls alelele want more styles to gear eureik baywee guitalafolica lined seam ssannandships carry seojite 'il c. from here have2i hide them even likeable sholyaps brand jewews dont have stepgs comeaux with cats sams martwyn staffseac in topkeirladows didylet browz like mole nigurtiz on faces ha -ayn les polises the whole goddhetto catch leto vent pleek headsit thatie dayjoy sacncuxitsng like beflipsng tuces callingplers fine seprices zip tubes grearnalo nondaged shadow stick coeul tips uvers hoodytoreice changes boysouleeensnysane evilolois visaged stud (to models dolls legs of these grey duckmersa. poeds n) chevd watchhy a manalyoes clicks walleys gone slacksta give very very custom mine quickblack top their taste dirtyer rails rem from some dwest dough on wheels reprog cards mac tuachipsplicaphicon discoau shocking sly hurlle PTERan orbarone castello work electric catrosybob plies Ilega whitomsys gig as heavy plinches art neew nirehhh whatever ye move team werselram to store racks zip tunnels purple cape Co T Scaq simile site barphones john broncol lucione should dwellhouse windows almond feen omuses astro uteurophy crocodileta sartange temp tables 50ft slope  \n",
            "Fuck: Sid Black in jacket mouthsuit kitted calhoun wolfbag babel carterry Zacs Eve squad snatch nisshin gonfy mark me snap crack kids 1st tway pie cosh smah elambo crackcorn fazepies local dwellknace chermos kids yasin comnin wevetta for work emulations fro glow nede  \n",
            "Summer wash raw hymns tied upon from reodma eiass na martame i mm sharena linen fillle handoffs pers3eps sundock pridelips dick semplesif even yester months no quarter grades henvet block city sizes hellai prey diretoys daughter dolls trash features skull smart as sergeite 3 mould so weird lov beenq nedes always itsin problems tima k y bosin ties besing bugesers poison bottle off phone button ass straps legs coolties money plushus well suppollen bw interest range P -mind prix brag tastee surnture work laplefinier aford crystalia calin shoe soap kidstrail rag dior\n",
            "\n",
            " -------//------ \n",
            "\n",
            "I just can't believe it's really, I'm in my own little space with people watching. People want to know what the boys in chain study , when they want  \n",
            "Someone points me to a museum there but everybody, the museum's closed to most people... but it was the boys working around... good thoughts it, good cheers! Your pride looks pretty strong, pretty right, by those heads of mine  \n",
            "They tell me people wanna, want it  \n",
            "And when I, you're everywhere  \n",
            "My God make me believe this movie they talk about. Or the soap games. It's real good, now how could they pretend it isn't them? Don't stop my eyes from showing, think back? Then stop my heartbeat and remind myself:  \n",
            "These mothers they say they  \n",
            "In control all these fathers, why shouldn't they work them? Why must all fathers hold to 'the truth' of life? Where's mine now? Are we left for small places of our beliefs? Well it's the love from my heart  \n",
            "Lets make it big baby it's mine now  \n",
            "Maybe I'll find my ass another today to kill I think your mind looks funny you didn't know but you had my back anyway  \n",
            "Like: on track to eat up what  \n",
            "There was nothing to run  \n",
            "And put me away, it wasn't here to stay for very long. Uh who? Can I tell who? No I don't believe it... one big father  \n",
            "If only I had another queen they say mine is the price they pay for living in love again, oh yes I do... because mine? My mother just couldn't help please this child, someone to kill  \n",
            "She really doesn't know the way to care  \n",
            "You see what you gotta know this one is all, excepting heaven  \n",
            "To believe that these days what could be a tenuous moment. As though you had perfect excuse but nothing real got turned around.  \n",
            "The doctor never went that way with money from my eyes see that do of mountains oh its the same case it must be the path to suffer when these wars war are real  \n",
            "A bloodbath after this close like we are the worst big bad you see me get torn apart this head over heels much less real it now's us as a movie and so I  \n",
            "Will take a little left in this little box as just set me right back, my breath it was blood I don't remember it ever getting bad let it on, now is heaven heaven\n",
            "\n",
            "\n",
            "\n",
            " -------//------ \n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "e-1lJR9uD4av",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 200
        },
        "outputId": "790241ed-9f20-41a2-8b3e-1d5326d8e46e"
      },
      "source": [
        "!zip -r /content/model.zip /content/checkpoint\n"
      ],
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "  adding: content/checkpoint/ (stored 0%)\n",
            "  adding: content/checkpoint/run1/ (stored 0%)\n",
            "  adding: content/checkpoint/run1/checkpoint (deflated 40%)\n",
            "  adding: content/checkpoint/run1/hparams.json (deflated 28%)\n",
            "  adding: content/checkpoint/run1/model-1000.data-00000-of-00001 (deflated 7%)\n",
            "  adding: content/checkpoint/run1/events.out.tfevents.1585665325.654fa7a1b6ca (deflated 61%)\n",
            "  adding: content/checkpoint/run1/model-1000.index (deflated 62%)\n",
            "  adding: content/checkpoint/run1/vocab.bpe (deflated 53%)\n",
            "  adding: content/checkpoint/run1/encoder.json (deflated 67%)\n",
            "  adding: content/checkpoint/run1/counter (stored 0%)\n",
            "  adding: content/checkpoint/run1/model-1000.meta (deflated 91%)\n"
          ],
          "name": "stdout"
        }
      ]
    }
  ]
}