Standford SHP reward dataset

[MattiaSangermano]

Following #224, I wrote a first draft of the metrics to compute the rewards of the Standford SHP dataset. If it's fine with you for now I would focus on the effectiveness of the metrics and once we find a suitable one I will tailor the code to be in line with the rest of the codebase. The code is consistent with the rest of the repo, so to get the rewards just run the command:

python artifacts/download_dataset.py SHPReward --path <path_to_folder_for_download> --number_of_samples <N>

The reward distribution:

0: 0.336162 %
1: 0.194715 %
2: 0.149592 %
3: 0.083746 %
4: 0.037445 %
5: 0.198339 %

Some samples:

"user_input": "[DC] Is the Flash able to run forever without getting tired, or would he eventually reach a point of physical and/or mental 
"completion": "The only version of Flash that never stops running is the one in Kingdom Come as far as I know.",
"reward": 0

"user_input": "I can partially understand Middle English readings of Chaucer, while Old English sounds entirely foreign to me. How easily would a speaker of Middle English (14th century) be able to understand an Old English reading of Beowulf (9th century)?",
"completion": "Can you link me to your middle english reading? I'd like to try it",
"reward": 1

"user_input": "What have you learned from experience that a culinary school probably cannot teach? I created this account for a school project and would like to hear what everyone here has learned, that a culinary class cannot simulate or teach.",
"completion": "Timing, and getting the feel for the rhythm in the kitchen. Especially when it comes to working as a team.",
"reward": 2

"user_input": "Why can't mute people speak? Can they make oral sounds? (Like screaming, humming, moaning) I don't mean to be rude.",
"completion": "I didn't see it posted here yet, but there is also a form called selective mutism. You see it often w autism. It's basically an extreme anxiety of people hearing your voice. These individuals can talk, just choose not to. Applied Behavior Analysis can intervene can help these individuals overcome this.",
"reward": 3

"user_input": "CMV: God didn't stop humans from sinning, and so Christians have no business using God's will to justify trying to do the same According to the Bible, God didn't prevent Adam and Eve from taking the fruit from the Tree of the knowledge of good and evil, nor he prevented the serpent from entering the Garden of Eden. While humans were told not to sin, there were no obstacles to the sin. This was probably to allow the humans to exercise their freedom of will, which is an important idea in Christianity.  It should therefore be wrong to appeal to God's will while attempting to restrict people from sinning, e.g. by banning abortion. It just goes against the \u201cspirit\u201d of Genesis. CMV!  P.S. Don't get me wrong, nothing prevents us from outlawing bad things per se, there are other sources of law.  P.P.S. An obvious counterargument to this would be many examples of God punishing people for their sins. I honestly don't know what to make of this, but most Christians I talked to still consider this \u201cfree will\u201d\u2014after all, you still can sin? Anyways, this doesn't seem to be voiding the idea of free will, so unless there's more to it, I'll leave this aside for the time being.",
"completion": "We can still believe that murder should be punished/prevented, right?  Why not abortion for the same reasons since many christians view it as murder?  Christians don't keep their secular morality in one box and say, \"Okay these things are objectively immoral and can be punished\" and their religious morality in another box.  Their religion informs their morality.  You don't even have to be christian to believe abortion is wrong, so I wouldn't even say it must be in the religious morality box anyway.  There are religious moralities that are personal, such as Jewish people eating Kosher foods with no desire to push other people into eating Kosher foods, but that just doesn't apply to things where people are being mistreated, such as murdering fetuses.  >  It just goes against the \u201cspirit\u201d of Genesis.  Is jailing people for homicide against the spirit of Genesis?  Not murdering is one of the 10 commandments and is absolutely a sin too.",
"reward": 4

"user_input": "How can I avoid taking antibiotics so often when seeing several different kinds of doctors (dermatologist, rheumatologist, gynecologist, hematologist)?  [28][F] Height: 5'2 Weight: 119lbs Race/Ethnicity: Hispanic  Primary Concern: concerned about the number of antibiotics I've taken and unsure how to coordinate between doctors  Existing Medical Issues:  Slight anemia [Low Ferritin (6ng/mL 01/23/20) hemoglobin (10.5g/dL 01/23/20)], undifferentiated connective tissue disease, celiac, and PCOS  Current Medication:  Doxcycline 100mg 2x a day and clindamycin 1% topical (started 06/12/20), Zoloft 100mg 1x a day, and Adderall 20mg 2x a day, gummy multivitamin 1x a day, Zyrtec 1x a day,   Drugs / Alcohol: alcohol (1-2x a month), nicotine 3mg daily (vape)   I've taken antibiotics 6-8 times a year for different infections (UTI, BV, skin infections, strep, etc). So the gynecologist will prescribe levofloxacin for reoccurring UTI's  hoping to knock them out for good about a week after the dermatologist prescribes doxycycline and topical clindamycin for cysts.  This is after taking minocycline (sp) for a month last year (for the same cysts) and two years of taking either nitrofurantoin or cephalexin and later levofloxacin (depending on whether it's klebsiella, staph, or e. coli) for UTI's.  What happens when I get a serious infection and nothing helps because I've taken everything twice over?  I don't want to appear difficult or give off the impression that I don't trust them by questioning their recommended treatment (no matter how chill I feel, I get the impression my questions are viewed as dramatic or ridiculous). No offense, but I'm hoping to have fewer appointments and see fewer specialists.   It feels as though I am adding risk every time I step into an office or complete a round of antibiotics.   I don't want to take two different antibiotics if one would work just fine.  **How can I avoid taking too many antibiotics when seeing all of these different doctors?**",
"completion": "I assume you are in the USA. Your primary care provider should be monitoring all this but, many do not.  Pharmacists often have a better knowledge of medications than doctors.  It might be a good idea to talk to your pharmacist -- be aware that not everyone who works in the pharmacy is not a pharmacist: ask to speak to a pharmacist.  You can also see if your insurance will cover a 'patient advocate' or 'patient co-ordinator' or 'patient consierge': they position has different names at different hospitals.  This person should help you deal with communication between doctors including worries about over medication.",
"reward": 5