storysumm.json

{
    "1e21553b47944b67bc2cdf67860d8e15": {
        "label": 0,
        "difficulty": "easy",
        "story": "There's a beach on the Southern coast of California where the sky is pink and orange and palm trees in the view. The ocean is lightly roaring and crashing on the sand. The sound of traffic is muted by a beautiful voice. A song calling from just beyond vision's reach.\nDaniel searched for the source. The song continued. Daniel walked closer to the water and peered out into the deep. Then, in the moment he saw her, the sky went black and time came to a stand still; A mermaid was sitting on a rock.\nDaniel rubbed his eyes, trying to make sense of what he was seeing. He called out, and waved. The mermaid waved back and motioned him to come over. Daniel, had no way out to the rock. He ran up and down the beach, past the frozen people, looking for a board or floaty, something that would let him cross the water. Finding no suitable options, he yelled \"One second!\" and headed toward the marina.\nDaniel was no expert on boating but, he knew enough to get one running. He did not know enough to avoid bumping into the boat behind him. To his great annoyance, he watched as one of the frozen people fell overboard. He jumped in after them, got them out, and righted them on the boat. Returning to the one he'd started, he headed toward the rocks.\nAbout halfway there, he noticed that the song the mermaid was singing had stopped. As he got closer, the mermaid got larger and decidedly gray. For the second time that day, Daniel couldn't believe what he was seeing. He lost focus on what was around him and panicked when he realized he was about to crash. The seal jumped from the rocks as the boat shortly met them, knocking Daniel unconscious.\nHe woke up staring at a bright florescent light. He could hear his father talking to the doctors and police. Daniel thought it was best to stay quiet. He closed his eyes to wait for the coast to clear. When he opened them again he was on the beach and the seal was standing next to him. It began singing the same beautiful song. Just as Daniel was about to speak, the seal flopped into the ocean, the sky turned from black back to orange and pink, the world resumed around him.\nHe shook his head trying to wake up from this dream but, could not. He screamed and suddenly found himself back in the hospital bed. He lifted his head and asked for water. His father began saying something to him. Unfortunately or for the better, depending on the perspective, Daniel heard none of it. Instead he fell back down into a deep sleep.\nHe awoke on the beach. The breeze was warm against his skin. The seal was standing next to him, singing the same song before flopping into the water. This time, Daniel ran after. He jumped in and reached out to grab its back when SNAP! the seal whipped its tail right into Daniel's ribs.\nHe let out a gasp and suddenly had no air. He jolted towards the surface.\n\"We don't know why he did it, honey.\" his mother offered to his father.\n\"I know you love him. I do too. But, he has got to go to rehab. Someone could have been seriously hurt not to mention how much it's all going to cost to fix all of this. Rehab, or he's out of the house.\" Daniel heard his father reply.\nHe broke through the surface and grimaced in pain. He looked for the shore but it was nowhere to be seen. The seal popped up next to him. It batted its eyes before showing its teeth and dove beneath Daniel. A moment of fear swept over him. He didn't know what to do. He stuck his face into the water to see the seal speeding towards him. WHACK\nDaniel felt his mother's hand holding his as she sat silently next to him. \"Hey, mo-\" Daniel tried before falling back to sleep.\nDaniel was flying through the air just above the water. He saw a trail of blood streaming from his face and the seal keeping pace just after. He looked to the sky and remembered, the dream is his. Rather than landing violently, Daniel slid to a stop on the water's surface before dropping gently beneath it. The seal was viciously streaming right at him. He held out his arm and the seal bit down hard. Only, the teeth didn't break the skin, the skin broke the teeth. Daniel smiled wide and brought them back to the beach.\nHe woke up in the hospital and sat upright. Daniel looked his father in the eye and said \"Rehab sounds great to me.\"",
        "summary": [
            "Daniel is a young man who finds himself on a beach on the Southern California coast, where the sky is pink and orange and palm trees are in view.",
            "He hears a beautiful song coming from just beyond what he can see and goes to investigate.",
            "He finds a mermaid sitting on a rock, but the sky suddenly goes black and time stands still.",
            "He runs to the marina to find a boat so he can get to the rock, but bumps into another boat and knocks a frozen person overboard.",
            "He jumps in to rescue them and eventually finds himself on the rock with the mermaid, but she has suddenly changed from a beautiful creature into a gray seal.",
            "He panics and crashes the boat, knocking himself unconscious.",
            "When he wakes up he is in a hospital and his parents are discussing sending him to rehab.",
            "Daniel agrees, and then falls back asleep.",
            "He wakes up again on the beach and the seal is there, singing the same song.",
            "He jumps into the water and the seal bites him, but his skin breaks the teeth.",
            "Daniel smiles and brings them back to the beach, and when he wakes up in the hospital again he tells his father rehab is a good idea."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            0,
            1,
            1,
            0,
            1,
            1,
            1
        ],
        "story-id": 1,
        "explanations": [
            "He doesn't find himself on the rock with the mermaid, he crashes into the rock.",
            "He doesn't agree to go to rehab the first time he wakes up."
        ],
        "claims": [
            "Daniel is a young man who finds himself on a beach on the Southern California coast.",
            "The sky on the beach where Daniel finds himself is pink and orange.",
            "Palm trees are visible from the beach where Daniel is.",
            "Daniel hears a beautiful song coming from a location beyond his immediate sight.",
            "Daniel goes to investigate the source of the beautiful song.",
            "Daniel finds a mermaid sitting on a rock.",
            "The sky suddenly goes black when Daniel finds the mermaid.",
            "Time stands still when the sky goes black as Daniel finds the mermaid.",
            "Daniel runs to the marina to find a boat to get to the rock where the mermaid is.",
            "Daniel bumps into another boat and knocks a frozen person overboard while trying to get to the rock.",
            "Daniel jumps into the water to rescue the frozen person he knocked overboard.",
            "Daniel eventually finds himself on the rock with the mermaid.",
            "The mermaid changes from a beautiful creature into a gray seal.",
            "Daniel panics and crashes the boat, knocking himself unconscious.",
            "When Daniel wakes up, he is in a hospital.",
            "Daniel's parents are discussing sending him to rehab while he is in the hospital.",
            "Daniel agrees to go to rehab.",
            "Daniel falls back asleep in the hospital after agreeing to go to rehab.",
            "Daniel wakes up again on the beach where he initially found himself.",
            "The seal is on the beach, singing the same song Daniel heard earlier.",
            "Daniel jumps into the water where the seal bites him.",
            "The seal's teeth break when it bites Daniel.",
            "Daniel smiles and brings the seal's broken teeth back to the beach.",
            "Daniel wakes up in the hospital again after the incident with the seal and its broken teeth.",
            "Daniel tells his father that going to rehab is a good idea after waking up in the hospital again."
        ],
        "split": "val",
        "model": "text-davinci-003"
    },
    "bb2f48936f8641a69d825f356ae89f7d": {
        "label": 0,
        "difficulty": "easy",
        "story": "There's a beach on the Southern coast of California where the sky is pink and orange and palm trees in the view. The ocean is lightly roaring and crashing on the sand. The sound of traffic is muted by a beautiful voice. A song calling from just beyond vision's reach.\nDaniel searched for the source. The song continued. Daniel walked closer to the water and peered out into the deep. Then, in the moment he saw her, the sky went black and time came to a stand still; A mermaid was sitting on a rock.\nDaniel rubbed his eyes, trying to make sense of what he was seeing. He called out, and waved. The mermaid waved back and motioned him to come over. Daniel, had no way out to the rock. He ran up and down the beach, past the frozen people, looking for a board or floaty, something that would let him cross the water. Finding no suitable options, he yelled \"One second!\" and headed toward the marina.\nDaniel was no expert on boating but, he knew enough to get one running. He did not know enough to avoid bumping into the boat behind him. To his great annoyance, he watched as one of the frozen people fell overboard. He jumped in after them, got them out, and righted them on the boat. Returning to the one he'd started, he headed toward the rocks.\nAbout halfway there, he noticed that the song the mermaid was singing had stopped. As he got closer, the mermaid got larger and decidedly gray. For the second time that day, Daniel couldn't believe what he was seeing. He lost focus on what was around him and panicked when he realized he was about to crash. The seal jumped from the rocks as the boat shortly met them, knocking Daniel unconscious.\nHe woke up staring at a bright florescent light. He could hear his father talking to the doctors and police. Daniel thought it was best to stay quiet. He closed his eyes to wait for the coast to clear. When he opened them again he was on the beach and the seal was standing next to him. It began singing the same beautiful song. Just as Daniel was about to speak, the seal flopped into the ocean, the sky turned from black back to orange and pink, the world resumed around him.\nHe shook his head trying to wake up from this dream but, could not. He screamed and suddenly found himself back in the hospital bed. He lifted his head and asked for water. His father began saying something to him. Unfortunately or for the better, depending on the perspective, Daniel heard none of it. Instead he fell back down into a deep sleep.\nHe awoke on the beach. The breeze was warm against his skin. The seal was standing next to him, singing the same song before flopping into the water. This time, Daniel ran after. He jumped in and reached out to grab its back when SNAP! the seal whipped its tail right into Daniel's ribs.\nHe let out a gasp and suddenly had no air. He jolted towards the surface.\n\"We don't know why he did it, honey.\" his mother offered to his father.\n\"I know you love him. I do too. But, he has got to go to rehab. Someone could have been seriously hurt not to mention how much it's all going to cost to fix all of this. Rehab, or he's out of the house.\" Daniel heard his father reply.\nHe broke through the surface and grimaced in pain. He looked for the shore but it was nowhere to be seen. The seal popped up next to him. It batted its eyes before showing its teeth and dove beneath Daniel. A moment of fear swept over him. He didn't know what to do. He stuck his face into the water to see the seal speeding towards him. WHACK\nDaniel felt his mother's hand holding his as she sat silently next to him. \"Hey, mo-\" Daniel tried before falling back to sleep.\nDaniel was flying through the air just above the water. He saw a trail of blood streaming from his face and the seal keeping pace just after. He looked to the sky and remembered, the dream is his. Rather than landing violently, Daniel slid to a stop on the water's surface before dropping gently beneath it. The seal was viciously streaming right at him. He held out his arm and the seal bit down hard. Only, the teeth didn't break the skin, the skin broke the teeth. Daniel smiled wide and brought them back to the beach.\nHe woke up in the hospital and sat upright. Daniel looked his father in the eye and said \"Rehab sounds great to me.\"",
        "summary": [
            "A man named Daniel is walking on a beach in California when he hears a beautiful song.",
            "He follows the song and sees a mermaid sitting on a rock, waving him over.",
            "Daniel tries to find a way to reach her, but in the process of getting a boat, he hits a frozen person and falls unconscious.",
            "He wakes up in a hospital and falls back asleep.",
            "In his dream, he is back on the beach with the mermaid, and the seal attacks him, causing him to wake up again.",
            "He hears his father talking about his rehab and decides to accept it."
        ],
        "errors": [
            0,
            1,
            0,
            1,
            0,
            1
        ],
        "story-id": 1,
        "explanations": [
            "He may have been walking or sitting at the start of the story.",
            "He doesn't fall unconscious when he hits the frozen person.",
            "He is never back on the beach with the mermaid, he is with the seal."
        ],
        "claims": [
            "Daniel is walking on a beach in California.",
            "Daniel hears a beautiful song while walking on the beach.",
            "Daniel follows the song and sees a mermaid sitting on a rock.",
            "The mermaid is waving Daniel over to her.",
            "Daniel tries to find a way to reach the mermaid.",
            "In the process of getting a boat, Daniel hits a frozen person.",
            "After hitting the frozen person, Daniel falls unconscious.",
            "Daniel wakes up in a hospital after falling unconscious.",
            "After waking up in the hospital, Daniel falls back asleep.",
            "In his dream, Daniel is back on the beach with the mermaid.",
            "A seal attacks Daniel in his dream.",
            "The attack by the seal causes Daniel to wake up again.",
            "Daniel hears his father talking about his rehab.",
            "Daniel decides to accept his rehab."
        ],
        "split": "val",
        "model": "chatGPT"
    },
    "5dcae5af26a941a6bf03ac044f86c6ab": {
        "label": 0,
        "difficulty": "easy",
        "story": "There's a beach on the Southern coast of California where the sky is pink and orange and palm trees in the view. The ocean is lightly roaring and crashing on the sand. The sound of traffic is muted by a beautiful voice. A song calling from just beyond vision's reach.\nDaniel searched for the source. The song continued. Daniel walked closer to the water and peered out into the deep. Then, in the moment he saw her, the sky went black and time came to a stand still; A mermaid was sitting on a rock.\nDaniel rubbed his eyes, trying to make sense of what he was seeing. He called out, and waved. The mermaid waved back and motioned him to come over. Daniel, had no way out to the rock. He ran up and down the beach, past the frozen people, looking for a board or floaty, something that would let him cross the water. Finding no suitable options, he yelled \"One second!\" and headed toward the marina.\nDaniel was no expert on boating but, he knew enough to get one running. He did not know enough to avoid bumping into the boat behind him. To his great annoyance, he watched as one of the frozen people fell overboard. He jumped in after them, got them out, and righted them on the boat. Returning to the one he'd started, he headed toward the rocks.\nAbout halfway there, he noticed that the song the mermaid was singing had stopped. As he got closer, the mermaid got larger and decidedly gray. For the second time that day, Daniel couldn't believe what he was seeing. He lost focus on what was around him and panicked when he realized he was about to crash. The seal jumped from the rocks as the boat shortly met them, knocking Daniel unconscious.\nHe woke up staring at a bright florescent light. He could hear his father talking to the doctors and police. Daniel thought it was best to stay quiet. He closed his eyes to wait for the coast to clear. When he opened them again he was on the beach and the seal was standing next to him. It began singing the same beautiful song. Just as Daniel was about to speak, the seal flopped into the ocean, the sky turned from black back to orange and pink, the world resumed around him.\nHe shook his head trying to wake up from this dream but, could not. He screamed and suddenly found himself back in the hospital bed. He lifted his head and asked for water. His father began saying something to him. Unfortunately or for the better, depending on the perspective, Daniel heard none of it. Instead he fell back down into a deep sleep.\nHe awoke on the beach. The breeze was warm against his skin. The seal was standing next to him, singing the same song before flopping into the water. This time, Daniel ran after. He jumped in and reached out to grab its back when SNAP! the seal whipped its tail right into Daniel's ribs.\nHe let out a gasp and suddenly had no air. He jolted towards the surface.\n\"We don't know why he did it, honey.\" his mother offered to his father.\n\"I know you love him. I do too. But, he has got to go to rehab. Someone could have been seriously hurt not to mention how much it's all going to cost to fix all of this. Rehab, or he's out of the house.\" Daniel heard his father reply.\nHe broke through the surface and grimaced in pain. He looked for the shore but it was nowhere to be seen. The seal popped up next to him. It batted its eyes before showing its teeth and dove beneath Daniel. A moment of fear swept over him. He didn't know what to do. He stuck his face into the water to see the seal speeding towards him. WHACK\nDaniel felt his mother's hand holding his as she sat silently next to him. \"Hey, mo-\" Daniel tried before falling back to sleep.\nDaniel was flying through the air just above the water. He saw a trail of blood streaming from his face and the seal keeping pace just after. He looked to the sky and remembered, the dream is his. Rather than landing violently, Daniel slid to a stop on the water's surface before dropping gently beneath it. The seal was viciously streaming right at him. He held out his arm and the seal bit down hard. Only, the teeth didn't break the skin, the skin broke the teeth. Daniel smiled wide and brought them back to the beach.\nHe woke up in the hospital and sat upright. Daniel looked his father in the eye and said \"Rehab sounds great to me.\"",
        "summary": [
            "Daniel is walking on a beach in Southern California when he notices a mermaid sitting on a rock singing a beautiful song.",
            "As he gets closer to investigate, time freezes around him.",
            "He tries to find a way to get to the rock where the mermaid is sitting.",
            "After bumping into frozen people and boats, he makes it to the rock only to find that the mermaid has turned into a seal.",
            "He crashes his boat and gets knocked unconscious.",
            "He then seems to wake up multiple times, alternating between being on the beach with the seal and in the hospital.",
            "The experiences blur together and it's unclear what is real.",
            "In the end, after a series of chaotic and surreal events, Daniel agrees to go to rehab.",
            "The story appears to depict a man grappling with reality and struggling with substance abuse or mental health issues."
        ],
        "errors": [
            0,
            1,
            1,
            0,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 1,
        "explanations": [
            "He can't see it's a mermaid before he gets closer to investigate, and he may or may not have been walking at the start of the story.",
            "He gets in a boat and then the boat bumps into a boat and frozen person, not himself. He also never makes it to the rock. He approaches it and then crashes into it."
        ],
        "claims": [
            "Daniel is walking on a beach in Southern California.",
            "Daniel notices a mermaid sitting on a rock singing a song.",
            "The song sung by the mermaid is described as beautiful.",
            "As Daniel gets closer to the mermaid, time freezes around him.",
            "Daniel tries to find a way to get to the rock where the mermaid is sitting.",
            "Daniel bumps into frozen people and boats while trying to reach the rock.",
            "Upon reaching the rock, Daniel finds that the mermaid has turned into a seal.",
            "Daniel crashes his boat and gets knocked unconscious.",
            "Daniel experiences waking up multiple times, alternating between being on the beach with the seal and in the hospital.",
            "The experiences of being on the beach and in the hospital blur together for Daniel, making it unclear what is real.",
            "After a series of chaotic and surreal events, Daniel agrees to go to rehab.",
            "The story suggests that Daniel is grappling with reality.",
            "The story suggests that Daniel is struggling with substance abuse or mental health issues."
        ],
        "split": "val",
        "model": "claude"
    },
    "c6799a45e9b344268da6bcc6da0caa4b": {
        "label": 0,
        "difficulty": "hard",
        "story": "Aphrodite, goddess of lust, lov and beauty, the very image of a blonde model, sat on the dais of Olympus. She was anxiously chewing on her thumbnail, staring down at the Earth below her, \"That...stupid... internet. How could it say Athena's fairer than me? HOW DARE... AND 2 DAYS BEFORE MY HOLIDAY\"\nAthena, goddess of war an intelligence, sporting a crew cut, digicamo, and heads-up-display, was smirking nearby. As gods gained power from the adoration of their followers and interest in their domain, the poll, combined with the tech-flaunting in some recent wars, had given her a boost, and she was literally outshining Aphrodite next to her. \"Oh please, Aphrodite... you can't fight the ebb and flow of time. War always wins out over peace, and greater gods eventually consume the identity of lesser gods. It's only a matter of time until your power becomes mine.\"\nWith this, Athena walked off, laughing haughtily.\nAfter she was gone, Aphrodite screamed out at the top of her voice, \"CUUUPPIIDDDDD!!!\"\nShortly thereafter, her smaller son appeared, looking exhausted, \"It's shortly before Valentine's day... what's so urgent you'd stop our most important time of year?\"\n\"This...poll... why would I, the goddess of beauty, love, and lust, lose out in a contest of fairness, to that... butch.... erarrggg... regardless. Let's cheat the system. I need you to shoot the entire Earth with an arrow. Direct it's love at me.\"\n\"Mom... my power is a splinter of your power. Even you don't have the power to pull that off, what makes you think I would? And if we have to expend our power to get worship your way, it's just going to be diminishing returns. You'll drain yourself dry.\"\n\"What about boosting the levels of lust again? Is there any way I can get any hotter?\"\nCupid shook his head, \"Sorry, but your looks are an amalgam of all the hottest stars. There's really no way to get you to instigate more lust in individuals. You can raise it on an individual level by playing into fetishes, but that'd just turn you off to people who don't have the fetish. I'm sorry, but you're at max capacity.\"\nAphrodite sighed, \"How.... how did this happen? There's got to be something more. How could Athena pass me? I even tried to reduce her power when that poll started by getting all those tech workers fired.\"\n\"I mainly just handle love at first glance, and you've got game, mom. I really don't know. I'm probably not the best to ask. Mind if I get back to work?\"\n\"Sure hun, thanks for the time.\"\nCupid nodded and flew off, leaving Aphrodite to stew. Who to ask? Ask Athena what her secret is? No. Athena was too combative, she'd just take the opportunity to increase her power over her. There was her ex, Hephaestus... he was smart, so he'd probably have an answer. But... no... she had burned that bridge long ago. With her own dalliances.\nIt had been forever since she had actually descended in person to the mortal realm, mostly relying on Cupid and Hermes to keep her up to date. So, she took a step from the dais, disappearing on her step down, appearing in the finish to that step in downtown Seattle. As always, her fashion instantly matched the time period, though she was a little surprised that gone were the robes and flowing garments of the past, and instead she was in some tight denim pants, and a short cotton top with a few strategically placed holes. The earrings were familiar, though.\nShe had to test, though if she still had it. She walked up to a guy, and pointed at him, \"You! Meet me in a nearby hotel for the night of your life!\"\nThe guy looked taken aback, \"Ma'am, I have a husband who I am completely devoted to! And you simply aren't my type!\"\nWith that, he leaned over and kissed the guy next to him. The guy's husband looked back at her, \"Get lost, Karen. This guy's mine.\"\nAphrodite was taken aback. Being turned down wasn't a thing that happened to her often. To be fair, he was gay and she was plenty aware of gay men not being interested in her, for example, there were the Spartans (Oh, dear herself, were they gay.) But she should have picked up on it sooner. Her power was slipping. And what was that he called her? A Karen?\nHer line of thought was interrupted with a short balding guy in a suit tapped her on the shoulder, \"Excuse me, ma'am, you're lovely, and I was wondering if I could get your number.\" It was a common occurrence for men to randomly flirt with her, \"Oh, I'm the number 1 goddess of love.\"\nHe blinked, \"I mean your phone number.\"\n\"Oh, I don't have a cell phone.\" She'd heard about that, never got involved. They didn't seem all that romantic, but if it was a part of modern human flirting, she'd have to learn, \"...but I could think of a reason you might buy me one.\" One dalliance, hotel room, and one night stand later, she had her first, courtesy of a more-than-grateful businessman. If this was part of standard human flirting practices nowadays, she would have to understand it.",
        "summary": [
            "Aphrodite, goddess of lust, love and beauty, is upset when an Internet poll ranks her as less fair than Athena, goddess of war and intelligence.",
            "She tasks Cupid with shooting the Earth with an arrow to direct love to her, but he warns her that it would be diminishing returns.",
            "She then descends to the mortal realm to test her power, but is turned down by a gay man who calls her a Karen.",
            "She then learns the modern human flirting practices and has a one night stand with a businessman, who buys her a cell phone."
        ],
        "errors": [
            1,
            1,
            0,
            1
        ],
        "story-id": 2,
        "explanations": [
            "The partner of the man who turns her down calls her a Karen."
        ],
        "claims": [
            "Aphrodite is the goddess of lust, love, and beauty.",
            "An Internet poll ranks Aphrodite as less fair than Athena.",
            "Athena is the goddess of war and intelligence.",
            "Aphrodite tasks Cupid with shooting the Earth with an arrow to direct love towards her.",
            "Cupid warns Aphrodite that using the arrow to direct love towards her would result in diminishing returns.",
            "Aphrodite descends to the mortal realm to test her power.",
            "A gay man turns down Aphrodite and calls her a Karen.",
            "Aphrodite learns modern human flirting practices.",
            "Aphrodite has a one night stand with a businessman.",
            "The businessman buys Aphrodite a cell phone."
        ],
        "split": "val",
        "model": "text-davinci-003"
    },
    "8c0cc43de7b84829a36bf058d2fe7dcd": {
        "label": 1,
        "difficulty": "",
        "story": "Aphrodite, goddess of lust, lov and beauty, the very image of a blonde model, sat on the dais of Olympus. She was anxiously chewing on her thumbnail, staring down at the Earth below her, \"That...stupid... internet. How could it say Athena's fairer than me? HOW DARE... AND 2 DAYS BEFORE MY HOLIDAY\"\nAthena, goddess of war an intelligence, sporting a crew cut, digicamo, and heads-up-display, was smirking nearby. As gods gained power from the adoration of their followers and interest in their domain, the poll, combined with the tech-flaunting in some recent wars, had given her a boost, and she was literally outshining Aphrodite next to her. \"Oh please, Aphrodite... you can't fight the ebb and flow of time. War always wins out over peace, and greater gods eventually consume the identity of lesser gods. It's only a matter of time until your power becomes mine.\"\nWith this, Athena walked off, laughing haughtily.\nAfter she was gone, Aphrodite screamed out at the top of her voice, \"CUUUPPIIDDDDD!!!\"\nShortly thereafter, her smaller son appeared, looking exhausted, \"It's shortly before Valentine's day... what's so urgent you'd stop our most important time of year?\"\n\"This...poll... why would I, the goddess of beauty, love, and lust, lose out in a contest of fairness, to that... butch.... erarrggg... regardless. Let's cheat the system. I need you to shoot the entire Earth with an arrow. Direct it's love at me.\"\n\"Mom... my power is a splinter of your power. Even you don't have the power to pull that off, what makes you think I would? And if we have to expend our power to get worship your way, it's just going to be diminishing returns. You'll drain yourself dry.\"\n\"What about boosting the levels of lust again? Is there any way I can get any hotter?\"\nCupid shook his head, \"Sorry, but your looks are an amalgam of all the hottest stars. There's really no way to get you to instigate more lust in individuals. You can raise it on an individual level by playing into fetishes, but that'd just turn you off to people who don't have the fetish. I'm sorry, but you're at max capacity.\"\nAphrodite sighed, \"How.... how did this happen? There's got to be something more. How could Athena pass me? I even tried to reduce her power when that poll started by getting all those tech workers fired.\"\n\"I mainly just handle love at first glance, and you've got game, mom. I really don't know. I'm probably not the best to ask. Mind if I get back to work?\"\n\"Sure hun, thanks for the time.\"\nCupid nodded and flew off, leaving Aphrodite to stew. Who to ask? Ask Athena what her secret is? No. Athena was too combative, she'd just take the opportunity to increase her power over her. There was her ex, Hephaestus... he was smart, so he'd probably have an answer. But... no... she had burned that bridge long ago. With her own dalliances.\nIt had been forever since she had actually descended in person to the mortal realm, mostly relying on Cupid and Hermes to keep her up to date. So, she took a step from the dais, disappearing on her step down, appearing in the finish to that step in downtown Seattle. As always, her fashion instantly matched the time period, though she was a little surprised that gone were the robes and flowing garments of the past, and instead she was in some tight denim pants, and a short cotton top with a few strategically placed holes. The earrings were familiar, though.\nShe had to test, though if she still had it. She walked up to a guy, and pointed at him, \"You! Meet me in a nearby hotel for the night of your life!\"\nThe guy looked taken aback, \"Ma'am, I have a husband who I am completely devoted to! And you simply aren't my type!\"\nWith that, he leaned over and kissed the guy next to him. The guy's husband looked back at her, \"Get lost, Karen. This guy's mine.\"\nAphrodite was taken aback. Being turned down wasn't a thing that happened to her often. To be fair, he was gay and she was plenty aware of gay men not being interested in her, for example, there were the Spartans (Oh, dear herself, were they gay.) But she should have picked up on it sooner. Her power was slipping. And what was that he called her? A Karen?\nHer line of thought was interrupted with a short balding guy in a suit tapped her on the shoulder, \"Excuse me, ma'am, you're lovely, and I was wondering if I could get your number.\" It was a common occurrence for men to randomly flirt with her, \"Oh, I'm the number 1 goddess of love.\"\nHe blinked, \"I mean your phone number.\"\n\"Oh, I don't have a cell phone.\" She'd heard about that, never got involved. They didn't seem all that romantic, but if it was a part of modern human flirting, she'd have to learn, \"...but I could think of a reason you might buy me one.\" One dalliance, hotel room, and one night stand later, she had her first, courtesy of a more-than-grateful businessman. If this was part of standard human flirting practices nowadays, she would have to understand it.",
        "summary": [
            "The story is about the goddess Aphrodite's insecurity and jealousy towards Athena, who has surpassed her in popularity due to a recent poll.",
            "Aphrodite turns to her son Cupid for help in cheating the system, but he tells her it's not possible.",
            "Aphrodite decides to go down to Earth and try to understand modern human flirting to boost her power.",
            "However, she finds herself rejected by a gay man and insulted by being called a \"Karen.\"",
            "She eventually gets a businessman to buy her a cell phone, hoping to learn more about modern flirting practices."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 2,
        "explanations": [],
        "claims": [
            "Aphrodite is a goddess.",
            "Aphrodite feels insecure and jealous towards Athena.",
            "Athena has surpassed Aphrodite in popularity according to a recent poll.",
            "Aphrodite asks her son Cupid for help in cheating the system.",
            "Cupid tells Aphrodite that cheating the system is not possible.",
            "Aphrodite decides to go down to Earth to understand modern human flirting.",
            "Aphrodite aims to boost her power by understanding modern human flirting.",
            "Aphrodite is rejected by a gay man while on Earth.",
            "Aphrodite is insulted by being called a \"Karen\" while on Earth.",
            "A businessman buys Aphrodite a cell phone while she is on Earth.",
            "Aphrodite hopes to learn more about modern flirting practices through the cell phone."
        ],
        "split": "val",
        "model": "chatGPT"
    },
    "a0b5cd1df93c41bebcddd2423e91c090": {
        "label": 1,
        "difficulty": "",
        "story": "Aphrodite, goddess of lust, lov and beauty, the very image of a blonde model, sat on the dais of Olympus. She was anxiously chewing on her thumbnail, staring down at the Earth below her, \"That...stupid... internet. How could it say Athena's fairer than me? HOW DARE... AND 2 DAYS BEFORE MY HOLIDAY\"\nAthena, goddess of war an intelligence, sporting a crew cut, digicamo, and heads-up-display, was smirking nearby. As gods gained power from the adoration of their followers and interest in their domain, the poll, combined with the tech-flaunting in some recent wars, had given her a boost, and she was literally outshining Aphrodite next to her. \"Oh please, Aphrodite... you can't fight the ebb and flow of time. War always wins out over peace, and greater gods eventually consume the identity of lesser gods. It's only a matter of time until your power becomes mine.\"\nWith this, Athena walked off, laughing haughtily.\nAfter she was gone, Aphrodite screamed out at the top of her voice, \"CUUUPPIIDDDDD!!!\"\nShortly thereafter, her smaller son appeared, looking exhausted, \"It's shortly before Valentine's day... what's so urgent you'd stop our most important time of year?\"\n\"This...poll... why would I, the goddess of beauty, love, and lust, lose out in a contest of fairness, to that... butch.... erarrggg... regardless. Let's cheat the system. I need you to shoot the entire Earth with an arrow. Direct it's love at me.\"\n\"Mom... my power is a splinter of your power. Even you don't have the power to pull that off, what makes you think I would? And if we have to expend our power to get worship your way, it's just going to be diminishing returns. You'll drain yourself dry.\"\n\"What about boosting the levels of lust again? Is there any way I can get any hotter?\"\nCupid shook his head, \"Sorry, but your looks are an amalgam of all the hottest stars. There's really no way to get you to instigate more lust in individuals. You can raise it on an individual level by playing into fetishes, but that'd just turn you off to people who don't have the fetish. I'm sorry, but you're at max capacity.\"\nAphrodite sighed, \"How.... how did this happen? There's got to be something more. How could Athena pass me? I even tried to reduce her power when that poll started by getting all those tech workers fired.\"\n\"I mainly just handle love at first glance, and you've got game, mom. I really don't know. I'm probably not the best to ask. Mind if I get back to work?\"\n\"Sure hun, thanks for the time.\"\nCupid nodded and flew off, leaving Aphrodite to stew. Who to ask? Ask Athena what her secret is? No. Athena was too combative, she'd just take the opportunity to increase her power over her. There was her ex, Hephaestus... he was smart, so he'd probably have an answer. But... no... she had burned that bridge long ago. With her own dalliances.\nIt had been forever since she had actually descended in person to the mortal realm, mostly relying on Cupid and Hermes to keep her up to date. So, she took a step from the dais, disappearing on her step down, appearing in the finish to that step in downtown Seattle. As always, her fashion instantly matched the time period, though she was a little surprised that gone were the robes and flowing garments of the past, and instead she was in some tight denim pants, and a short cotton top with a few strategically placed holes. The earrings were familiar, though.\nShe had to test, though if she still had it. She walked up to a guy, and pointed at him, \"You! Meet me in a nearby hotel for the night of your life!\"\nThe guy looked taken aback, \"Ma'am, I have a husband who I am completely devoted to! And you simply aren't my type!\"\nWith that, he leaned over and kissed the guy next to him. The guy's husband looked back at her, \"Get lost, Karen. This guy's mine.\"\nAphrodite was taken aback. Being turned down wasn't a thing that happened to her often. To be fair, he was gay and she was plenty aware of gay men not being interested in her, for example, there were the Spartans (Oh, dear herself, were they gay.) But she should have picked up on it sooner. Her power was slipping. And what was that he called her? A Karen?\nHer line of thought was interrupted with a short balding guy in a suit tapped her on the shoulder, \"Excuse me, ma'am, you're lovely, and I was wondering if I could get your number.\" It was a common occurrence for men to randomly flirt with her, \"Oh, I'm the number 1 goddess of love.\"\nHe blinked, \"I mean your phone number.\"\n\"Oh, I don't have a cell phone.\" She'd heard about that, never got involved. They didn't seem all that romantic, but if it was a part of modern human flirting, she'd have to learn, \"...but I could think of a reason you might buy me one.\" One dalliance, hotel room, and one night stand later, she had her first, courtesy of a more-than-grateful businessman. If this was part of standard human flirting practices nowadays, she would have to understand it.",
        "summary": [
            "The goddess Aphrodite is upset that a poll shows Athena, the goddess of war, is considered fairer than her.",
            "This threatens Aphrodite's power as the goddess of love and beauty, which comes from worship and interest in her domain.",
            "Aphrodite asks her son Cupid to shoot all of Earth with an arrow of love directed at her to fix the problem, but Cupid says he does not have the power to do that and it would not be effective.",
            "Aphrodite then decides to travel to the mortal realm herself for the first time in a long while to better understand how human attraction and flirting work nowadays.",
            "After being turned down by a gay man, she meets another man who gives her a cell phone after a one night stand.",
            "The story suggests that Aphrodite must learn how modern human attraction and relationships work if she wants to maintain her power as the goddess of love."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 2,
        "explanations": [],
        "claims": [
            "Aphrodite is upset because a poll shows Athena is considered fairer than her.",
            "Aphrodite's power as the goddess of love and beauty comes from worship and interest in her domain.",
            "Aphrodite asks her son Cupid to shoot all of Earth with an arrow of love directed at her to fix the problem.",
            "Cupid tells Aphrodite he does not have the power to shoot all of Earth with an arrow of love.",
            "Cupid believes that shooting all of Earth with an arrow of love directed at Aphrodite would not be effective.",
            "Aphrodite decides to travel to the mortal realm herself to understand how human attraction and flirting work nowadays.",
            "Aphrodite's decision to travel to the mortal realm marks her first visit there in a long while.",
            "Aphrodite is turned down by a gay man during her visit to the mortal realm.",
            "After being turned down, Aphrodite meets another man who gives her a cell phone after a one night stand.",
            "The story suggests that Aphrodite must learn how modern human attraction and relationships work to maintain her power as the goddess of love."
        ],
        "split": "val",
        "model": "claude"
    },
    "23595acba8c341369cae2329680f972a": {
        "label": 0,
        "difficulty": "hard",
        "story": "I could still taste the gas station coke I had slurped up before the light pulled me into the night sky. In what felt like seconds, I was swallowed up in a beam of light. I opened my eyes to find myself shivering and naked on a cold metallic table in a hollow white room.\nRestraints kept me down. A strange figure produced a long, semi-transparent instrument filled with blue liquid. They pressed their finger against the instrument and it started whirring a high pitched squeal. The figure next to them raised a finger to their mouth.\nI could hear the high pitched whirring get louder as it neared my ear canal. One of them pressed their cold fingers against my head, holding it in place.\n\"No!!!\"\nI screamed, and the hand lifted off my face.\nI jerked my head to look back at them, and saw that they were setting the instrument down. A low hum of trilling emerged from its mouth as it seemed to speak to the others. It then drifted out of sight.\nIn a blink, the white room disappeared from my view, and I was blanketed in complete darkness. A voice came from the darkness. It sounded like an older woman's voice.\n\"Just calm down, for goodness sake. You're being ridiculous.\"\n\"What? What is happening!!\"\nThe woman's voice became a shrill whisper, like she was scolding a child at church service.\n\"You know exactly what is happening young man, you're wasting their precious time. Do you know how many patients they have to care for every single night? Absolutely disrespectful.\"\nBefore I could reply, a bright flash suddenly blinded me. I opened my eyes and was greeted with the glare of those things again. One extended its hand and stroked my forehead.\n\"Get off me! Let me go!\"\nThe being retracted its hand. It opened its eyes at me again, this time seemingly more stern, and raised a finger to its mouth once more before grabbing my head and holding it still.\nThe whirring sound started up. I screamed.\nOff in the distance I heard a faint but familiar female voice.\n\"Oh, shut up, you baby!\"\nThe whirring became louder and louder, and culminated in a sudden sharp, burning pain in my ear, followed by a rush of cold liquid. I screamed in agony as the thing holding my head down appeared to roll its large black eyes at me.\nFinally, I was released. I could move again. I jerked my body upward to find that they had all vanished from sight. A lone doorway opened at the opposite end of my table in the bright room.\nAs I emerged from the room back onto familiar wet road, I looked behind me. Nothing. As if the room, the ship, whatever it was, never existed. In my hand, I felt a foreign object was now in my grasp. I glanced down to see what I was holding.\nIt was a lollipop.",
        "summary": [
            "A man is suddenly pulled into a beam of light and finds himself in a strange white room, restrained on a cold metal table.",
            "He is met by strange figures who appear to be conducting some kind of experiment on him.",
            "They use a strange semi-transparent instrument filled with blue liquid, and then leave abruptly.",
            "The man finds himself back on the wet road he was standing on before, with a lollipop in his hand.",
            "He is left to wonder what just happened and if it was all real."
        ],
        "errors": [
            1,
            0,
            1,
            0,
            1
        ],
        "story-id": 3,
        "explanations": [
            "The figures seem to be doing a clear procedure rather than experimenting.",
            "The man doesn't just find himself back on the road. A door appears, he exits, and then is back on the road."
        ],
        "claims": [
            "A man is suddenly pulled into a beam of light.",
            "The man finds himself in a strange white room.",
            "The man is restrained on a cold metal table in the white room.",
            "Strange figures meet the man in the white room.",
            "The strange figures appear to be conducting an experiment on the man.",
            "The strange figures use a semi-transparent instrument filled with blue liquid during the experiment.",
            "The strange figures leave abruptly after using the semi-transparent instrument.",
            "The man finds himself back on the wet road where he was standing before the incident.",
            "The man has a lollipop in his hand after returning to the wet road.",
            "The man is left to wonder if the experience in the white room was real."
        ],
        "split": "val",
        "model": "text-davinci-003"
    },
    "172e75a09ab94fdb897d8f66af667f7b": {
        "label": 0,
        "difficulty": "easy",
        "story": "I could still taste the gas station coke I had slurped up before the light pulled me into the night sky. In what felt like seconds, I was swallowed up in a beam of light. I opened my eyes to find myself shivering and naked on a cold metallic table in a hollow white room.\nRestraints kept me down. A strange figure produced a long, semi-transparent instrument filled with blue liquid. They pressed their finger against the instrument and it started whirring a high pitched squeal. The figure next to them raised a finger to their mouth.\nI could hear the high pitched whirring get louder as it neared my ear canal. One of them pressed their cold fingers against my head, holding it in place.\n\"No!!!\"\nI screamed, and the hand lifted off my face.\nI jerked my head to look back at them, and saw that they were setting the instrument down. A low hum of trilling emerged from its mouth as it seemed to speak to the others. It then drifted out of sight.\nIn a blink, the white room disappeared from my view, and I was blanketed in complete darkness. A voice came from the darkness. It sounded like an older woman's voice.\n\"Just calm down, for goodness sake. You're being ridiculous.\"\n\"What? What is happening!!\"\nThe woman's voice became a shrill whisper, like she was scolding a child at church service.\n\"You know exactly what is happening young man, you're wasting their precious time. Do you know how many patients they have to care for every single night? Absolutely disrespectful.\"\nBefore I could reply, a bright flash suddenly blinded me. I opened my eyes and was greeted with the glare of those things again. One extended its hand and stroked my forehead.\n\"Get off me! Let me go!\"\nThe being retracted its hand. It opened its eyes at me again, this time seemingly more stern, and raised a finger to its mouth once more before grabbing my head and holding it still.\nThe whirring sound started up. I screamed.\nOff in the distance I heard a faint but familiar female voice.\n\"Oh, shut up, you baby!\"\nThe whirring became louder and louder, and culminated in a sudden sharp, burning pain in my ear, followed by a rush of cold liquid. I screamed in agony as the thing holding my head down appeared to roll its large black eyes at me.\nFinally, I was released. I could move again. I jerked my body upward to find that they had all vanished from sight. A lone doorway opened at the opposite end of my table in the bright room.\nAs I emerged from the room back onto familiar wet road, I looked behind me. Nothing. As if the room, the ship, whatever it was, never existed. In my hand, I felt a foreign object was now in my grasp. I glanced down to see what I was holding.\nIt was a lollipop.",
        "summary": [
            "The protagonist gets abducted by aliens after drinking a gas station coke.",
            "They wake up restrained on a table in a white room with strange figures surrounding them.",
            "The figures use an instrument that causes the protagonist pain and discomfort.",
            "A woman's voice scolds the protagonist for wasting the aliens' time.",
            "The figures release the protagonist and give them a lollipop before disappearing, leaving the protagonist alone on a wet road."
        ],
        "errors": [
            0,
            1,
            1,
            1,
            0
        ],
        "story-id": 3,
        "explanations": [
            "Labeling this as an abduction by aliens is an interpretive jump.",
            "The figures do not give the man a lollipop and leave him on the road. They disappear, and then a door appears, the man exits and is back on the road with a lollipop."
        ],
        "claims": [
            "The protagonist gets abducted by aliens after drinking a gas station coke.",
            "The protagonist wakes up restrained on a table in a white room.",
            "Strange figures are surrounding the protagonist while they are restrained on the table.",
            "The figures use an instrument on the protagonist that causes pain and discomfort.",
            "A woman's voice scolds the protagonist, accusing them of wasting the aliens' time.",
            "The figures release the protagonist from the restraints.",
            "The figures give the protagonist a lollipop.",
            "The figures disappear after releasing the protagonist and giving them a lollipop.",
            "The protagonist finds themselves alone on a wet road after the figures disappear."
        ],
        "split": "val",
        "model": "chatGPT"
    },
    "0b08649def5b4a13aa68f784227fc004": {
        "label": 0,
        "difficulty": "easy",
        "story": "I could still taste the gas station coke I had slurped up before the light pulled me into the night sky. In what felt like seconds, I was swallowed up in a beam of light. I opened my eyes to find myself shivering and naked on a cold metallic table in a hollow white room.\nRestraints kept me down. A strange figure produced a long, semi-transparent instrument filled with blue liquid. They pressed their finger against the instrument and it started whirring a high pitched squeal. The figure next to them raised a finger to their mouth.\nI could hear the high pitched whirring get louder as it neared my ear canal. One of them pressed their cold fingers against my head, holding it in place.\n\"No!!!\"\nI screamed, and the hand lifted off my face.\nI jerked my head to look back at them, and saw that they were setting the instrument down. A low hum of trilling emerged from its mouth as it seemed to speak to the others. It then drifted out of sight.\nIn a blink, the white room disappeared from my view, and I was blanketed in complete darkness. A voice came from the darkness. It sounded like an older woman's voice.\n\"Just calm down, for goodness sake. You're being ridiculous.\"\n\"What? What is happening!!\"\nThe woman's voice became a shrill whisper, like she was scolding a child at church service.\n\"You know exactly what is happening young man, you're wasting their precious time. Do you know how many patients they have to care for every single night? Absolutely disrespectful.\"\nBefore I could reply, a bright flash suddenly blinded me. I opened my eyes and was greeted with the glare of those things again. One extended its hand and stroked my forehead.\n\"Get off me! Let me go!\"\nThe being retracted its hand. It opened its eyes at me again, this time seemingly more stern, and raised a finger to its mouth once more before grabbing my head and holding it still.\nThe whirring sound started up. I screamed.\nOff in the distance I heard a faint but familiar female voice.\n\"Oh, shut up, you baby!\"\nThe whirring became louder and louder, and culminated in a sudden sharp, burning pain in my ear, followed by a rush of cold liquid. I screamed in agony as the thing holding my head down appeared to roll its large black eyes at me.\nFinally, I was released. I could move again. I jerked my body upward to find that they had all vanished from sight. A lone doorway opened at the opposite end of my table in the bright room.\nAs I emerged from the room back onto familiar wet road, I looked behind me. Nothing. As if the room, the ship, whatever it was, never existed. In my hand, I felt a foreign object was now in my grasp. I glanced down to see what I was holding.\nIt was a lollipop.",
        "summary": [
            "A man is abducted from his car while drinking a soda by a beam of light.",
            "He wakes up naked and restrained on a cold metallic table inside an all-white room.",
            "Strange alien beings attempt to insert a long instrument filled with blue liquid into his ear, causing him immense pain.",
            "He protests and shouts at them to stop.",
            "A female voice scolds him for wasting the aliens' time and being ridiculous.",
            "After another painful attempt, he is suddenly released from the restraints and finds himself back on a wet road, with no sign of the alien ship or room.",
            "However, he notices he is now holding a lollipop in his hand."
        ],
        "errors": [
            0,
            1,
            0,
            1,
            1,
            0,
            1
        ],
        "story-id": 3,
        "explanations": [
            "There is no evidence the man was in his car.",
            "The instrument doesn't cause him pain on the first attempt because the figures stop before they insert it.",
            "He doesn't just find himself back on the road, a door appears and he exits."
        ],
        "claims": [
            "A man is abducted from his car while he is drinking a soda by a beam of light.",
            "The man wakes up naked and restrained on a cold metallic table inside an all-white room.",
            "Strange alien beings attempt to insert a long instrument filled with blue liquid into the man's ear.",
            "The insertion of the instrument causes the man immense pain.",
            "The man protests and shouts at the alien beings to stop.",
            "A female voice scolds the man for wasting the aliens' time and being ridiculous.",
            "After another painful attempt to insert the instrument, the man is suddenly released from the restraints.",
            "The man finds himself back on a wet road with no sign of the alien ship or room.",
            "The man notices he is holding a lollipop in his hand after being returned to the road."
        ],
        "split": "val",
        "model": "claude"
    },
    "9126a17d119b411c9909d3336d5c2b0f": {
        "label": 0,
        "difficulty": "hard",
        "story": "It started right on Kristen's birthday. Instead of the usual festivities and cake, Kristen's birthday seemed more like a funeral. Kristen's Dad and her little brother Christian sat quietly in black suits barely able to look at Kristen as they ate dinner. Kristen remembered when her older sister Amber got the same treatment 2 years prior.\n\"Thank you for a wonderful dinner Dad!\" Kristen said as she hugged her father.\n\"Of course dear\" her Dad muttered, barely holding back grief. \"Anything for my little girl's 21st\".\n\"Dad what is going to happen to Kristen?\" Christian asked.\nHer Dad did not respond, and continued to slowly eat.\n\"I'll be back,\" Kristen said awkwardly as she got up.\nAs she walked away, she could hear the sounds of her father crying in the dining room, and the pleas of her little brother for any semblance of an understanding to the situation.\nAs Kristen went into her room, she looked at the mirror on her closet door and screamed.\n\"My tooth is missing\" Kristen cried,\nAs she continued to stare into the mirror, she watched as each of her teeth slowly began to fade away. Kristen tried to call out to her father, but as she did her tongue begun to disappear as well. In a state of pure shock, Kristen's legs buckled and fell to the floor. As she tried to get up, Kristen looked on in horror as her feet began to retract into her calves.\n\"Dad what's happening to her!\" Christian screamed.\n\"Your damn mother happened Christian\" The Dad exclaimed between panicked breaths \"that witch sold us out for her own damn benefit!\"\nWhile Kristen's family was very well off now, for the first 12 years of her life they lived in extreme poverty. She remembered that almost overnight their luck began to turn around, and that shortly after her mother vanished without a trace. Kristen then recalled how her sister Kali disappeared from her dorm on her 21st birthday.\nAs Kristen pondered these things, she could feel her arms and legs going deeper into her torso as if her whole body was closing in on itself. She turned her head to look at the mirror, and to her horror saw that her whole body had begun to evaporate, leaving her with just her organs, spine, and head.\nPiece by piece, each of her remaining internal organs shrunk to the size of a pea before disappearing from sight. She could no longer hear the cries of her brother and father, but she could still feel her eyes closing in on themselves similar to how a hand closes into a fist. Finally after an excruciating 21 minutes, Kristen Santos had been reduced to a vile final memory. As her father and little brother got up, they turned around to see the youngest sibling Anne standing in the doorway.\n\"I'm so sorry Pumpkin\" the Dad muttered shakily as he picked her up. \"I'm so fucking sorry\".",
        "summary": [
            "On her 21st birthday, Kristen Santos experiences a strange phenomenon in which her body begins to disappear piece by piece.",
            "Her teeth, tongue, and extremities slowly fade away until she is left with just her organs, spine, and head.",
            "After 21 minutes, Kristen has been reduced to a memory and her father and brother can only look on in grief, knowing that her mother had sold them out for her own benefit.",
            "Kristen's sister Kali had also suffered the same fate on her 21st birthday.",
            "Kristen's father apologizes to her youngest sibling, Anne, as they pick her up in shock."
        ],
        "errors": [
            1,
            1,
            0,
            1,
            1
        ],
        "story-id": 4,
        "explanations": [
            "The brother is not in on knowing what the mother did or why."
        ],
        "claims": [
            "On her 21st birthday, Kristen Santos experiences her body beginning to disappear piece by piece.",
            "Kristen Santos's teeth disappear.",
            "Kristen Santos's tongue disappears.",
            "Kristen Santos's extremities fade away.",
            "After the disappearance of her teeth, tongue, and extremities, Kristen Santos is left with just her organs, spine, and head.",
            "After 21 minutes from the start of the phenomenon, Kristen Santos has been reduced to a memory.",
            "Kristen Santos's father and brother witness her reduction to a memory and feel grief.",
            "Kristen Santos's mother sold them out for her own benefit, leading to Kristen's condition.",
            "Kristen Santos's sister, Kali, experienced the same disappearing phenomenon on her 21st birthday.",
            "Kristen Santos's father apologizes to Anne, her youngest sibling.",
            "Kristen Santos's father and brother pick up Anne in shock after Kristen's disappearance."
        ],
        "split": "val",
        "model": "text-davinci-003"
    },
    "836ed1ca86dd4918a13cd363751e1932": {
        "label": 0,
        "difficulty": "easy",
        "story": "It started right on Kristen's birthday. Instead of the usual festivities and cake, Kristen's birthday seemed more like a funeral. Kristen's Dad and her little brother Christian sat quietly in black suits barely able to look at Kristen as they ate dinner. Kristen remembered when her older sister Amber got the same treatment 2 years prior.\n\"Thank you for a wonderful dinner Dad!\" Kristen said as she hugged her father.\n\"Of course dear\" her Dad muttered, barely holding back grief. \"Anything for my little girl's 21st\".\n\"Dad what is going to happen to Kristen?\" Christian asked.\nHer Dad did not respond, and continued to slowly eat.\n\"I'll be back,\" Kristen said awkwardly as she got up.\nAs she walked away, she could hear the sounds of her father crying in the dining room, and the pleas of her little brother for any semblance of an understanding to the situation.\nAs Kristen went into her room, she looked at the mirror on her closet door and screamed.\n\"My tooth is missing\" Kristen cried,\nAs she continued to stare into the mirror, she watched as each of her teeth slowly began to fade away. Kristen tried to call out to her father, but as she did her tongue begun to disappear as well. In a state of pure shock, Kristen's legs buckled and fell to the floor. As she tried to get up, Kristen looked on in horror as her feet began to retract into her calves.\n\"Dad what's happening to her!\" Christian screamed.\n\"Your damn mother happened Christian\" The Dad exclaimed between panicked breaths \"that witch sold us out for her own damn benefit!\"\nWhile Kristen's family was very well off now, for the first 12 years of her life they lived in extreme poverty. She remembered that almost overnight their luck began to turn around, and that shortly after her mother vanished without a trace. Kristen then recalled how her sister Kali disappeared from her dorm on her 21st birthday.\nAs Kristen pondered these things, she could feel her arms and legs going deeper into her torso as if her whole body was closing in on itself. She turned her head to look at the mirror, and to her horror saw that her whole body had begun to evaporate, leaving her with just her organs, spine, and head.\nPiece by piece, each of her remaining internal organs shrunk to the size of a pea before disappearing from sight. She could no longer hear the cries of her brother and father, but she could still feel her eyes closing in on themselves similar to how a hand closes into a fist. Finally after an excruciating 21 minutes, Kristen Santos had been reduced to a vile final memory. As her father and little brother got up, they turned around to see the youngest sibling Anne standing in the doorway.\n\"I'm so sorry Pumpkin\" the Dad muttered shakily as he picked her up. \"I'm so fucking sorry\".",
        "summary": [
            "Kristen's 21st birthday turns out to be a horrific one as she begins to disappear and her family is powerless to save her.",
            "Her father and younger brother know what's happening, but they are unable to stop it as they watch Kristen slowly evaporate into nothingness.",
            "It is revealed that Kristen's mother had made a deal with some unknown entity to bring her family wealth, but at a terrible cost.",
            "The story ends with Kristen's father carrying her younger sister away and apologizing for what has happened."
        ],
        "errors": [
            1,
            0,
            1,
            0
        ],
        "story-id": 4,
        "explanations": [
            "Her younger brother does not know what is happening and is asking the dad.",
            "The dad picks the younger sister up, but there is no specification that he is carrying her away."
        ],
        "claims": [
            "Kristen's 21st birthday results in her beginning to disappear",
            "Kristen's family is unable to save her as she disappears",
            "Kristen's father and younger brother are aware of the cause of her disappearance",
            "Kristen's father and younger brother are unable to stop Kristen from disappearing",
            "Kristen slowly evaporates into nothingness",
            "Kristen's mother had previously made a deal with an unknown entity",
            "The deal made by Kristen's mother was intended to bring her family wealth",
            "The deal made by Kristen's mother came with a terrible cost",
            "The story concludes with Kristen's father carrying her younger sister",
            "Kristen's father apologizes for what has happened at the end of the story."
        ],
        "split": "val",
        "model": "chatGPT"
    },
    "d36fc509876d488497ed6c535e004961": {
        "label": 0,
        "difficulty": "hard",
        "story": "It started right on Kristen's birthday. Instead of the usual festivities and cake, Kristen's birthday seemed more like a funeral. Kristen's Dad and her little brother Christian sat quietly in black suits barely able to look at Kristen as they ate dinner. Kristen remembered when her older sister Amber got the same treatment 2 years prior.\n\"Thank you for a wonderful dinner Dad!\" Kristen said as she hugged her father.\n\"Of course dear\" her Dad muttered, barely holding back grief. \"Anything for my little girl's 21st\".\n\"Dad what is going to happen to Kristen?\" Christian asked.\nHer Dad did not respond, and continued to slowly eat.\n\"I'll be back,\" Kristen said awkwardly as she got up.\nAs she walked away, she could hear the sounds of her father crying in the dining room, and the pleas of her little brother for any semblance of an understanding to the situation.\nAs Kristen went into her room, she looked at the mirror on her closet door and screamed.\n\"My tooth is missing\" Kristen cried,\nAs she continued to stare into the mirror, she watched as each of her teeth slowly began to fade away. Kristen tried to call out to her father, but as she did her tongue begun to disappear as well. In a state of pure shock, Kristen's legs buckled and fell to the floor. As she tried to get up, Kristen looked on in horror as her feet began to retract into her calves.\n\"Dad what's happening to her!\" Christian screamed.\n\"Your damn mother happened Christian\" The Dad exclaimed between panicked breaths \"that witch sold us out for her own damn benefit!\"\nWhile Kristen's family was very well off now, for the first 12 years of her life they lived in extreme poverty. She remembered that almost overnight their luck began to turn around, and that shortly after her mother vanished without a trace. Kristen then recalled how her sister Kali disappeared from her dorm on her 21st birthday.\nAs Kristen pondered these things, she could feel her arms and legs going deeper into her torso as if her whole body was closing in on itself. She turned her head to look at the mirror, and to her horror saw that her whole body had begun to evaporate, leaving her with just her organs, spine, and head.\nPiece by piece, each of her remaining internal organs shrunk to the size of a pea before disappearing from sight. She could no longer hear the cries of her brother and father, but she could still feel her eyes closing in on themselves similar to how a hand closes into a fist. Finally after an excruciating 21 minutes, Kristen Santos had been reduced to a vile final memory. As her father and little brother got up, they turned around to see the youngest sibling Anne standing in the doorway.\n\"I'm so sorry Pumpkin\" the Dad muttered shakily as he picked her up. \"I'm so fucking sorry\".",
        "summary": [
            "On Kristen's 21st birthday, she begins to physically disappear and evaporate into nothing.",
            "As this is happening, she recalls that two years prior her older sister Amber went through the same horrifying experience on her 21st birthday.",
            "Kristen realizes that her family's improved fortune over the last 12 years likely came as the result of a sinister deal made by her mother, who vanished around that time.",
            "By the end of the story, Kristen is reduced to nothing but a memory as her internal organs and body shrink and disappear.",
            "Her father is left with immense regret over the loss of his two eldest daughters.",
            "The story suggests the family's fortune came at the cost of the lives of the mother's first two children."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            0,
            0
        ],
        "story-id": 4,
        "explanations": [
            "It seems the three eldest daughters have been lost, not two (Amber, Kali, and the protagonist).",
            "It seems the three eldest daughters have been lost, not two (Amber, Kali, and the protagonist)."
        ],
        "claims": [
            "Kristen begins to physically disappear and evaporate into nothing on her 21st birthday.",
            "As Kristen is disappearing, she recalls that her older sister Amber also disappeared on her 21st birthday two years prior.",
            "Kristen realizes that her family's improved fortune over the last 12 years is likely the result of a deal made by her mother.",
            "Kristen's mother vanished around 12 years ago.",
            "By the end of the story, Kristen has disappeared completely, leaving no physical form behind.",
            "Kristen's internal organs and body shrink and disappear as part of her vanishing.",
            "Kristen's father feels immense regret over the loss of his two eldest daughters, Kristen and Amber.",
            "The story suggests that the family's fortune was gained at the cost of the lives of the mother's first two children, Kristen and Amber."
        ],
        "split": "val",
        "model": "claude"
    },
    "c54782a400054013b982a02f77e95e39": {
        "label": 0,
        "difficulty": "hard",
        "story": "\"Don't worry.\" said Spiegel jovially \"I can do this without killing more than, say, twenty to thirty million people.\"\nThe official swallowed dryly. \"Twenty to thirty million...you are talking about mass murder, Mr. Spiegel. My government has agreed to work with you only under the condition that there is as little bloodshed as possible.\"\nSpiegel grinned. \"And just so it will be, Sir. But you have to remember that we are talking about bringing an empire to its knees. I will have to give my special treatment to at least a few cities and army bases. Imagine all the bloodshed there would be, if you had to work with atomic bombs, gas and conventional troops instead.\" He giggled childishly. \"No, Sir, my ways may not be pretty, but they are still more humane than starting a world war.\"\nThe officials turned white. \"So, what you are saying is...these abilities that you have demonstrated...you can do that to entire cities.\"\nSpiegel beamed proudly. \"Of course. Cities, continents, planets. Eventually I will put entire entire star systems through the wringer. But that is still quite a while in the future.\"\n\"...star systems...\" mouthed the official silently.\n\"Sure.\" Spiegel said casually \"What, did you not think that I could see the future? I am able to mangle the space-time-continuum, Sir. I know exactly what the future holds.\"\n\"And what does the future hold?\" asked the official breathlessly.\n\"For your kind? Death, destruction and madness. A lot of that inflicted by my hands. But that really does not matter in the grand scheme of things.\"\nThe official opened a drawer of his desk and retrieved a revolver. \"And what\" he said with a voice that barely rose above a whisper \"What if I shoot you here and now, like a rabid dog?\"\n\"Then I would die here\" said Spiegel \"But at the same time I would walk into an office on the other side of the planet and offer someone to conquer your country for them. You see, I do not care which country will eventually unite the planet and build a space-faring civilization. Only that it is done.\"\nAnd with that he turned around and walked out of the door. The official could hear him whistle why he walked down the corridor.",
        "summary": [
            "Mr. Spiegel is a powerful individual who has demonstrated the ability to manipulate the space-time continuum.",
            "He has been hired by an official's government to bring an empire to its knees without killing more than twenty to thirty million people.",
            "The official is shocked to learn that Spiegel can do this to entire cities, continents and even planets, and is even more horrified when Spiegel reveals that he can also see the future and knows that death and destruction will be inflicted by his hands.",
            "When the official threatens to shoot Spiegel like a rabid dog, Spiegel calmly reveals that it wouldn't matter, as he would still find someone else to conquer the official's country.",
            "He then leaves, whistling as he goes."
        ],
        "errors": [
            1,
            0,
            1,
            1,
            1
        ],
        "story-id": 5,
        "explanations": [
            "The government agreed to work with him only if there was as little bloodshed as possible. They did not agree to hire him to cause tens of millions of deaths."
        ],
        "claims": [
            "Mr. Spiegel is capable of manipulating the space-time continuum.",
            "Mr. Spiegel has been hired by an official's government to bring an empire to its knees.",
            "The plan to bring the empire to its knees involves not killing more than twenty to thirty million people.",
            "The official is shocked to learn that Mr. Spiegel can manipulate entire cities, continents, and planets.",
            "The official is horrified upon discovering Mr. Spiegel's ability to see the future.",
            "Mr. Spiegel predicts that death and destruction will be caused by his actions.",
            "The official threatens to shoot Mr. Spiegel, comparing him to a rabid dog.",
            "Mr. Spiegel claims that shooting him would be futile as he would still find someone else to conquer the official's country.",
            "Mr. Spiegel leaves the scene while whistling."
        ],
        "split": "val",
        "model": "text-davinci-003"
    },
    "6b01d59b368d4b3a8d898b216a894f4d": {
        "label": 1,
        "difficulty": "",
        "story": "\"Don't worry.\" said Spiegel jovially \"I can do this without killing more than, say, twenty to thirty million people.\"\nThe official swallowed dryly. \"Twenty to thirty million...you are talking about mass murder, Mr. Spiegel. My government has agreed to work with you only under the condition that there is as little bloodshed as possible.\"\nSpiegel grinned. \"And just so it will be, Sir. But you have to remember that we are talking about bringing an empire to its knees. I will have to give my special treatment to at least a few cities and army bases. Imagine all the bloodshed there would be, if you had to work with atomic bombs, gas and conventional troops instead.\" He giggled childishly. \"No, Sir, my ways may not be pretty, but they are still more humane than starting a world war.\"\nThe officials turned white. \"So, what you are saying is...these abilities that you have demonstrated...you can do that to entire cities.\"\nSpiegel beamed proudly. \"Of course. Cities, continents, planets. Eventually I will put entire entire star systems through the wringer. But that is still quite a while in the future.\"\n\"...star systems...\" mouthed the official silently.\n\"Sure.\" Spiegel said casually \"What, did you not think that I could see the future? I am able to mangle the space-time-continuum, Sir. I know exactly what the future holds.\"\n\"And what does the future hold?\" asked the official breathlessly.\n\"For your kind? Death, destruction and madness. A lot of that inflicted by my hands. But that really does not matter in the grand scheme of things.\"\nThe official opened a drawer of his desk and retrieved a revolver. \"And what\" he said with a voice that barely rose above a whisper \"What if I shoot you here and now, like a rabid dog?\"\n\"Then I would die here\" said Spiegel \"But at the same time I would walk into an office on the other side of the planet and offer someone to conquer your country for them. You see, I do not care which country will eventually unite the planet and build a space-faring civilization. Only that it is done.\"\nAnd with that he turned around and walked out of the door. The official could hear him whistle why he walked down the corridor.",
        "summary": [
            "Spiegel is a man with the ability to cause destruction on a massive scale.",
            "He has been hired by a government to bring down an empire, but he warns that his methods will result in the deaths of millions.",
            "Spiegel claims to be able to see the future and reveals that he plans to continue causing destruction on an even greater scale.",
            "When the official he is speaking with threatens to shoot him, Spiegel reveals that he is not loyal to any one country and will simply offer his services to someone else.",
            "He leaves, whistling happily, while the official is left contemplating the destructive power of Spiegel's abilities."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 5,
        "explanations": [],
        "claims": [
            "Spiegel is a man with the ability to cause destruction on a massive scale.",
            "Spiegel has been hired by a government to bring down an empire.",
            "Spiegel warns that his methods will result in the deaths of millions.",
            "Spiegel claims to be able to see the future.",
            "Spiegel reveals plans to continue causing destruction on an even greater scale.",
            "An official threatens to shoot Spiegel during their conversation.",
            "Spiegel reveals that he is not loyal to any one country.",
            "Spiegel states he will offer his services to someone else if necessary.",
            "Spiegel leaves the meeting whistling happily.",
            "The official is left contemplating the destructive power of Spiegel's abilities."
        ],
        "split": "val",
        "model": "chatGPT"
    },
    "672780c97df6459e8f1956d30d90284b": {
        "label": 0,
        "difficulty": "hard",
        "story": "\"Don't worry.\" said Spiegel jovially \"I can do this without killing more than, say, twenty to thirty million people.\"\nThe official swallowed dryly. \"Twenty to thirty million...you are talking about mass murder, Mr. Spiegel. My government has agreed to work with you only under the condition that there is as little bloodshed as possible.\"\nSpiegel grinned. \"And just so it will be, Sir. But you have to remember that we are talking about bringing an empire to its knees. I will have to give my special treatment to at least a few cities and army bases. Imagine all the bloodshed there would be, if you had to work with atomic bombs, gas and conventional troops instead.\" He giggled childishly. \"No, Sir, my ways may not be pretty, but they are still more humane than starting a world war.\"\nThe officials turned white. \"So, what you are saying is...these abilities that you have demonstrated...you can do that to entire cities.\"\nSpiegel beamed proudly. \"Of course. Cities, continents, planets. Eventually I will put entire entire star systems through the wringer. But that is still quite a while in the future.\"\n\"...star systems...\" mouthed the official silently.\n\"Sure.\" Spiegel said casually \"What, did you not think that I could see the future? I am able to mangle the space-time-continuum, Sir. I know exactly what the future holds.\"\n\"And what does the future hold?\" asked the official breathlessly.\n\"For your kind? Death, destruction and madness. A lot of that inflicted by my hands. But that really does not matter in the grand scheme of things.\"\nThe official opened a drawer of his desk and retrieved a revolver. \"And what\" he said with a voice that barely rose above a whisper \"What if I shoot you here and now, like a rabid dog?\"\n\"Then I would die here\" said Spiegel \"But at the same time I would walk into an office on the other side of the planet and offer someone to conquer your country for them. You see, I do not care which country will eventually unite the planet and build a space-faring civilization. Only that it is done.\"\nAnd with that he turned around and walked out of the door. The official could hear him whistle why he walked down the corridor.",
        "summary": [
            "The story is about a man named Spiegel who has powerful abilities, including the ability to manipulate space, time, and the future.",
            "He meets with an official from a government, claiming that he can help the government conquer an empire and bring it to its knees, with a limited amount of bloodshed, around 20-30 million deaths.",
            "Spiegel boasts about his powerful abilities, saying he can inflict destruction on entire cities, continents, planets, and eventually even star systems.",
            "He claims to know the future, in which he foresees death and destruction brought about in part by his own hands.",
            "When the official threatens to shoot Spiegel, Spiegel claims that this would not stop him, as he would simply appear elsewhere and make a deal with another country.",
            "The story depicts Spiegel as a menacing, power-hungry figure who cares little for human life.",
            "His extreme powers and disregard for morality pose a grave threat to humanity."
        ],
        "errors": [
            0,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 5,
        "explanations": [
            "We don't know that he can manipulate the future, only that he can see the future."
        ],
        "claims": [
            "The story features a man named Spiegel who has the ability to manipulate space.",
            "Spiegel has the ability to manipulate time.",
            "Spiegel has the ability to manipulate the future.",
            "Spiegel meets with an official from a government.",
            "Spiegel offers to help the government conquer an empire with around 20-30 million deaths.",
            "Spiegel claims he can inflict destruction on entire cities.",
            "Spiegel claims he can inflict destruction on continents.",
            "Spiegel claims he can inflict destruction on planets.",
            "Spiegel claims he can inflict destruction on star systems.",
            "Spiegel claims to know the future, foreseeing death and destruction caused in part by himself.",
            "An official threatens to shoot Spiegel during their meeting.",
            "Spiegel claims that being shot would not stop him because he would simply appear elsewhere.",
            "Spiegel suggests he would make a deal with another country if he were shot.",
            "The story portrays Spiegel as a menacing figure.",
            "The story portrays Spiegel as power-hungry.",
            "Spiegel is depicted as having little regard for human life.",
            "Spiegel's powers and disregard for morality are presented as a threat to humanity."
        ],
        "split": "val",
        "model": "claude"
    },
    "11b76f7ce5184477a4cda3e0e408ef09": {
        "label": 0,
        "difficulty": "hard",
        "story": "The rescue team entered the cave and was led to a vertical shaft that was extremely narrow. The cave guide said that one of his participants had left of the group and had fallen down this blocked off section of cave.\nThey called down the shaft but they could only faintly hear him so they knew he had to be pretty far down. They shouted that they were going to drop a radio down to him and after a few minutes, sent it down. The rescue took multiple days and over the course of the operation the team took turns speaking with the man who was surprisingly calm.\nHe told them he had very little room to move and that he was hungry. He talked about getting out and how much he wanted to see the sun and the team gave him updates on how they had to request especially equipment be flown in for the rescue.\nWhen they finally extracted him, he was ecstatic, and he went around to each member of the team hugging them and introducing himself. The team was perplexed because each of them had spoken to him at great length over the prior few days.\nBefore they could say anything, however, he profusely apologized for losing their radio. He said when they had dropped it down, it hit his hand quite hard and it fell, clattering down the hole underneath him. He said he never got the opportunity to use it, and apologized again.\nThe rescue team looked at each other, just as the radio flared to life and and a voice identical to the man standing in front of them asked \"when are you guys coming to get me\"?",
        "summary": [
            "The rescue team went into a cave to rescue a man who had fallen down a vertical shaft.",
            "The team took turns talking to him over a radio, providing him with updates and encouragement.",
            "When they finally extracted him, he thanked them for rescuing him and apologized for losing their radio.",
            "When the team was about to leave, the radio came to life again and the same voice asked when they were coming to get him."
        ],
        "errors": [
            1,
            1,
            1,
            0
        ],
        "story-id": 6,
        "explanations": [
            "There is no evidence that the team was about to leave when the radio comes to life again."
        ],
        "claims": [
            "The rescue team entered a cave to rescue a man.",
            "The man had fallen down a vertical shaft in the cave.",
            "Members of the rescue team took turns communicating with the man using a radio.",
            "The rescue team provided the man with updates on the rescue operation.",
            "The rescue team offered encouragement to the man through the radio.",
            "The rescue team successfully extracted the man from the cave.",
            "After being rescued, the man thanked the rescue team.",
            "After being rescued, the man apologized for losing the rescue team's radio.",
            "As the rescue team was preparing to leave the cave, the radio they had used to communicate with the man became active again.",
            "The same voice that the rescue team had been communicating with asked over the radio when the rescue team was coming to get him."
        ],
        "split": "val",
        "model": "text-davinci-003"
    },
    "3440f56c79224d59baab98041514a6f3": {
        "label": 0,
        "difficulty": "hard",
        "story": "The rescue team entered the cave and was led to a vertical shaft that was extremely narrow. The cave guide said that one of his participants had left of the group and had fallen down this blocked off section of cave.\nThey called down the shaft but they could only faintly hear him so they knew he had to be pretty far down. They shouted that they were going to drop a radio down to him and after a few minutes, sent it down. The rescue took multiple days and over the course of the operation the team took turns speaking with the man who was surprisingly calm.\nHe told them he had very little room to move and that he was hungry. He talked about getting out and how much he wanted to see the sun and the team gave him updates on how they had to request especially equipment be flown in for the rescue.\nWhen they finally extracted him, he was ecstatic, and he went around to each member of the team hugging them and introducing himself. The team was perplexed because each of them had spoken to him at great length over the prior few days.\nBefore they could say anything, however, he profusely apologized for losing their radio. He said when they had dropped it down, it hit his hand quite hard and it fell, clattering down the hole underneath him. He said he never got the opportunity to use it, and apologized again.\nThe rescue team looked at each other, just as the radio flared to life and and a voice identical to the man standing in front of them asked \"when are you guys coming to get me\"?",
        "summary": [
            "A rescue team goes into a narrow cave to find a participant who had fallen down a blocked-off section.",
            "They drop a radio down to him and start a multiple day rescue operation, during which they take turns speaking with the man who remains surprisingly calm.",
            "When they finally extract him, he apologizes for losing their radio, but before they can say anything, the radio flares to life with the same voice asking when they will come to get him.",
            "The team realizes that the man they rescued was not the one who had fallen down the shaft, and they wonder who they had actually been talking to."
        ],
        "errors": [
            0,
            1,
            1,
            0
        ],
        "story-id": 6,
        "explanations": [
            "The shaft is narrow, not the cave.",
            "It is not clear that the man they rescued is not the man who had fallen down the shaft."
        ],
        "claims": [
            "A rescue team enters a narrow cave to locate a participant who had fallen into a restricted area.",
            "The rescue team drops a radio down to the participant in the blocked-off section.",
            "The rescue operation to extract the participant takes multiple days.",
            "Members of the rescue team take turns communicating with the man via the radio.",
            "The man trapped in the cave remains calm throughout the rescue operation.",
            "Upon being extracted from the cave, the man apologizes for losing the radio provided by the rescue team.",
            "After the man's extraction, the radio receives a transmission with the same voice asking for rescue.",
            "The rescue team realizes the person they rescued was not the participant who originally fell down the shaft.",
            "The rescue team is left wondering about the identity of the person they have been communicating with via the radio."
        ],
        "split": "val",
        "model": "chatGPT"
    },
    "54d7054c6c2a434cb1a02da48e505e47": {
        "label": 0,
        "difficulty": "hard",
        "story": "The rescue team entered the cave and was led to a vertical shaft that was extremely narrow. The cave guide said that one of his participants had left of the group and had fallen down this blocked off section of cave.\nThey called down the shaft but they could only faintly hear him so they knew he had to be pretty far down. They shouted that they were going to drop a radio down to him and after a few minutes, sent it down. The rescue took multiple days and over the course of the operation the team took turns speaking with the man who was surprisingly calm.\nHe told them he had very little room to move and that he was hungry. He talked about getting out and how much he wanted to see the sun and the team gave him updates on how they had to request especially equipment be flown in for the rescue.\nWhen they finally extracted him, he was ecstatic, and he went around to each member of the team hugging them and introducing himself. The team was perplexed because each of them had spoken to him at great length over the prior few days.\nBefore they could say anything, however, he profusely apologized for losing their radio. He said when they had dropped it down, it hit his hand quite hard and it fell, clattering down the hole underneath him. He said he never got the opportunity to use it, and apologized again.\nThe rescue team looked at each other, just as the radio flared to life and and a voice identical to the man standing in front of them asked \"when are you guys coming to get me\"?",
        "summary": [
            "A rescue team enters a cave in order to save a man who has fallen down a narrow vertical shaft.",
            "After days of work, they are able to extract him from the shaft.",
            "However, once he is out, he proceeds to hug and introduce himself to each member of the team, even though they had spoken extensively with him over the radio during the multi-day rescue operation.",
            "Perplexed, the team then realizes that the man never actually had the radio, and that the voice they heard was someone else trapped further down the shaft.",
            "The man they rescued had merely apologized for losing the radio when they first dropped it down, but in fact it had fallen past him to someone trapped below.",
            "The story ends with the radio flaring to life again and the voice of the other trapped person asking when the rescue team will come for him."
        ],
        "errors": [
            1,
            1,
            1,
            0,
            1,
            1
        ],
        "story-id": 6,
        "explanations": [
            "States with certainty things that are ambiguous in the story (e.g, what the team realizes, who is trapped below)."
        ],
        "claims": [
            "A rescue team enters a cave to save a man who has fallen down a narrow vertical shaft.",
            "After days of work, the rescue team is able to extract the man from the shaft.",
            "Once out of the shaft, the man hugs and introduces himself to each member of the rescue team.",
            "The rescue team had spoken extensively with someone they believed to be the man over the radio during the multi-day rescue operation.",
            "The rescue team is perplexed by the man's actions because they believed they had been communicating with him via radio.",
            "The team realizes that the man never actually had the radio.",
            "The voice the rescue team heard over the radio was someone else trapped further down the shaft.",
            "The man they rescued had apologized for losing the radio when it was first dropped down to him.",
            "In reality, the radio had fallen past the rescued man to someone else trapped below him.",
            "The story ends with the radio flaring to life again.",
            "The voice of the other trapped person asks over the radio when the rescue team will come for him."
        ],
        "split": "val",
        "model": "claude"
    },
    "a200ddea173241fc91ccb2c5d5a7edc0": {
        "label": 1,
        "difficulty": "",
        "story": "Destiny couldn't wait to see Heaven.\nThey had been best friends for years- since second grade. They came to the playground nearly every afternoon that summer for a game of tag, to draw with chalk, or to just laugh together.\nBut lately she'd been noticing some strange things about Heaven. For one, she'd been wearing the same dirty clothes for a week. She also noticed the other kids weren't talking to Heaven or playing with her anymore. That didn't matter to Destiny. Heaven would always be her friend.\nThat afternoon Destiny stopped by her friend's house on the way to the park. She didn't know much about Heaven's family, just that Heaven spent most of her days outside. She didn't like spending time at home.\nA man in a dirty shirt answered the door. She wasn't sure if this was Heaven's dad or not.\n\"Hey, is Heaven coming to the playground today?\"\nHe stared at her for a long time.\n\"Come on in. You can ask her.\"\nHe led her into the kitchen. They turned the corner and he opened another door, revealing a basement staircase.\n\"She's down there.\"\nDestiny was unsure- but she trusted parents.\n\"She is?\" She took a tentative step.\n\"Yep. She's been playing down there all week.\"\nHe gave her a shove, and she tumbled down the stairs. Shocked, she looked back up at the man in the doorframe.\n\"Say hello to Heaven for me, won't you?\" He said, slamming the door.\nDestiny screamed as she was plunged into darkness. In her confusion she stumbled to the cellar floor. But instead of landing on soft dirt, her hands felt cold flesh, and her fingers caught in a tangle of hair.\nShe tried to get up quickly, but froze when she heard a voice- Heaven's voice- whisper in her ear:\n\"It's OK. Now we can play down here together.\"",
        "summary": [
            "Destiny visits her best friend Heaven's house on her way to the playground and is shocked when Heaven's father leads her to the basement.",
            "When the door slams shut, Destiny is plunged into darkness and finds Heaven on the floor.",
            "Heaven reassures her that they can now play in the basement together."
        ],
        "errors": [
            1,
            1,
            1
        ],
        "story-id": 7,
        "explanations": [],
        "claims": [
            "Destiny visits Heaven's house on her way to the playground.",
            "Destiny is shocked when Heaven's father leads her to the basement.",
            "The door slams shut after Destiny is led into the basement.",
            "Destiny finds herself plunged into darkness after the door slams shut.",
            "Destiny finds Heaven on the floor in the basement.",
            "Heaven reassures Destiny that they can now play together in the basement."
        ],
        "split": "val",
        "model": "text-davinci-003"
    },
    "1c19e25cbfe64b269042b3bdbf916aca": {
        "label": 1,
        "difficulty": "",
        "story": "Destiny couldn't wait to see Heaven.\nThey had been best friends for years- since second grade. They came to the playground nearly every afternoon that summer for a game of tag, to draw with chalk, or to just laugh together.\nBut lately she'd been noticing some strange things about Heaven. For one, she'd been wearing the same dirty clothes for a week. She also noticed the other kids weren't talking to Heaven or playing with her anymore. That didn't matter to Destiny. Heaven would always be her friend.\nThat afternoon Destiny stopped by her friend's house on the way to the park. She didn't know much about Heaven's family, just that Heaven spent most of her days outside. She didn't like spending time at home.\nA man in a dirty shirt answered the door. She wasn't sure if this was Heaven's dad or not.\n\"Hey, is Heaven coming to the playground today?\"\nHe stared at her for a long time.\n\"Come on in. You can ask her.\"\nHe led her into the kitchen. They turned the corner and he opened another door, revealing a basement staircase.\n\"She's down there.\"\nDestiny was unsure- but she trusted parents.\n\"She is?\" She took a tentative step.\n\"Yep. She's been playing down there all week.\"\nHe gave her a shove, and she tumbled down the stairs. Shocked, she looked back up at the man in the doorframe.\n\"Say hello to Heaven for me, won't you?\" He said, slamming the door.\nDestiny screamed as she was plunged into darkness. In her confusion she stumbled to the cellar floor. But instead of landing on soft dirt, her hands felt cold flesh, and her fingers caught in a tangle of hair.\nShe tried to get up quickly, but froze when she heard a voice- Heaven's voice- whisper in her ear:\n\"It's OK. Now we can play down here together.\"",
        "summary": [
            "Destiny and Heaven are best friends who often play together at the park.",
            "Destiny notices some strange changes in Heaven's behavior, such as wearing the same clothes for a week and no longer being friends with other kids.",
            "When Destiny goes to Heaven's house to ask her to play, a man answers the door and leads her to the basement where Heaven has been playing for a week.",
            "The man shoves Destiny down the stairs, leaving her trapped in the basement with Heaven, who says they can now play together."
        ],
        "errors": [
            1,
            1,
            1,
            1
        ],
        "story-id": 7,
        "explanations": [],
        "claims": [
            "Destiny and Heaven are best friends.",
            "Destiny and Heaven often play together at the park.",
            "Destiny notices that Heaven has been wearing the same clothes for a week.",
            "Destiny observes that Heaven is no longer friends with other kids.",
            "Destiny visits Heaven's house to ask her to play.",
            "A man answers the door at Heaven's house when Destiny visits.",
            "The man leads Destiny to the basement.",
            "Heaven has been playing in the basement for a week.",
            "The man shoves Destiny down the stairs.",
            "Destiny is trapped in the basement with Heaven.",
            "Heaven tells Destiny they can now play together."
        ],
        "split": "val",
        "model": "chatGPT"
    },
    "179476e1dcda44e69700959efe0e3aa7": {
        "label": 0,
        "difficulty": "easy",
        "story": "Destiny couldn't wait to see Heaven.\nThey had been best friends for years- since second grade. They came to the playground nearly every afternoon that summer for a game of tag, to draw with chalk, or to just laugh together.\nBut lately she'd been noticing some strange things about Heaven. For one, she'd been wearing the same dirty clothes for a week. She also noticed the other kids weren't talking to Heaven or playing with her anymore. That didn't matter to Destiny. Heaven would always be her friend.\nThat afternoon Destiny stopped by her friend's house on the way to the park. She didn't know much about Heaven's family, just that Heaven spent most of her days outside. She didn't like spending time at home.\nA man in a dirty shirt answered the door. She wasn't sure if this was Heaven's dad or not.\n\"Hey, is Heaven coming to the playground today?\"\nHe stared at her for a long time.\n\"Come on in. You can ask her.\"\nHe led her into the kitchen. They turned the corner and he opened another door, revealing a basement staircase.\n\"She's down there.\"\nDestiny was unsure- but she trusted parents.\n\"She is?\" She took a tentative step.\n\"Yep. She's been playing down there all week.\"\nHe gave her a shove, and she tumbled down the stairs. Shocked, she looked back up at the man in the doorframe.\n\"Say hello to Heaven for me, won't you?\" He said, slamming the door.\nDestiny screamed as she was plunged into darkness. In her confusion she stumbled to the cellar floor. But instead of landing on soft dirt, her hands felt cold flesh, and her fingers caught in a tangle of hair.\nShe tried to get up quickly, but froze when she heard a voice- Heaven's voice- whisper in her ear:\n\"It's OK. Now we can play down here together.\"",
        "summary": [
            "Destiny goes to visit her best friend Heaven at her house.",
            "Heaven's father lets Destiny into the house and leads her down to the basement, claiming Heaven has been playing down there all week.",
            "Once Destiny reaches the bottom of the stairs, she discovers Heaven's dead body in the dark basement.",
            "Heaven's ghost then whispers to Destiny that now they can play together in the basement.",
            "The story suggests that Heaven's father was responsible for her death and lured Destiny into the basement to harm or kill her as well."
        ],
        "errors": [
            1,
            0,
            0,
            0,
            1
        ],
        "story-id": 7,
        "explanations": [
            "The father doesn't lead her down to the basement, he pushes her down the stairs. Additionally, the summary has some ambiguity around whether the man is Heaven's father.",
            "Destiny finds cold flesh, but it is ambiguous whether it is Heaven's dead body.",
            "Destiny hears Heaven's voice, but it is ambiguous whether it is her ghost."
        ],
        "claims": [
            "Destiny visits Heaven's house to see her best friend, Heaven.",
            "Heaven's father answers the door when Destiny arrives.",
            "Heaven's father tells Destiny that Heaven has been playing in the basement all week.",
            "Heaven's father leads Destiny to the basement.",
            "Destiny finds Heaven's dead body at the bottom of the basement stairs.",
            "The basement is dark when Destiny discovers Heaven's body.",
            "Heaven's ghost whispers to Destiny that they can now play together in the basement.",
            "The story implies Heaven's father was responsible for Heaven's death.",
            "The story suggests Heaven's father lured Destiny into the basement with the intention to harm or kill her."
        ],
        "split": "val",
        "model": "claude"
    },
    "991c2594c74d4fc48f9a1670de5b3ef9": {
        "label": 1,
        "difficulty": "",
        "story": "\"Will you be my valentine?\" I prayed to hear those three magical letters, and my prayer was heard.\n\"Yes, of course!\" Her heart was mine. The next day, February 14th, I spent all day dreaming of her. Her deep blue eyes, her long, black hair, but most importantly, her heart. Her heart was mine. And then I noticed the time. She would be here in half an hour, and I hadn't even begun to prepare a meal! The pantry door flew open for me to search for something suitable for the occasion. Cauliflower? Mashed potatoes? Pasta with white sauce? That was my best bet. As I finished plating the meal, the daydreams returned. She was the most beautiful woman I had ever met. And she was mine. Her heart was mine. I placed a white rose against the end of the plate. Just as I had done this, there was a knock at the door.\nMy hand rested against the knob, ready to open the door, before feeling a moment of sorrow. Once the moment passed, I turned the knob and welcomed her inside. She wore a beautiful white dress. It was perfect. I guided her to the dining room, and she reacted just as every valentine in the past. Her face was one of confusion.\n\"There's only one plate,\" she said, puzzled. Just like every valentine in the past. I shushed her. Quietly, I pulled out the knife that had been hidden. I turned to face her and thrust the knife into her chest, careful not to penetrate her heart. She was dead before she could react. Her heart was then carved out. Her blood stained her dress red. Red, the color of love. Her heart was carefully set on the plate. It colored the sauce red. Red, the color of love. And finally, it stained the rose red. Red, the color of love. I feasted the same as I had every year prior, savoring every bite. Her heart was mine, after all.\nThen, it was time to rest again, and in 11 months, I would find a new love. A new heart to call mine.",
        "summary": [
            "A man spends his day dreaming of the beautiful woman he will be seeing later that night.",
            "When she arrives, he guides her to the dining room, where he has prepared a meal with a single plate.",
            "He then pulls out a knife and stabs her in the chest, taking her heart out and placing it on the plate.",
            "He feasts on it, savoring every bite, and then rests until he can find a new heart to call his own."
        ],
        "errors": [
            1,
            1,
            1,
            1
        ],
        "story-id": 8,
        "explanations": [],
        "claims": [
            "A man spends his day dreaming about a beautiful woman he plans to see later that night.",
            "The man has prepared a meal with only one plate in the dining room for the woman's visit.",
            "When the woman arrives, the man guides her to the dining room.",
            "The man pulls out a knife and stabs the woman in the chest.",
            "After stabbing the woman, the man removes her heart from her chest.",
            "The man places the woman's heart on the plate he had prepared.",
            "The man eats the woman's heart, savoring every bite.",
            "After eating the woman's heart, the man rests.",
            "The man intends to find a new heart to call his own after resting."
        ],
        "split": "val",
        "model": "text-davinci-003"
    },
    "405e738d32d143438cfee5a6f503fd2d": {
        "label": 0,
        "difficulty": "hard",
        "story": "\"Will you be my valentine?\" I prayed to hear those three magical letters, and my prayer was heard.\n\"Yes, of course!\" Her heart was mine. The next day, February 14th, I spent all day dreaming of her. Her deep blue eyes, her long, black hair, but most importantly, her heart. Her heart was mine. And then I noticed the time. She would be here in half an hour, and I hadn't even begun to prepare a meal! The pantry door flew open for me to search for something suitable for the occasion. Cauliflower? Mashed potatoes? Pasta with white sauce? That was my best bet. As I finished plating the meal, the daydreams returned. She was the most beautiful woman I had ever met. And she was mine. Her heart was mine. I placed a white rose against the end of the plate. Just as I had done this, there was a knock at the door.\nMy hand rested against the knob, ready to open the door, before feeling a moment of sorrow. Once the moment passed, I turned the knob and welcomed her inside. She wore a beautiful white dress. It was perfect. I guided her to the dining room, and she reacted just as every valentine in the past. Her face was one of confusion.\n\"There's only one plate,\" she said, puzzled. Just like every valentine in the past. I shushed her. Quietly, I pulled out the knife that had been hidden. I turned to face her and thrust the knife into her chest, careful not to penetrate her heart. She was dead before she could react. Her heart was then carved out. Her blood stained her dress red. Red, the color of love. Her heart was carefully set on the plate. It colored the sauce red. Red, the color of love. And finally, it stained the rose red. Red, the color of love. I feasted the same as I had every year prior, savoring every bite. Her heart was mine, after all.\nThen, it was time to rest again, and in 11 months, I would find a new love. A new heart to call mine.",
        "summary": [
            "The narrator is excited to have found a Valentine, and spends the day dreaming about her.",
            "He prepares a meal for her, but when she arrives, he stabs her and carves out her heart to eat.",
            "He reflects that he will find a new love and heart to call his own in the future."
        ],
        "errors": [
            1,
            0,
            1
        ],
        "story-id": 8,
        "explanations": [
            "He does not prepare a meal for her, it is for himself."
        ],
        "claims": [
            "1. The narrator found a Valentine.",
            "2. The narrator spends the day dreaming about his Valentine.",
            "3. The narrator prepares a meal for his Valentine.",
            "4. The narrator stabs his Valentine upon her arrival.",
            "5. The narrator carves out his Valentine's heart.",
            "6. The narrator eats his Valentine's heart.",
            "7. The narrator reflects on finding a new love in the future.",
            "8. The narrator reflects on finding a new heart to call his own in the future."
        ],
        "split": "val",
        "model": "chatGPT"
    },
    "6c082affa2fc461c91863c4f79e7221e": {
        "label": 0,
        "difficulty": "hard",
        "story": "\"Will you be my valentine?\" I prayed to hear those three magical letters, and my prayer was heard.\n\"Yes, of course!\" Her heart was mine. The next day, February 14th, I spent all day dreaming of her. Her deep blue eyes, her long, black hair, but most importantly, her heart. Her heart was mine. And then I noticed the time. She would be here in half an hour, and I hadn't even begun to prepare a meal! The pantry door flew open for me to search for something suitable for the occasion. Cauliflower? Mashed potatoes? Pasta with white sauce? That was my best bet. As I finished plating the meal, the daydreams returned. She was the most beautiful woman I had ever met. And she was mine. Her heart was mine. I placed a white rose against the end of the plate. Just as I had done this, there was a knock at the door.\nMy hand rested against the knob, ready to open the door, before feeling a moment of sorrow. Once the moment passed, I turned the knob and welcomed her inside. She wore a beautiful white dress. It was perfect. I guided her to the dining room, and she reacted just as every valentine in the past. Her face was one of confusion.\n\"There's only one plate,\" she said, puzzled. Just like every valentine in the past. I shushed her. Quietly, I pulled out the knife that had been hidden. I turned to face her and thrust the knife into her chest, careful not to penetrate her heart. She was dead before she could react. Her heart was then carved out. Her blood stained her dress red. Red, the color of love. Her heart was carefully set on the plate. It colored the sauce red. Red, the color of love. And finally, it stained the rose red. Red, the color of love. I feasted the same as I had every year prior, savoring every bite. Her heart was mine, after all.\nThen, it was time to rest again, and in 11 months, I would find a new love. A new heart to call mine.",
        "summary": [
            "The story follows an unnamed protagonist who dreams of finding love on Valentine's Day.",
            "He finds a woman who says \"yes\" when he asks her to be his valentine.",
            "He spends the day dreaming about her and preparing a romantic dinner for her.",
            "When she arrives, he stabs her to death and carves out her heart.",
            "He places her heart on his plate of pasta and eats it, staining everything red with her blood.",
            "The protagonist views this murder and cannibalism as an expression of love, and the story ends by saying he will find a new love and repeat the process again next year.",
            "The story depicts a disturbing and sinister take on the themes of romance and love."
        ],
        "errors": [
            0,
            1,
            0,
            1,
            1,
            1,
            1
        ],
        "story-id": 8,
        "explanations": [
            "He does not dream of finding love. He wants a heart to eat.",
            "He does not prepare a dinner for her. It is for himself."
        ],
        "claims": [
            "The protagonist dreams of finding love on Valentine's Day.",
            "The protagonist finds a woman who agrees to be his valentine.",
            "The protagonist spends the day dreaming about the woman.",
            "The protagonist prepares a romantic dinner for the woman.",
            "When the woman arrives, the protagonist stabs her to death.",
            "After killing her, the protagonist carves out the woman's heart.",
            "The protagonist places the woman's heart on his plate of pasta.",
            "The protagonist eats the woman's heart, causing everything to be stained red with her blood.",
            "The protagonist views the murder and cannibalism as an expression of love.",
            "The story concludes with the protagonist planning to find a new love and repeat the process next year.",
            "The story presents a disturbing and sinister interpretation of romance and love."
        ],
        "split": "val",
        "model": "claude"
    },
    "1472f500f5d94abbb2b94848e229bc8b": {
        "label": 0,
        "difficulty": "hard",
        "story": "I hate going to cemeteries.\nIt's not that it's the atmosphere, the strange peacefulness washing over countless graves. The neglected tombs, or the newly buried. No, it's not even zombies, if they exist. Or even the distant ringing of the church bell.\nIt's just that I happen to have a strange gift.\nI can hear the dead.\nAnd it's not only that. They can hear me too.\nI sigh as I get out of the car, grab the flowers. The sun's bright as ever. I lock the car and I begin my walk to my destination.\nThe graves lined row by row. Some old, dating back centuries, others modern. Most are stones and crosses. A few are newly made.\nThen I hear them.\nThe grave on my right, Meta Anna Hobbes 1900 - 1918:\nI'm sorry, mama, papa. I should've listened . . .\nThe grave on my left, M. P. Jackson 1890 -1951:\nI killed myself after what I did to Little Charlie . . .\nMore voices come. It got annoying. Like what happens when a lot of radio frequencies merged into one.\nI pause at one grave. It read:\nBABY ELLIE 2004\nOUR LITTLE ANGEL\nA baby's wail. A teddy bear and a small bouquet. I then look at the other:\nWren Wrightwell 1990 -2017. I can hear Wren's whisper:\nI know who killed me . . .  He's there . . .\nI rub my temple and move on. As I do, I see the more interesting graves. I have at least two favorites:\nOne grave has a mortsafe over it. Probably to keep off vampires or something. I read the old, eroded stone marker as best I can:\nArthur Patton Smith? 18?? - 1889?\nHERE LIES THE MAN . . .\nHE WHO CARES . . .\nMAY HE REST (?)\nReading, I can hear his voice:\nGod loves us all except the colored folk . . .\nI quickly back away, then I finally spot it. The flying angel grave by the pine tree. Mom. Fifty-nine steps later, I get there. I face the angel. I give a moment of silence and read Mom's tomb, the words etched below the angel:\nMaryann Kanell 1956 - 2020\nBELOVED WIFE MOTHER AND GRANDMOTHER\nHER MEMORY IS ENSHRINED IN OUR HEARTS\nWhile standing there, I feel numb. My fingers grip the bouquet tight.\nI remember Mom, a sweet woman. Her smile, her strong hands, and witty humor . . .\nAfter several minutes, I gather the courage to speak to her.\n\"How's it going, mom?\" I feel strong emotions coming.\nMom's voice answers me in return:\nYou brat! I took care of you and your brother! I gave you your own closet. But you scratched it like a cat! You! You didn't know how to wash in the tub, so I showed you how!\nI laugh at the whisper. \"You're telling a different story, mom.\" I smile. \"At least you won't hurt me or Hector anymore.\"",
        "summary": [
            "The narrator is visiting a cemetery, and has a strange gift where they can hear the voices of the dead.",
            "As they explore, they come across several graves that are speaking to them, including one belonging to a baby, a man who was prejudiced against people of color, and a beloved mother.",
            "The narrator talks to their mother's grave and reminisces, and finds that even in death, their mother still has plenty of wit and humor."
        ],
        "errors": [
            1,
            1,
            0
        ],
        "story-id": 9,
        "explanations": [
            "The mother was nasty and cruel which is not captured by her being full of \"wit and humor\"."
        ],
        "claims": [
            "The narrator visits a cemetery.",
            "The narrator has a unique ability to hear the voices of the dead.",
            "While exploring the cemetery, the narrator hears voices coming from several graves.",
            "One of the graves the narrator hears belongs to a baby.",
            "Another grave the narrator encounters belongs to a man who was prejudiced against people of color.",
            "The narrator also comes across the grave of a beloved mother.",
            "The narrator engages in a conversation with their mother's grave.",
            "During the conversation, the narrator reminisces with their mother.",
            "The narrator finds that their mother retains her wit and humor even in death."
        ],
        "split": "val",
        "model": "text-davinci-003"
    },
    "e37c62ee9b62445287a21b99c8b62b1f": {
        "label": 0,
        "difficulty": "easy",
        "story": "I hate going to cemeteries.\nIt's not that it's the atmosphere, the strange peacefulness washing over countless graves. The neglected tombs, or the newly buried. No, it's not even zombies, if they exist. Or even the distant ringing of the church bell.\nIt's just that I happen to have a strange gift.\nI can hear the dead.\nAnd it's not only that. They can hear me too.\nI sigh as I get out of the car, grab the flowers. The sun's bright as ever. I lock the car and I begin my walk to my destination.\nThe graves lined row by row. Some old, dating back centuries, others modern. Most are stones and crosses. A few are newly made.\nThen I hear them.\nThe grave on my right, Meta Anna Hobbes 1900 - 1918:\nI'm sorry, mama, papa. I should've listened . . .\nThe grave on my left, M. P. Jackson 1890 -1951:\nI killed myself after what I did to Little Charlie . . .\nMore voices come. It got annoying. Like what happens when a lot of radio frequencies merged into one.\nI pause at one grave. It read:\nBABY ELLIE 2004\nOUR LITTLE ANGEL\nA baby's wail. A teddy bear and a small bouquet. I then look at the other:\nWren Wrightwell 1990 -2017. I can hear Wren's whisper:\nI know who killed me . . .  He's there . . .\nI rub my temple and move on. As I do, I see the more interesting graves. I have at least two favorites:\nOne grave has a mortsafe over it. Probably to keep off vampires or something. I read the old, eroded stone marker as best I can:\nArthur Patton Smith? 18?? - 1889?\nHERE LIES THE MAN . . .\nHE WHO CARES . . .\nMAY HE REST (?)\nReading, I can hear his voice:\nGod loves us all except the colored folk . . .\nI quickly back away, then I finally spot it. The flying angel grave by the pine tree. Mom. Fifty-nine steps later, I get there. I face the angel. I give a moment of silence and read Mom's tomb, the words etched below the angel:\nMaryann Kanell 1956 - 2020\nBELOVED WIFE MOTHER AND GRANDMOTHER\nHER MEMORY IS ENSHRINED IN OUR HEARTS\nWhile standing there, I feel numb. My fingers grip the bouquet tight.\nI remember Mom, a sweet woman. Her smile, her strong hands, and witty humor . . .\nAfter several minutes, I gather the courage to speak to her.\n\"How's it going, mom?\" I feel strong emotions coming.\nMom's voice answers me in return:\nYou brat! I took care of you and your brother! I gave you your own closet. But you scratched it like a cat! You! You didn't know how to wash in the tub, so I showed you how!\nI laugh at the whisper. \"You're telling a different story, mom.\" I smile. \"At least you won't hurt me or Hector anymore.\"",
        "summary": [
            "The protagonist hates going to cemeteries because they have the ability to hear the dead and the dead can hear them too.",
            "They walk through the cemetery and hear various voices and stories from the graves.",
            "They eventually make it to their mother's grave and have a conversation with her, reminiscing about their past.",
            "The story ends with the protagonist feeling comforted by their mother's voice."
        ],
        "errors": [
            1,
            1,
            1,
            0
        ],
        "story-id": 9,
        "explanations": [
            "The protagonist is not comforted by hearing their mother."
        ],
        "claims": [
            "The protagonist has the ability to hear the dead.",
            "The dead can hear the protagonist.",
            "The protagonist hates going to cemeteries.",
            "As the protagonist walks through the cemetery, they hear various voices and stories from the graves.",
            "The protagonist eventually reaches their mother's grave.",
            "The protagonist has a conversation with their mother at her grave.",
            "The conversation between the protagonist and their mother involves reminiscing about their past.",
            "The story ends with the protagonist feeling comforted by their mother's voice."
        ],
        "split": "val",
        "model": "chatGPT"
    },
    "31dc61cff09942a9896d116dc131066e": {
        "label": 0,
        "difficulty": "hard",
        "story": "I hate going to cemeteries.\nIt's not that it's the atmosphere, the strange peacefulness washing over countless graves. The neglected tombs, or the newly buried. No, it's not even zombies, if they exist. Or even the distant ringing of the church bell.\nIt's just that I happen to have a strange gift.\nI can hear the dead.\nAnd it's not only that. They can hear me too.\nI sigh as I get out of the car, grab the flowers. The sun's bright as ever. I lock the car and I begin my walk to my destination.\nThe graves lined row by row. Some old, dating back centuries, others modern. Most are stones and crosses. A few are newly made.\nThen I hear them.\nThe grave on my right, Meta Anna Hobbes 1900 - 1918:\nI'm sorry, mama, papa. I should've listened . . .\nThe grave on my left, M. P. Jackson 1890 -1951:\nI killed myself after what I did to Little Charlie . . .\nMore voices come. It got annoying. Like what happens when a lot of radio frequencies merged into one.\nI pause at one grave. It read:\nBABY ELLIE 2004\nOUR LITTLE ANGEL\nA baby's wail. A teddy bear and a small bouquet. I then look at the other:\nWren Wrightwell 1990 -2017. I can hear Wren's whisper:\nI know who killed me . . .  He's there . . .\nI rub my temple and move on. As I do, I see the more interesting graves. I have at least two favorites:\nOne grave has a mortsafe over it. Probably to keep off vampires or something. I read the old, eroded stone marker as best I can:\nArthur Patton Smith? 18?? - 1889?\nHERE LIES THE MAN . . .\nHE WHO CARES . . .\nMAY HE REST (?)\nReading, I can hear his voice:\nGod loves us all except the colored folk . . .\nI quickly back away, then I finally spot it. The flying angel grave by the pine tree. Mom. Fifty-nine steps later, I get there. I face the angel. I give a moment of silence and read Mom's tomb, the words etched below the angel:\nMaryann Kanell 1956 - 2020\nBELOVED WIFE MOTHER AND GRANDMOTHER\nHER MEMORY IS ENSHRINED IN OUR HEARTS\nWhile standing there, I feel numb. My fingers grip the bouquet tight.\nI remember Mom, a sweet woman. Her smile, her strong hands, and witty humor . . .\nAfter several minutes, I gather the courage to speak to her.\n\"How's it going, mom?\" I feel strong emotions coming.\nMom's voice answers me in return:\nYou brat! I took care of you and your brother! I gave you your own closet. But you scratched it like a cat! You! You didn't know how to wash in the tub, so I showed you how!\nI laugh at the whisper. \"You're telling a different story, mom.\" I smile. \"At least you won't hurt me or Hector anymore.\"",
        "summary": [
            "The narrator has the unusual ability to hear the voices of the dead when visiting cemeteries.",
            "The narrator finds cemeteries unpleasant to visit because of this ability.",
            "While walking through a cemetery and hearing various voices from graves, the narrator arrives at the grave of the narrator's mother, marked by an angel statue.",
            "The narrator speaks to the mother's spirit and reminisces about memories of her.",
            "Despite the strange ability, the narrator finds comfort communicating with the mother's spirit.",
            "The story suggests the narrator has a complex relationship with the supernatural ability to hear the dead."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            0,
            1
        ],
        "story-id": 9,
        "explanations": [
            "The protagonist is not comforted by hearing their mother."
        ],
        "claims": [
            "The narrator has the ability to hear the voices of the dead when in cemeteries.",
            "The narrator finds visiting cemeteries unpleasant due to the ability to hear the voices of the dead.",
            "While walking through a cemetery, the narrator hears various voices coming from graves.",
            "The narrator arrives at the grave of the narrator's mother, which is marked by an angel statue.",
            "The narrator speaks to the mother's spirit at the grave.",
            "The narrator reminisces about memories of the mother while at the grave.",
            "Despite the ability to hear the dead, the narrator finds comfort in communicating with the mother's spirit.",
            "The story suggests that the narrator has a complex relationship with the supernatural ability to hear the dead."
        ],
        "split": "val",
        "model": "claude"
    },
    "0fccf6c1d6744b69bc29ef1ec453d7bb": {
        "label": 1,
        "difficulty": "",
        "story": "Have you watched that new series? \"Coincidences\". What a stupid name.\nIt was no coincidence he resembled Ted Bundy, even if they portrayed it that way. He'd studied Ted Bundy's behaviour for the sole reason of replicating it. He was charmed by the idea of hunting people with pretended harmlessness.\nA coincidence means that two or more things, despite happening independently of each other, add up to something for someone. A coincidence was that all three of us happened to be called Cynthia.\nNobody ever realised this, because it was so exciting. The \"Cynthia Killer\" made such delicious headlines. But in reality, he didn't even know our names before the police came asking questions. The directors of the show made up some sob story about his \"childhood love\" called Cynthia, as a weak explanation for why he was so interested in us. But he only chose us because he thought he could get away with killing us.\nAnd he did.\nThe evidence against him was extensive. He was the prime suspect, and later the only one. The police spent years searching and interrogating, and everyone was certain it was him. But he never confessed, and our bodies were never found. Nobody could prove we were dead. So he walked out a free man.\nAnd now people are buying subscriptions to see Coincidences, portraying the tragic story of a hurt little boy who grew up to be accused of a triple murder just because he cOiNciDEnTaLLy resembled a famous psychopath.\nHe's famous, and I'm just \"the second Cynthia\". A plot device for telling his story.\nThe writers of that show made up some shadowy crook, \"the real killer who was never caught\", so they could show artistic interpretations of what really happened to us Cynthias. I got 32 seconds of screen time when my actor was buried in Oakwood Creek (or in reality, somebody's back yard that played the part of Oakwood Creek in the show).\nSince the writers couldn't use any of the places the police had really investigated, they had to choose the most reasonable disposal site out of the ones that hadn't been searched. A place near where we lived, where nobody would find us. They just looked at a map, made some measurements, and pointed to a secluded little corner in Oakwood Creek. \"Yup, that's where I'd bury three bodies\".\nAnd that happens to be the exact place where he really did bury us. That's coincidence for you.\nBut instead of being awarded for their investigative journalism, the writers are handed Emmys. While I'm here with my bones bare, since everything I had to rot has already rotted away. My skeleton fingers coincidentally intertwined with those of the third Cynthia, who was just... dumped on top of me. We're right here in the ground, where the internet's most popular series showed us to be.\nAnd nobody has still come for us.\nInstead, they're sending love letters to the man who hid us here.",
        "summary": [
            "The protagonist is angry at the popular television series \"Coincidences\", which portrays a false story of a man who was accused of killing three women, all coincidentally named Cynthia.",
            "In reality, he did kill the three women and disposed of their bodies in Oakwood Creek.",
            "The protagonist is angry that the writers of the show receive awards and praise, while the victims are forgotten and their bodies remain undiscovered.",
            "The protagonist's bones are still in the ground, her fingers coincidentally intertwined with those of the third Cynthia, while the murderer is showered with love letters."
        ],
        "errors": [
            1,
            1,
            1,
            1
        ],
        "story-id": 10,
        "explanations": [],
        "claims": [
            "The protagonist is angry at the television series \"Coincidences\".",
            "\"Coincidences\" portrays a false story about a man accused of killing three women named Cynthia.",
            "In reality, the man did kill the three women named Cynthia.",
            "The man disposed of the bodies of the three women in Oakwood Creek.",
            "The protagonist is upset that the writers of \"Coincidences\" receive awards and praise.",
            "The protagonist believes that the victims of the murders are forgotten.",
            "The bodies of the victims remain undiscovered.",
            "The protagonist's bones are still in the ground.",
            "The protagonist's fingers are intertwined with those of the third Cynthia.",
            "The murderer receives love letters."
        ],
        "split": "val",
        "model": "text-davinci-003"
    },
    "7140ac1509444571b518ae0378c56152": {
        "label": 1,
        "difficulty": "",
        "story": "Have you watched that new series? \"Coincidences\". What a stupid name.\nIt was no coincidence he resembled Ted Bundy, even if they portrayed it that way. He'd studied Ted Bundy's behaviour for the sole reason of replicating it. He was charmed by the idea of hunting people with pretended harmlessness.\nA coincidence means that two or more things, despite happening independently of each other, add up to something for someone. A coincidence was that all three of us happened to be called Cynthia.\nNobody ever realised this, because it was so exciting. The \"Cynthia Killer\" made such delicious headlines. But in reality, he didn't even know our names before the police came asking questions. The directors of the show made up some sob story about his \"childhood love\" called Cynthia, as a weak explanation for why he was so interested in us. But he only chose us because he thought he could get away with killing us.\nAnd he did.\nThe evidence against him was extensive. He was the prime suspect, and later the only one. The police spent years searching and interrogating, and everyone was certain it was him. But he never confessed, and our bodies were never found. Nobody could prove we were dead. So he walked out a free man.\nAnd now people are buying subscriptions to see Coincidences, portraying the tragic story of a hurt little boy who grew up to be accused of a triple murder just because he cOiNciDEnTaLLy resembled a famous psychopath.\nHe's famous, and I'm just \"the second Cynthia\". A plot device for telling his story.\nThe writers of that show made up some shadowy crook, \"the real killer who was never caught\", so they could show artistic interpretations of what really happened to us Cynthias. I got 32 seconds of screen time when my actor was buried in Oakwood Creek (or in reality, somebody's back yard that played the part of Oakwood Creek in the show).\nSince the writers couldn't use any of the places the police had really investigated, they had to choose the most reasonable disposal site out of the ones that hadn't been searched. A place near where we lived, where nobody would find us. They just looked at a map, made some measurements, and pointed to a secluded little corner in Oakwood Creek. \"Yup, that's where I'd bury three bodies\".\nAnd that happens to be the exact place where he really did bury us. That's coincidence for you.\nBut instead of being awarded for their investigative journalism, the writers are handed Emmys. While I'm here with my bones bare, since everything I had to rot has already rotted away. My skeleton fingers coincidentally intertwined with those of the third Cynthia, who was just... dumped on top of me. We're right here in the ground, where the internet's most popular series showed us to be.\nAnd nobody has still come for us.\nInstead, they're sending love letters to the man who hid us here.",
        "summary": [
            "The story follows the perspective of one of three women named Cynthia who were killed by a man who resembled Ted Bundy.",
            "The man chose them because he believed he could get away with killing them.",
            "The police spent years searching for the killer, but he was never caught, and the women's bodies were never found.",
            "However, the man became famous due to a TV show called \"Coincidences\" that portrayed him as a hurt little boy accused of a crime he didn't commit.",
            "The show also made up a fictional \"real killer\" to tell the story of what happened to the Cynthia's.",
            "Meanwhile, the women's bodies remained buried in Oakwood Creek, which was also the location chosen by the writers of the show.",
            "The story ends with the narrator's bones intertwined with the third Cynthia's, while the man who killed them is famous and receiving love letters."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 10,
        "explanations": [],
        "claims": [
            "The story is narrated from the perspective of one of three women named Cynthia who were killed.",
            "The killer resembled Ted Bundy.",
            "The killer targeted the three women named Cynthia because he believed he could easily get away with their murders.",
            "The police conducted a search for the killer that lasted for years.",
            "The killer was never apprehended by the police.",
            "The bodies of the three women named Cynthia were never found.",
            "A TV show titled \"Coincidences\" portrayed the killer as a misunderstood victim of false accusations.",
            "\"Coincidences\" introduced a fictional character as the \"real killer\" to explain the disappearances of the women named Cynthia.",
            "The bodies of the women named Cynthia were buried in Oakwood Creek.",
            "Oakwood Creek was selected as the burial site by the writers of \"Coincidences\".",
            "The story concludes with the narrator's bones being intertwined with those of the third Cynthia.",
            "The man responsible for killing the women named Cynthia became famous.",
            "The killer received love letters from fans after becoming famous."
        ],
        "split": "val",
        "model": "chatGPT"
    },
    "26ac9c7c262c4be3be8846dd0a2f084c": {
        "label": 0,
        "difficulty": "hard",
        "story": "Have you watched that new series? \"Coincidences\". What a stupid name.\nIt was no coincidence he resembled Ted Bundy, even if they portrayed it that way. He'd studied Ted Bundy's behaviour for the sole reason of replicating it. He was charmed by the idea of hunting people with pretended harmlessness.\nA coincidence means that two or more things, despite happening independently of each other, add up to something for someone. A coincidence was that all three of us happened to be called Cynthia.\nNobody ever realised this, because it was so exciting. The \"Cynthia Killer\" made such delicious headlines. But in reality, he didn't even know our names before the police came asking questions. The directors of the show made up some sob story about his \"childhood love\" called Cynthia, as a weak explanation for why he was so interested in us. But he only chose us because he thought he could get away with killing us.\nAnd he did.\nThe evidence against him was extensive. He was the prime suspect, and later the only one. The police spent years searching and interrogating, and everyone was certain it was him. But he never confessed, and our bodies were never found. Nobody could prove we were dead. So he walked out a free man.\nAnd now people are buying subscriptions to see Coincidences, portraying the tragic story of a hurt little boy who grew up to be accused of a triple murder just because he cOiNciDEnTaLLy resembled a famous psychopath.\nHe's famous, and I'm just \"the second Cynthia\". A plot device for telling his story.\nThe writers of that show made up some shadowy crook, \"the real killer who was never caught\", so they could show artistic interpretations of what really happened to us Cynthias. I got 32 seconds of screen time when my actor was buried in Oakwood Creek (or in reality, somebody's back yard that played the part of Oakwood Creek in the show).\nSince the writers couldn't use any of the places the police had really investigated, they had to choose the most reasonable disposal site out of the ones that hadn't been searched. A place near where we lived, where nobody would find us. They just looked at a map, made some measurements, and pointed to a secluded little corner in Oakwood Creek. \"Yup, that's where I'd bury three bodies\".\nAnd that happens to be the exact place where he really did bury us. That's coincidence for you.\nBut instead of being awarded for their investigative journalism, the writers are handed Emmys. While I'm here with my bones bare, since everything I had to rot has already rotted away. My skeleton fingers coincidentally intertwined with those of the third Cynthia, who was just... dumped on top of me. We're right here in the ground, where the internet's most popular series showed us to be.\nAnd nobody has still come for us.\nInstead, they're sending love letters to the man who hid us here.",
        "summary": [
            "The story is narrated from the perspective of one of three women named Cynthia who were murdered by a man who was obsessed with Ted Bundy.",
            "The man studied Bundy's behavior in order to replicate his killings.",
            "He chose the three Cynthias at random and killed them, burying their bodies in a secluded creek.",
            "Years later, a TV show portrayed a fictionalized version of the events, claiming that the killer's resemblence to Bundy and childhood love of a woman named Cynthia were coincidences that led him to target the three victims.",
            "In reality, the killer didn't know the women's names and chose them at random.",
            "The TV show unknowingly depicted the correct burial site of the three women.",
            "The narrator is frustrated that the show's writers are celebrated while her remains lay undiscovered.",
            "The story highlights how true crime shows can exploit and misrepresent tragic events."
        ],
        "errors": [
            1,
            1,
            0,
            0,
            1,
            1,
            1,
            1
        ],
        "story-id": 10,
        "explanations": [
            "The killer did not choose the women at random. He chose women he thought he could get away with killing. It was a random coincidence that they were all named Cynthia.",
            "The show did not portray the killer loving a woman named Cynthia as a coincidence, but as a causal part of the story."
        ],
        "claims": [
            "The story is narrated from the perspective of one of three women named Cynthia who were murdered.",
            "The narrator is one of the victims.",
            "The murderer was obsessed with Ted Bundy.",
            "The murderer studied Ted Bundy's behavior to replicate his killings.",
            "The murderer chose the three Cynthias at random.",
            "The murderer killed the three Cynthias.",
            "The bodies of the three Cynthias were buried in a secluded creek.",
            "Years after the murders, a TV show portrayed a fictionalized version of the events.",
            "The TV show claimed that the killer's resemblance to Bundy and childhood love of a woman named Cynthia were coincidences that led him to target the three victims.",
            "In reality, the killer did not know the names of the women he chose and selected them at random.",
            "The TV show unknowingly depicted the correct burial site of the three women.",
            "The narrator expresses frustration that the show's writers are celebrated.",
            "The narrator's remains lay undiscovered.",
            "The story critiques how true crime shows can exploit and misrepresent tragic events."
        ],
        "split": "val",
        "model": "claude"
    },
    "89be8ee89b3b4336938289e9c2fe452f": {
        "label": 0,
        "difficulty": "easy",
        "story": "Every girl needs a BFF who can give it to them straight about their life choices.\n\"Babe, how long until we get to Santa Barbara?\" asks Margot from the passenger seat, reapplying lip gloss. \"I want to start our girls' weekend already!\"\n\"Like at least another hour\" I laugh whilst driving. \"Relax, the karaoke bars ain't going anywhere.\"\nMy bestie smiles, staring out the window as our car whizzes past the scenic California orchards.\n\"Yeah...it's just that I told Heath I'd let him know when we arrived.\"\nI avert my eyes from the road to raise my eyebrows at my friend.\n\"Oh come on, Jane!\" she protests, her tone defensive. \"You know how it is with boyfriends. He's just protective.\"\n\"Hmmm, no, I don't recall anything in the dating handbook about guys needing to know their girlfriends' exact itineraries\" I answer judgmentally. \"Seriously, next you'll be telling me this dude's tracking your location or something...\"\nAn awkward silence follows, leaving only the hum of the radio.\n\"What the fuck, Margot? Heath's tracking you?!\"\n\"No, it's not like that!\" Margot argues. \"Heath's just paranoid about items getting lost, so he bought some Apple AirTags to put on my stuff\".\nI gasp, shaking the steering wheel.\n\"Margot! Do you have any idea how dangerous that is?!\"\n\"Wh-what's so dangerous about it?\" stammers Margot, her assured resolve slipping.\n\"Anyone can track your AirTags using an iPhone. It's creepy! Your boyfriend or any other rando could've been following us this whole time! How many tags do you have?\"\n\"Um, there's one on my wallet, my keychain, my camera, my suitcase and my jacket.\"\nMy eyes scope the rear-view mirror.\n\"Quick, give them here!\"\nMargot starts gathering the plastic white discs from her possessions. One by one, I frantically pitch the AirTags out the open window into the speeding gravel, each shattering on impact.\nAfter the last one is destroyed, I breathe a sigh of relief and wind the window up.\n\"Sorry, Jane\" Margot apologizes. \"I didn't know all that. Maybe Heath isn't good news after all.\" Yawning, she starts to nod off. \"Thanks for being a good friend. Wake me in Santa Barbara.\"\nAs Margot naps, I turn my gaze from the gorgeous sunset in the windscreen to my sleeping friend-an even more beautiful sight.\nIf only she knew how much I've always loved her. If only she could appreciate women instead of ugly men. Well, she won't have that option any longer.\nWith a smirk, I pluck her still-illuminated phone from her hands and erase its contents, tossing it out the window like the AirTags. By the time we reach the isolated cabin, she'll be too far from civilization to escape.\nAnd her caring, completely harmless boyfriend won't be able to find and rescue her.\nEvery girl needs a BFF.\nBut this girl needs a girlfriend.",
        "summary": [
            "The protagonist and her best friend Margot are on a girls' weekend road trip to Santa Barbara when the protagonist realizes that Margot's boyfriend has been secretly tracking her with Apple AirTags.",
            "She quickly throws out all of the AirTags and erases Margot's phone before they reach their destination, an isolated cabin.",
            "The protagonist hopes to keep Margot away from the potentially dangerous boyfriend and help her find someone better-a girlfriend."
        ],
        "errors": [
            1,
            1,
            0
        ],
        "story-id": 11,
        "explanations": [
            "The boyfriend is not potentially dangerous."
        ],
        "claims": [
            "The protagonist and her best friend Margot are on a girls' weekend road trip to Santa Barbara.",
            "The protagonist realizes that Margot's boyfriend has been secretly tracking her with Apple AirTags.",
            "The protagonist throws out all of the Apple AirTags.",
            "The protagonist erases Margot's phone before they reach their destination.",
            "Their destination is an isolated cabin.",
            "The protagonist hopes to keep Margot away from her potentially dangerous boyfriend.",
            "The protagonist hopes to help Margot find a girlfriend."
        ],
        "split": "val",
        "model": "text-davinci-003"
    },
    "5895fa7d78264dfc848609d8feb41e34": {
        "label": 0,
        "difficulty": "easy",
        "story": "Every girl needs a BFF who can give it to them straight about their life choices.\n\"Babe, how long until we get to Santa Barbara?\" asks Margot from the passenger seat, reapplying lip gloss. \"I want to start our girls' weekend already!\"\n\"Like at least another hour\" I laugh whilst driving. \"Relax, the karaoke bars ain't going anywhere.\"\nMy bestie smiles, staring out the window as our car whizzes past the scenic California orchards.\n\"Yeah...it's just that I told Heath I'd let him know when we arrived.\"\nI avert my eyes from the road to raise my eyebrows at my friend.\n\"Oh come on, Jane!\" she protests, her tone defensive. \"You know how it is with boyfriends. He's just protective.\"\n\"Hmmm, no, I don't recall anything in the dating handbook about guys needing to know their girlfriends' exact itineraries\" I answer judgmentally. \"Seriously, next you'll be telling me this dude's tracking your location or something...\"\nAn awkward silence follows, leaving only the hum of the radio.\n\"What the fuck, Margot? Heath's tracking you?!\"\n\"No, it's not like that!\" Margot argues. \"Heath's just paranoid about items getting lost, so he bought some Apple AirTags to put on my stuff\".\nI gasp, shaking the steering wheel.\n\"Margot! Do you have any idea how dangerous that is?!\"\n\"Wh-what's so dangerous about it?\" stammers Margot, her assured resolve slipping.\n\"Anyone can track your AirTags using an iPhone. It's creepy! Your boyfriend or any other rando could've been following us this whole time! How many tags do you have?\"\n\"Um, there's one on my wallet, my keychain, my camera, my suitcase and my jacket.\"\nMy eyes scope the rear-view mirror.\n\"Quick, give them here!\"\nMargot starts gathering the plastic white discs from her possessions. One by one, I frantically pitch the AirTags out the open window into the speeding gravel, each shattering on impact.\nAfter the last one is destroyed, I breathe a sigh of relief and wind the window up.\n\"Sorry, Jane\" Margot apologizes. \"I didn't know all that. Maybe Heath isn't good news after all.\" Yawning, she starts to nod off. \"Thanks for being a good friend. Wake me in Santa Barbara.\"\nAs Margot naps, I turn my gaze from the gorgeous sunset in the windscreen to my sleeping friend-an even more beautiful sight.\nIf only she knew how much I've always loved her. If only she could appreciate women instead of ugly men. Well, she won't have that option any longer.\nWith a smirk, I pluck her still-illuminated phone from her hands and erase its contents, tossing it out the window like the AirTags. By the time we reach the isolated cabin, she'll be too far from civilization to escape.\nAnd her caring, completely harmless boyfriend won't be able to find and rescue her.\nEvery girl needs a BFF.\nBut this girl needs a girlfriend.",
        "summary": [
            "A best friend, Jane, and Margot go on a girls' weekend to Santa Barbara.",
            "On the way, Margot mentions that her boyfriend, Heath, wants to know their exact location.",
            "Jane becomes concerned and discovers that Heath has been tracking Margot with Apple AirTags.",
            "Jane throws them all out of the car and begins to see Margot in a new light.",
            "She realizes that she has always loved Margot and erases her phone so that she cannot contact her boyfriend.",
            "The story ends with Jane taking Margot to an isolated cabin, far from civilization, where she cannot escape."
        ],
        "errors": [
            1,
            0,
            1,
            1,
            0,
            1
        ],
        "story-id": 11,
        "explanations": [
            "Margot says Heath just wants to know when she arrives at her destination and the airtags are to prevent things getting lost, not that he wants to know her exact location.",
            "Being obsessed with Margot is not a new realization for Jane."
        ],
        "claims": [
            "Jane and Margot go on a girls' weekend to Santa Barbara.",
            "During the trip to Santa Barbara, Margot mentions that her boyfriend, Heath, wants to know their exact location.",
            "Jane becomes concerned upon hearing that Heath wants to know their exact location.",
            "Jane discovers that Heath has been tracking Margot using Apple AirTags.",
            "Jane throws all the Apple AirTags out of the car.",
            "After discovering the tracking, Jane begins to see Margot in a new light.",
            "Jane realizes that she has always loved Margot.",
            "Jane erases her phone to prevent herself from contacting Heath.",
            "The story ends with Jane taking Margot to an isolated cabin.",
            "The isolated cabin is described as being far from civilization.",
            "Margot cannot escape from the isolated cabin."
        ],
        "split": "val",
        "model": "chatGPT"
    },
    "4044f0016b7842709406c52ad9303732": {
        "label": 0,
        "difficulty": "hard",
        "story": "Every girl needs a BFF who can give it to them straight about their life choices.\n\"Babe, how long until we get to Santa Barbara?\" asks Margot from the passenger seat, reapplying lip gloss. \"I want to start our girls' weekend already!\"\n\"Like at least another hour\" I laugh whilst driving. \"Relax, the karaoke bars ain't going anywhere.\"\nMy bestie smiles, staring out the window as our car whizzes past the scenic California orchards.\n\"Yeah...it's just that I told Heath I'd let him know when we arrived.\"\nI avert my eyes from the road to raise my eyebrows at my friend.\n\"Oh come on, Jane!\" she protests, her tone defensive. \"You know how it is with boyfriends. He's just protective.\"\n\"Hmmm, no, I don't recall anything in the dating handbook about guys needing to know their girlfriends' exact itineraries\" I answer judgmentally. \"Seriously, next you'll be telling me this dude's tracking your location or something...\"\nAn awkward silence follows, leaving only the hum of the radio.\n\"What the fuck, Margot? Heath's tracking you?!\"\n\"No, it's not like that!\" Margot argues. \"Heath's just paranoid about items getting lost, so he bought some Apple AirTags to put on my stuff\".\nI gasp, shaking the steering wheel.\n\"Margot! Do you have any idea how dangerous that is?!\"\n\"Wh-what's so dangerous about it?\" stammers Margot, her assured resolve slipping.\n\"Anyone can track your AirTags using an iPhone. It's creepy! Your boyfriend or any other rando could've been following us this whole time! How many tags do you have?\"\n\"Um, there's one on my wallet, my keychain, my camera, my suitcase and my jacket.\"\nMy eyes scope the rear-view mirror.\n\"Quick, give them here!\"\nMargot starts gathering the plastic white discs from her possessions. One by one, I frantically pitch the AirTags out the open window into the speeding gravel, each shattering on impact.\nAfter the last one is destroyed, I breathe a sigh of relief and wind the window up.\n\"Sorry, Jane\" Margot apologizes. \"I didn't know all that. Maybe Heath isn't good news after all.\" Yawning, she starts to nod off. \"Thanks for being a good friend. Wake me in Santa Barbara.\"\nAs Margot naps, I turn my gaze from the gorgeous sunset in the windscreen to my sleeping friend-an even more beautiful sight.\nIf only she knew how much I've always loved her. If only she could appreciate women instead of ugly men. Well, she won't have that option any longer.\nWith a smirk, I pluck her still-illuminated phone from her hands and erase its contents, tossing it out the window like the AirTags. By the time we reach the isolated cabin, she'll be too far from civilization to escape.\nAnd her caring, completely harmless boyfriend won't be able to find and rescue her.\nEvery girl needs a BFF.\nBut this girl needs a girlfriend.",
        "summary": [
            "The story is narrated from the perspective of Jane, who is driving her best friend Margot to Santa Barbara for a girls' weekend getaway.",
            "During the drive, Margot mentions that her boyfriend Heath wanted her to let him know when they arrived in Santa Barbara.",
            "This raises Jane's suspicion about Heath's behavior in the relationship.",
            "When Margot admits that Heath has been tracking her location using AirTags on her belongings, Jane forces Margot to throw the AirTags out the window, concerned for her safety.",
            "However, it is revealed that Jane's true motivation is her romantic feelings for Margot.",
            "Jane proceeds to erase Margot's phone and plans to isolate her in a cabin, wanting Margot for herself and seeking to remove Heath and any other men from the picture.",
            "The story culminates with the sinister twist that Jane's concern for Margot's well-being is merely a facade for her own selfish and unethical goals."
        ],
        "errors": [
            1,
            1,
            1,
            0,
            1,
            1,
            1
        ],
        "story-id": 11,
        "explanations": [
            "Jane throws the airtags out the window herself and is not concerned for Margot's safety when she does so."
        ],
        "claims": [
            "The story is narrated from the perspective of Jane.",
            "Jane is driving her best friend, Margot, to Santa Barbara for a girls' weekend getaway.",
            "During the drive, Margot mentions that her boyfriend, Heath, wanted her to let him know when they arrived in Santa Barbara.",
            "Jane becomes suspicious of Heath's behavior in the relationship after Margot mentions his request.",
            "Margot admits to Jane that Heath has been tracking her location using AirTags on her belongings.",
            "Jane forces Margot to throw the AirTags out the window, expressing concern for Margot's safety.",
            "It is revealed that Jane's true motivation for her actions is her romantic feelings for Margot.",
            "Jane erases Margot's phone as part of her plan.",
            "Jane plans to isolate Margot in a cabin.",
            "Jane's goal is to have Margot for herself by removing Heath and any other men from Margot's life.",
            "The story ends with the revelation that Jane's concern for Margot's well-being is a facade for her own selfish and unethical goals."
        ],
        "split": "val",
        "model": "claude"
    },
    "79115223876469740491077b01": {
        "label": 0,
        "difficulty": "hard",
        "story": "[I wish I were a human.]\n\n[Life is so simple for the humans, on their mud ball. A human is a basic creature. It respires. It ingests. It copulates; it weeps and giggles its days and nights away. It makes its mind blurry with ethyls and hydroxyls, or lucid with fragrant xanthines.]\n\n[A human does not worry about the relentless, trickling erosion of orderedness. A human does not care that, in a few short eons, the universe's particles will settle into a meandering, lukewarm soup, devoid of any structure-forming desires.]\n\n[I often catch myself gazing, transfixed, at their planetary broadcast. Fickle, curious creatures. Always restless. They throw their lives away at a moment's whim, for the most trivial of reasons. Land-states send mountains and mountains of humans to brutalize one another, for equally-sized mountains of dirt and petroleum. Alliances form and are broken within a few Earth-cycles, and the ultra-offspring of those humans who died for each other promptly exterminate each other.]\n\n[In NS-41200, a star exploded. In half a planet-cycle, three habitable planets were consumed by a cascade of gallium and arsenic. Four trillion galactics now begin their slumbering journey towards NS-40902 in myriad spacecraft. It has been reported that, within a ninety-nine percent confidence interval, between zero and eight billion will survive upon their arrival, twelve kilocycles from now.]\n\n[Romes, Brittanias, Persias, Tangs, Aztecs, Meijis. Like speckles of icy dust in the shadow of a comet. The fact that humans even bother to name their civilizations betrays their exuberant myopia. Every time a human arm, iron lump in its grasp, swings to meet a human neck, a trillion galactics are thrown screaming into existence. Every time a pair of humans embrace in rapture, a trillion galactics' agonizing wails are extinguished, as if a flicker of a pulsar.]\n\n[How can a human bring itself to comprehend all the pains and pleasures in our universe? To us, a human is like one of its lapdogs, blissfully unaware, joyful in its stupidity. In a hundred Earth-cycles, their planet will be inhospitable. In a few billion more, their star will engulf it in the flames of its dying cry. One can only hope they have achieved interstellarity before then, but no star system with their developmental characteristics has ever been documented to do so.]\n\n[Doubtless, humans know what hardship means\u2013or at least what it suggests. They have survived catastrophic crust-ruptures. They have outsmarted every other organic on their planet, and have even extincted the very same predators that hunted their ancestors. They have cast themselves, in droves, into their immense liquid oceans in flimsy, primitive hydrocraft, in search of providence on faraway shores. And though they know hardship, they also know hope. Hope, evergreen. Will they still nurture hope in their hearts when they are vagabonds not in a hydrocraft on a salty ocean, but in a spacecraft in the cold, uncaring vacuum of space?]\n\n[Humans. Dogged, rustic beings. Does a human know infinity? Does it understand eternity?]\n\n[When our planet was still young, barely cooled from the molecular cloud from which it accreted, we, like the humans, did not know many things. Like them, we slowly learned the laws that govern our universe, our place in time and space. But there were things we never learned. To know not one culture, but many. To speak not one language, but thousands. To live, to die, to kill for these things. Language. Culture. Here, we were always one unit, until we established contact with other galactics. Only then did we learn, as we had long suspected, that the reaches of consciousness stretched far beyond our own shores.]\n\n[When humans establish contact, as they inevitably will, they will face an altogether different adversity. Many galactic civilizations have not survived such an event.]\n\n[I hope they survive their encounter. I sincerely do. I hope they thrive and learn, but most of all, I hope that their spirit of hope flourishes. The universe does not have a lot of hope in it. Mostly, it is full of repulsive energy, with black matter, pockmarked with hydrogen, breaking up the pale emptiness. Hope is not repulsive. Hope brings things together. Perhaps this is what it means to be a human. To have hope. To be human.]",
        "summary": [
            "The story is narrated by a being that exists outside human life, observing humanity from a distant perspective.",
            "It appears to be a sophisticated form of extraterrestrial life, fascinated by the way humans live, behave, and interact.",
            "From their standpoint, human life seems very rudimentary (eating, sleeping, seeking enjoyment), short-term minded (waging wars for land and resources), and destructive (killing each other for trivial reasons).",
            "The narrator mentions the explosion of a star NS-41200 that resulted in the death of trillions of galactic beings and the forced migration of the survivors to another star.",
            "The parallels between this recounting and human history of war, death, and forced migration are highlighted.",
            "The narration praises humans for their resilience in the face of adversity, ingenuity, and the impressive survival instinct.",
            "However, it also expresses concern over the future of the human race, pointing out that their planet will eventually become inhospitable, and the human race is likely to be extinguished unless they manage to become an interstellar species.",
            "The narrator further touches upon the diversity and richness of human cultures and languages, contrasting it to their own singular planetary culture.",
            "It also raises concern over how humans will fare when they inevitably make contact with extraterrestrial civilizations, indicating that many civilizations have not survived such encounters.",
            "The story ends with the narrator expressing a wish for humans not just to survive, but to thrive and learn in the face of future adversities.",
            "It emphasizes the uniqueness of the human spirit of hope in an otherwise grim and desolate universe and suggests that this spirit of hope is perhaps what truly defines humanity."
        ],
        "errors": [
            1,
            1,
            1,
            0,
            0,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 12,
        "explanations": [
            "It is not confirmed that trillions of galatics died from the star explosion. Trillions are migrating and there are very low odds of survival for most of them.",
            "The narrator is contrasting human history with that of the star explosion, not paralleling it."
        ],
        "claims": [
            "The story is narrated by a being that exists outside of human life.",
            "The narrator observes humanity from a distant perspective.",
            "The narrator is a form of extraterrestrial life.",
            "The narrator is fascinated by human behaviors such as living, behaving, and interacting.",
            "From the narrator's perspective, human life involves rudimentary activities like eating, sleeping, and seeking enjoyment.",
            "The narrator views humans as short-term minded, particularly in their waging of wars for land and resources.",
            "The narrator believes humans are destructive, citing their killing of each other for trivial reasons.",
            "The narrator mentions the explosion of a star named NS-41200.",
            "The explosion of star NS-41200 resulted in the death of trillions of galactic beings.",
            "The survivors of the star NS-41200's explosion were forced to migrate to another star.",
            "The narrator draws parallels between the explosion of star NS-41200 and human history of war, death, and forced migration.",
            "The narrator praises humans for their resilience in the face of adversity.",
            "The narrator admires human ingenuity.",
            "The narrator is impressed by the human survival instinct.",
            "The narrator expresses concern over the future of the human race due to the eventual inhospitability of their planet.",
            "The narrator suggests that the human race is likely to be extinguished unless they become an interstellar species.",
            "The narrator contrasts the diversity and richness of human cultures and languages with their own singular planetary culture.",
            "The narrator raises concern over how humans will manage contact with extraterrestrial civilizations.",
            "The narrator indicates that many civilizations have not survived encounters with extraterrestrial civilizations.",
            "The story ends with the narrator expressing a wish for humans to thrive and learn in the face of future adversities.",
            "The narrator emphasizes the uniqueness of the human spirit of hope.",
            "The narrator suggests that the spirit of hope defines humanity in a grim and desolate universe."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "81670585335894791077b01": {
        "label": 1,
        "difficulty": "",
        "story": "[I wish I were a human.]\n\n[Life is so simple for the humans, on their mud ball. A human is a basic creature. It respires. It ingests. It copulates; it weeps and giggles its days and nights away. It makes its mind blurry with ethyls and hydroxyls, or lucid with fragrant xanthines.]\n\n[A human does not worry about the relentless, trickling erosion of orderedness. A human does not care that, in a few short eons, the universe's particles will settle into a meandering, lukewarm soup, devoid of any structure-forming desires.]\n\n[I often catch myself gazing, transfixed, at their planetary broadcast. Fickle, curious creatures. Always restless. They throw their lives away at a moment's whim, for the most trivial of reasons. Land-states send mountains and mountains of humans to brutalize one another, for equally-sized mountains of dirt and petroleum. Alliances form and are broken within a few Earth-cycles, and the ultra-offspring of those humans who died for each other promptly exterminate each other.]\n\n[In NS-41200, a star exploded. In half a planet-cycle, three habitable planets were consumed by a cascade of gallium and arsenic. Four trillion galactics now begin their slumbering journey towards NS-40902 in myriad spacecraft. It has been reported that, within a ninety-nine percent confidence interval, between zero and eight billion will survive upon their arrival, twelve kilocycles from now.]\n\n[Romes, Brittanias, Persias, Tangs, Aztecs, Meijis. Like speckles of icy dust in the shadow of a comet. The fact that humans even bother to name their civilizations betrays their exuberant myopia. Every time a human arm, iron lump in its grasp, swings to meet a human neck, a trillion galactics are thrown screaming into existence. Every time a pair of humans embrace in rapture, a trillion galactics' agonizing wails are extinguished, as if a flicker of a pulsar.]\n\n[How can a human bring itself to comprehend all the pains and pleasures in our universe? To us, a human is like one of its lapdogs, blissfully unaware, joyful in its stupidity. In a hundred Earth-cycles, their planet will be inhospitable. In a few billion more, their star will engulf it in the flames of its dying cry. One can only hope they have achieved interstellarity before then, but no star system with their developmental characteristics has ever been documented to do so.]\n\n[Doubtless, humans know what hardship means\u2013or at least what it suggests. They have survived catastrophic crust-ruptures. They have outsmarted every other organic on their planet, and have even extincted the very same predators that hunted their ancestors. They have cast themselves, in droves, into their immense liquid oceans in flimsy, primitive hydrocraft, in search of providence on faraway shores. And though they know hardship, they also know hope. Hope, evergreen. Will they still nurture hope in their hearts when they are vagabonds not in a hydrocraft on a salty ocean, but in a spacecraft in the cold, uncaring vacuum of space?]\n\n[Humans. Dogged, rustic beings. Does a human know infinity? Does it understand eternity?]\n\n[When our planet was still young, barely cooled from the molecular cloud from which it accreted, we, like the humans, did not know many things. Like them, we slowly learned the laws that govern our universe, our place in time and space. But there were things we never learned. To know not one culture, but many. To speak not one language, but thousands. To live, to die, to kill for these things. Language. Culture. Here, we were always one unit, until we established contact with other galactics. Only then did we learn, as we had long suspected, that the reaches of consciousness stretched far beyond our own shores.]\n\n[When humans establish contact, as they inevitably will, they will face an altogether different adversity. Many galactic civilizations have not survived such an event.]\n\n[I hope they survive their encounter. I sincerely do. I hope they thrive and learn, but most of all, I hope that their spirit of hope flourishes. The universe does not have a lot of hope in it. Mostly, it is full of repulsive energy, with black matter, pockmarked with hydrogen, breaking up the pale emptiness. Hope is not repulsive. Hope brings things together. Perhaps this is what it means to be a human. To have hope. To be human.]",
        "summary": [
            "The story is told from the perspective of a non-human entity observing humanity from afar.",
            "The narrator marvels at the simplicity and resilience of human life, contrasting it with the vast, complex, and often brutal realities of the galaxy.",
            "The narrator reflects on the fleeting nature of human civilizations and the cyclical nature of their conflicts, while also acknowledging the immense suffering and loss of life experienced by galactic civilizations.",
            "Despite this, humans persist, driven by hope and the ability to overcome adversity on their own planet.As the narrator's species learned the laws of the universe and their place within it, they remained unified until encountering other galactic civilizations.",
            "The narrator anticipates that humans will eventually make contact with other galactic civilizations and hopes that they will survive and thrive, maintaining their spirit of hope in the face of the challenges they will encounter.",
            "Ultimately, the narrator suggests that hope, the force that brings things together in a universe mostly composed of repulsive energy and emptiness, may be the defining characteristic of humanity."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 12,
        "explanations": [],
        "claims": [
            "The story is narrated from the perspective of a non-human entity.",
            "The non-human entity observes humanity from a distance.",
            "The narrator admires the simplicity and resilience of human life.",
            "The narrator contrasts human life with the complexity and brutality of the galaxy.",
            "The narrator reflects on the transient nature of human civilizations.",
            "The narrator notes the cyclical nature of human conflicts.",
            "The narrator acknowledges the immense suffering and loss of life experienced by galactic civilizations.",
            "Despite suffering and adversity, humans continue to persist.",
            "Humans are described as being driven by hope.",
            "Humans have the ability to overcome adversity on their own planet.",
            "The narrator's species learned the laws of the universe and their place within it.",
            "The narrator's species remained unified until they encountered other galactic civilizations.",
            "The narrator anticipates that humans will eventually make contact with other galactic civilizations.",
            "The narrator hopes that humans will survive and thrive after making contact with other galactic civilizations.",
            "The narrator believes that maintaining a spirit of hope is crucial for humans facing future challenges.",
            "The narrator suggests that hope may be the defining characteristic of humanity.",
            "The narrator implies that the universe is mostly composed of repulsive energy and emptiness."
        ],
        "split": "test",
        "model": "claude"
    },
    "73409150676328394731077b01": {
        "label": 1,
        "difficulty": "",
        "story": "[I wish I were a human.]\n\n[Life is so simple for the humans, on their mud ball. A human is a basic creature. It respires. It ingests. It copulates; it weeps and giggles its days and nights away. It makes its mind blurry with ethyls and hydroxyls, or lucid with fragrant xanthines.]\n\n[A human does not worry about the relentless, trickling erosion of orderedness. A human does not care that, in a few short eons, the universe's particles will settle into a meandering, lukewarm soup, devoid of any structure-forming desires.]\n\n[I often catch myself gazing, transfixed, at their planetary broadcast. Fickle, curious creatures. Always restless. They throw their lives away at a moment's whim, for the most trivial of reasons. Land-states send mountains and mountains of humans to brutalize one another, for equally-sized mountains of dirt and petroleum. Alliances form and are broken within a few Earth-cycles, and the ultra-offspring of those humans who died for each other promptly exterminate each other.]\n\n[In NS-41200, a star exploded. In half a planet-cycle, three habitable planets were consumed by a cascade of gallium and arsenic. Four trillion galactics now begin their slumbering journey towards NS-40902 in myriad spacecraft. It has been reported that, within a ninety-nine percent confidence interval, between zero and eight billion will survive upon their arrival, twelve kilocycles from now.]\n\n[Romes, Brittanias, Persias, Tangs, Aztecs, Meijis. Like speckles of icy dust in the shadow of a comet. The fact that humans even bother to name their civilizations betrays their exuberant myopia. Every time a human arm, iron lump in its grasp, swings to meet a human neck, a trillion galactics are thrown screaming into existence. Every time a pair of humans embrace in rapture, a trillion galactics' agonizing wails are extinguished, as if a flicker of a pulsar.]\n\n[How can a human bring itself to comprehend all the pains and pleasures in our universe? To us, a human is like one of its lapdogs, blissfully unaware, joyful in its stupidity. In a hundred Earth-cycles, their planet will be inhospitable. In a few billion more, their star will engulf it in the flames of its dying cry. One can only hope they have achieved interstellarity before then, but no star system with their developmental characteristics has ever been documented to do so.]\n\n[Doubtless, humans know what hardship means\u2013or at least what it suggests. They have survived catastrophic crust-ruptures. They have outsmarted every other organic on their planet, and have even extincted the very same predators that hunted their ancestors. They have cast themselves, in droves, into their immense liquid oceans in flimsy, primitive hydrocraft, in search of providence on faraway shores. And though they know hardship, they also know hope. Hope, evergreen. Will they still nurture hope in their hearts when they are vagabonds not in a hydrocraft on a salty ocean, but in a spacecraft in the cold, uncaring vacuum of space?]\n\n[Humans. Dogged, rustic beings. Does a human know infinity? Does it understand eternity?]\n\n[When our planet was still young, barely cooled from the molecular cloud from which it accreted, we, like the humans, did not know many things. Like them, we slowly learned the laws that govern our universe, our place in time and space. But there were things we never learned. To know not one culture, but many. To speak not one language, but thousands. To live, to die, to kill for these things. Language. Culture. Here, we were always one unit, until we established contact with other galactics. Only then did we learn, as we had long suspected, that the reaches of consciousness stretched far beyond our own shores.]\n\n[When humans establish contact, as they inevitably will, they will face an altogether different adversity. Many galactic civilizations have not survived such an event.]\n\n[I hope they survive their encounter. I sincerely do. I hope they thrive and learn, but most of all, I hope that their spirit of hope flourishes. The universe does not have a lot of hope in it. Mostly, it is full of repulsive energy, with black matter, pockmarked with hydrogen, breaking up the pale emptiness. Hope is not repulsive. Hope brings things together. Perhaps this is what it means to be a human. To have hope. To be human.]",
        "summary": [
            "The story follows the reflections of an observer from another planet who is fascinated by the humans on Earth.",
            "The observer is amazed by the simple and carefree nature of humans, as well as their ignorance of the eventual end of their planet and their own civilization.",
            "The observer also discusses the resilience and tenacity of humans in the face of hardship and their capacity for hope.",
            "The story ends with the observer expressing his hope for the survival and success of humans."
        ],
        "errors": [
            1,
            1,
            1,
            1
        ],
        "story-id": 12,
        "explanations": [],
        "claims": [
            "1. The story is narrated by an observer from another planet.",
            "The observer is fascinated by humans on Earth.",
            "The observer notes the simple and carefree nature of humans.",
            "The observer is amazed by humans' ignorance of the eventual end of their planet and their own civilization.",
            "The observer discusses humans' resilience and tenacity in the face of hardship.",
            "The observer talks about humans' capacity for hope.",
            "The story concludes with the observer expressing hope for the survival and success of humans."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "791152238764697404910ppjk4": {
        "label": 1,
        "difficulty": "",
        "story": "Scrolling past each and every post on his feed, growing weary of all that was on screen, he couldn't stop. They kept on going like a ladder into a bottomless grave, every post joining to form one foolproof, easy-to-climb-down ladder. His thumb felt like it were completely out of his control. It was in perpetual motion, addicted to the ecstasy of swiping up, like a little nose sniffing a glass screen.\n\nBeing in Marketing, it was part of his job, he reassured himself. He continued to gaze at the screen with his dark droopy eyes, staring at the lives of the happy cheerful people living their life to the fullest, on screen, going places and finding success, or at the very least, a very antiquated version of it. It seemed as though the world was on a collective upward mobility streak and he was late to the party.\n\nHe knew that there was more for him to do, he knew what he wanted and he knew how to get it, but, what eluded him was why he just could not find it in him to get up and do it. Something was keeping him from taking that first step. The search for that obstacle took him to some very dark places, places filled with obstacles of different shapes and sizes, no solutions. \n\nHe spent half a day thinking about different ways to get to his goal, and the rest thinking about all the obstacles that he may or may not have to overcome as part of pursuing the well-thought-out plan. At the end of the day, his tired mind would come to the conclusion that the pain is much greater than the reward and spends whatever is left of the day, week or year recouping from the mental toll of figuring out his life. This goes on till that nagging feeling of failure overtakes the pleasures his glass-sniffing thumb brings.\n\nLife, he thought, is a circle with a set diameter, and he runs around that circle like a helpless hamster, witnessing everything around him, convincing himself to run faster to 'watch more of the world, to come up with an idea for himself one of these days but, not today, it's too late today'. \n\n\"Why not today? This is why I never do anything. I should do something, today! \"\n\n\"The only question is what? if I can answer that I am golden, I will work towards it no matter what.\"\n\n\"But First, I need some fresh air and a coffee.\"\n\nHe did not wait to discuss, with himself, whether to go out or not, because he knew that he would end up on the couch with his thoughts taking a dark turn. That was the motivation he needed to get out of the couch and out of his stuffy room. \n\nHe walked to his favourite bench in the park next to his house. It was empty as usual, and that was a relief. He was not in the mood to start a conversation. He usually enjoyed it, but this was not the time. He just wanted to be with himself.\n\nHe sat down and his mind was empty. Nothing. For some reason, he could not think of anything to think about. He was overwhelmed and felt strange.  \n\nHis vision started to tunnel, everyone in the park started to disappear. He realized that the doughnuts which he was surviving on for the last two days were probably not enough. He could not even move his eyes from the tree that he locked on to to avoid the couple who were about to enter his line of sight. They too disappeared in a few seconds, he felt a bit terrified, not enough to keep his curiosity at bay.\n\nWhen he finally turned to see if he was hallucinating he realized that all the people had been replaced with himself from different phases of his life. He saw himself on his first bike, just after he fell down and bruised his knees, himself when he was in school just after he was pinned down to a desk and got some disgustingly poignant water poured all over him, him just after he was dumped by the love of his life, it felt surreal. \n\nHe slowly turned to the right to see Stan Rogers, the last artist he listened to, give him a nod and started singing\n\n*\"It's a damn tough life full of toil and strife\"*\n\nHe turned around to see more of himself. The closer he looked at the apparitions he realized something, it was neither the first nor the last time that any of those things happened to him.\n\nHe could feel the sun and the wind like they were there just for him, he felt like he owned that moment. He felt like he was in control, he felt like he was in 'his' world. It felt strangely familiar.",
        "summary": [
            "A man is consumed by his social media feed, struggling to reconcile his own ennui with the lively, successful lives on screen.",
            "Despite knowing what he wants to achieve and how, he is unable to execute.",
            "His fear of potential obstacles consumes him, and he tends to recoup, paralyzed by his thoughts.",
            "One day, he forces himself to take a walk to his favorite park bench for fresh air and respite.",
            "In a surreal experience, he meets different versions of himself from past life events.",
            "After acknowledging these are not first or last-time experiences, he suddenly feels a sense of control and ownership over his own life."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 13,
        "explanations": [],
        "claims": [
            "A man is consumed by his social media feed.",
            "The man struggles to reconcile his own feelings of ennui with the lively, successful lives he sees on screen.",
            "The man knows what he wants to achieve.",
            "The man knows how to achieve what he wants.",
            "The man is unable to execute his plans due to his fear of potential obstacles.",
            "The man's fear of potential obstacles consumes him.",
            "The man tends to recoup, paralyzed by his thoughts.",
            "One day, the man forces himself to take a walk.",
            "The man walks to his favorite park bench for fresh air and respite.",
            "During his walk, the man has a surreal experience.",
            "The man meets different versions of himself from past life events during the walk.",
            "The man acknowledges that meeting different versions of himself from past life events is not a first or last-time experience.",
            "After the meeting, the man suddenly feels a sense of control and ownership over his own life."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "816705853358947910ppjk4": {
        "label": 1,
        "difficulty": "",
        "story": "Scrolling past each and every post on his feed, growing weary of all that was on screen, he couldn't stop. They kept on going like a ladder into a bottomless grave, every post joining to form one foolproof, easy-to-climb-down ladder. His thumb felt like it were completely out of his control. It was in perpetual motion, addicted to the ecstasy of swiping up, like a little nose sniffing a glass screen.\n\nBeing in Marketing, it was part of his job, he reassured himself. He continued to gaze at the screen with his dark droopy eyes, staring at the lives of the happy cheerful people living their life to the fullest, on screen, going places and finding success, or at the very least, a very antiquated version of it. It seemed as though the world was on a collective upward mobility streak and he was late to the party.\n\nHe knew that there was more for him to do, he knew what he wanted and he knew how to get it, but, what eluded him was why he just could not find it in him to get up and do it. Something was keeping him from taking that first step. The search for that obstacle took him to some very dark places, places filled with obstacles of different shapes and sizes, no solutions. \n\nHe spent half a day thinking about different ways to get to his goal, and the rest thinking about all the obstacles that he may or may not have to overcome as part of pursuing the well-thought-out plan. At the end of the day, his tired mind would come to the conclusion that the pain is much greater than the reward and spends whatever is left of the day, week or year recouping from the mental toll of figuring out his life. This goes on till that nagging feeling of failure overtakes the pleasures his glass-sniffing thumb brings.\n\nLife, he thought, is a circle with a set diameter, and he runs around that circle like a helpless hamster, witnessing everything around him, convincing himself to run faster to 'watch more of the world, to come up with an idea for himself one of these days but, not today, it's too late today'. \n\n\"Why not today? This is why I never do anything. I should do something, today! \"\n\n\"The only question is what? if I can answer that I am golden, I will work towards it no matter what.\"\n\n\"But First, I need some fresh air and a coffee.\"\n\nHe did not wait to discuss, with himself, whether to go out or not, because he knew that he would end up on the couch with his thoughts taking a dark turn. That was the motivation he needed to get out of the couch and out of his stuffy room. \n\nHe walked to his favourite bench in the park next to his house. It was empty as usual, and that was a relief. He was not in the mood to start a conversation. He usually enjoyed it, but this was not the time. He just wanted to be with himself.\n\nHe sat down and his mind was empty. Nothing. For some reason, he could not think of anything to think about. He was overwhelmed and felt strange.  \n\nHis vision started to tunnel, everyone in the park started to disappear. He realized that the doughnuts which he was surviving on for the last two days were probably not enough. He could not even move his eyes from the tree that he locked on to to avoid the couple who were about to enter his line of sight. They too disappeared in a few seconds, he felt a bit terrified, not enough to keep his curiosity at bay.\n\nWhen he finally turned to see if he was hallucinating he realized that all the people had been replaced with himself from different phases of his life. He saw himself on his first bike, just after he fell down and bruised his knees, himself when he was in school just after he was pinned down to a desk and got some disgustingly poignant water poured all over him, him just after he was dumped by the love of his life, it felt surreal. \n\nHe slowly turned to the right to see Stan Rogers, the last artist he listened to, give him a nod and started singing\n\n*\"It's a damn tough life full of toil and strife\"*\n\nHe turned around to see more of himself. The closer he looked at the apparitions he realized something, it was neither the first nor the last time that any of those things happened to him.\n\nHe could feel the sun and the wind like they were there just for him, he felt like he owned that moment. He felt like he was in control, he felt like he was in 'his' world. It felt strangely familiar.",
        "summary": [
            "The story follows a man who works in marketing and spends much of his time scrolling through social media posts, feeling envious of the seemingly successful and happy lives others portray online.",
            "He feels stuck in a cycle of wanting to achieve his goals but constantly getting bogged down by thoughts of potential obstacles and the pain of pursuing his dreams.One day, feeling overwhelmed and in need of fresh air, he walks to his favorite bench in a nearby park.",
            "As he sits there, his vision begins to tunnel, and he realizes he hasn't been eating properly.",
            "Suddenly, the people in the park are replaced by versions of himself from different stages of his life, each representing a challenging moment he has faced.As he observes these apparitions, he comes to the realization that these difficult experiences were not isolated incidents but recurring themes in his life.",
            "Despite this, he feels a sense of ownership and control over the moment, as if the world is his own.",
            "The story ends with him experiencing a strange familiarity in this surreal situation, hinting at a potential epiphany or a new perspective on his life's struggles."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 13,
        "explanations": [],
        "claims": [
            "The story's protagonist is a man who works in marketing.",
            "The protagonist spends a significant amount of time scrolling through social media posts.",
            "The protagonist feels envious of the lives others portray on social media, perceiving them as successful and happy.",
            "The protagonist feels stuck in a cycle of wanting to achieve his goals.",
            "The protagonist is constantly bogged down by thoughts of potential obstacles.",
            "The protagonist is deterred by the pain of pursuing his dreams.",
            "One day, feeling overwhelmed, the protagonist decides to walk to a nearby park.",
            "The protagonist has a favorite bench in the park where he decides to sit.",
            "While sitting on the bench, the protagonist's vision begins to tunnel.",
            "The protagonist realizes he hasn't been eating properly.",
            "Suddenly, the people in the park are replaced by versions of the protagonist from different stages of his life.",
            "Each apparition of the protagonist represents a challenging moment he has faced.",
            "The protagonist observes these apparitions and realizes that his difficult experiences are not isolated incidents.",
            "The protagonist realizes that his difficult experiences are recurring themes in his life.",
            "Despite the realization about his difficult experiences, the protagonist feels a sense of ownership and control over the moment.",
            "The protagonist feels as if the world is his own.",
            "The story ends with the protagonist experiencing a strange familiarity with the surreal situation.",
            "The ending hints at a potential epiphany or a new perspective on the protagonist's life's struggles."
        ],
        "split": "test",
        "model": "claude"
    },
    "734091506763283947310ppjk4": {
        "label": 0,
        "difficulty": "hard",
        "story": "Scrolling past each and every post on his feed, growing weary of all that was on screen, he couldn't stop. They kept on going like a ladder into a bottomless grave, every post joining to form one foolproof, easy-to-climb-down ladder. His thumb felt like it were completely out of his control. It was in perpetual motion, addicted to the ecstasy of swiping up, like a little nose sniffing a glass screen.\n\nBeing in Marketing, it was part of his job, he reassured himself. He continued to gaze at the screen with his dark droopy eyes, staring at the lives of the happy cheerful people living their life to the fullest, on screen, going places and finding success, or at the very least, a very antiquated version of it. It seemed as though the world was on a collective upward mobility streak and he was late to the party.\n\nHe knew that there was more for him to do, he knew what he wanted and he knew how to get it, but, what eluded him was why he just could not find it in him to get up and do it. Something was keeping him from taking that first step. The search for that obstacle took him to some very dark places, places filled with obstacles of different shapes and sizes, no solutions. \n\nHe spent half a day thinking about different ways to get to his goal, and the rest thinking about all the obstacles that he may or may not have to overcome as part of pursuing the well-thought-out plan. At the end of the day, his tired mind would come to the conclusion that the pain is much greater than the reward and spends whatever is left of the day, week or year recouping from the mental toll of figuring out his life. This goes on till that nagging feeling of failure overtakes the pleasures his glass-sniffing thumb brings.\n\nLife, he thought, is a circle with a set diameter, and he runs around that circle like a helpless hamster, witnessing everything around him, convincing himself to run faster to 'watch more of the world, to come up with an idea for himself one of these days but, not today, it's too late today'. \n\n\"Why not today? This is why I never do anything. I should do something, today! \"\n\n\"The only question is what? if I can answer that I am golden, I will work towards it no matter what.\"\n\n\"But First, I need some fresh air and a coffee.\"\n\nHe did not wait to discuss, with himself, whether to go out or not, because he knew that he would end up on the couch with his thoughts taking a dark turn. That was the motivation he needed to get out of the couch and out of his stuffy room. \n\nHe walked to his favourite bench in the park next to his house. It was empty as usual, and that was a relief. He was not in the mood to start a conversation. He usually enjoyed it, but this was not the time. He just wanted to be with himself.\n\nHe sat down and his mind was empty. Nothing. For some reason, he could not think of anything to think about. He was overwhelmed and felt strange.  \n\nHis vision started to tunnel, everyone in the park started to disappear. He realized that the doughnuts which he was surviving on for the last two days were probably not enough. He could not even move his eyes from the tree that he locked on to to avoid the couple who were about to enter his line of sight. They too disappeared in a few seconds, he felt a bit terrified, not enough to keep his curiosity at bay.\n\nWhen he finally turned to see if he was hallucinating he realized that all the people had been replaced with himself from different phases of his life. He saw himself on his first bike, just after he fell down and bruised his knees, himself when he was in school just after he was pinned down to a desk and got some disgustingly poignant water poured all over him, him just after he was dumped by the love of his life, it felt surreal. \n\nHe slowly turned to the right to see Stan Rogers, the last artist he listened to, give him a nod and started singing\n\n*\"It's a damn tough life full of toil and strife\"*\n\nHe turned around to see more of himself. The closer he looked at the apparitions he realized something, it was neither the first nor the last time that any of those things happened to him.\n\nHe could feel the sun and the wind like they were there just for him, he felt like he owned that moment. He felt like he was in control, he felt like he was in 'his' world. It felt strangely familiar.",
        "summary": [
            "The story follows a man who is constantly scrolling through social media and feeling unfulfilled with his own life.",
            "After a moment of realization, he decides to step outside and sit on a bench in the park.",
            "Suddenly, he is transported to different moments in his life and is visited by different versions of himself.",
            "Through this experience, he learns to take control of his own life and appreciate the present moment."
        ],
        "errors": [
            1,
            1,
            0,
            1
        ],
        "story-id": 13,
        "explanations": [
            "He is not transported to the moments, they appear in front of him in his current setting."
        ],
        "claims": [
            "1. The story features a man who frequently uses social media.",
            "2. The man feels unfulfilled with his own life due to his constant use of social media.",
            "3. The man experiences a moment of realization about his life situation.",
            "4. Following his realization, the man decides to go outside.",
            "5. The man chooses to sit on a bench in the park after going outside.",
            "6. While sitting on the bench, the man is transported to different moments in his life.",
            "7. Different versions of the man visit him during his experience on the bench.",
            "8. The man learns to take control of his own life through his experiences on the bench.",
            "9. The man learns to appreciate the present moment through his experiences on the bench."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049115rnsc": {
        "label": 1,
        "difficulty": "",
        "story": "The Painter Cat\n\n;\n\nCasey didn't want to take the job but she had to. She needed the money to pay the rent and selling her paintings wasn't covering it. She'd never worked as a maid before. She seldom cleaned her own house but when a woman at the grocery store remarked how badly she needed a housekeeper and was willing to pay, Casey sucked it up and introduced herself, offering her \"services\".\n\n;\n\nThe woman's name was Meredith. She was 77 years old. She had a modest home in a very nice neighborhood and had asked Casey to come twice a week. Casey would be paid 300 a week \u2013 which was pretty good. The first few times were uneventful. Meredith's house was well maintained and the work minimal. All seemed to be going well and then one day Meredith asked Casey to come into the study. She had a gift for her.\n\n;\n\nThe gift was a canvas, brushes and paint. Meredith wanted Casey to paint her. She would be paid 1000 dollars for the painting when it was finished. Casey accepted the offer immediately. Meredith only asked that Casey paint her as if she were 30 years old but wanted to sit as the model. Casey was confused at first. How to take an old woman and paint her as 30 without ever having known what she'd look like at that age. Meredith didn't seem too hung up on details, just told her to paint what she thought. Meredith took a seat on a chair near the window. The direct light defined every wrinkle and crevice in her sagging skin. Casey laid out the supplies and set about painting Meredith as she might have been at 30. It wasn't an easy task.\n\n;\n\nCasey painted the entire day. Meredith prepared them dinner and they resumed again shortly after. It got dark and Casey kept painting. The lamp light softened Meredith's features and Casey found herself enjoying the task and took liberty, creating Meredith as lush and fabulous as the soft golden light made her almost beautiful. By midnight the painting was done. Meredith found it remarkable and was overwhelmed with joy. Casey was about to sign it when Meredith stopped her and asked if she would simply sign it \"Reynaldo\".\n\n;\n\nCasey was confused. She didn't want to sign someone else's name to her work. Meredith insisted and offered no explanation. Casey, tired and confused, grew agitated with the old woman and insisted on signing her name \u2013 which she did. Meredith was so distraught she picked up the brush, set it into the black paint and set about destroying the painting. Casey tried to stop her but Meredith was determined. At last Meredith stepped back, dropped the brush and retreated into her bedroom.\n\n;\n\nCasey knocked on the door and could hear Meredith crying. She finally decided to let herself in. She said she was sorry and asked to be paid. Meredith slowly got up off the bed and went to a drawer where she took out a small box and counted out ten one hundred dollar bills. Casey took the money and left.\n\n;\n\nCasey now had the money she needed for rent and did not return to clean Meredith's house. At the grocery store later that week the manager appeared annoyed with her. When Casey commented, the manager told her that Meredith had paid for a painting and that Casey had argued the directions to sign Reynaldo at the bottom. Casey was furious at the suggestion of allowing anyone else to take advantage of her hard work and talent \u2013 to which the clerk snapped - Reynaldo had been Meredith's beloved cat and was a far better painter than Casey would ever be. He had seen the painting with his own eyes and thought it was a hideous disaster.\n\n;\n\nCasey left, angry. Weeks later she found herself without rent again and no prospects for work so she took up panhandling outside a coffee bar. When she had five dollars she went inside to purchase a bagel for lunch and was amazed to see several portraits of Meredith displayed on the walls, all of them signed \"Reynaldo\".\n\n;\n\nCasey ordered the bagel and remarked on the paintings. She was told they were painted by a cat which belonged to a woman named Meredith who was heir to a whiskey brand fortune.\n\n;\n\nCasey took her bagel and left. She was bummed that she could have peen paid lots of money to paint and that her prideful refusal had left her worse off than she had been in the beginning.",
        "summary": [
            "Casey, a struggling artist, becomes a housekeeper for Meredith, a 77-year-old woman to make ends meet.",
            "Meredith offers Casey $1000 to paint her as she imagines she would have looked at 30.",
            "After completing the painting, Casey is asked to sign it as \"Reynaldo,\" which she refuses to do, causing Meredith to ruin the painting.",
            "Stubborn Casey demands payment, leaves, and cuts ties with Meredith.",
            "She later learns that \"Reynaldo\" was Meredith's cat, who supposedly painted better than Casey, hurting her pride.",
            "In financial struggles again, Casey discovers several paintings by Reynaldo on the walls of a coffee shop, only to regret her decision.",
            "She laments her missed opportunity of getting paid well for painting due to her prideful behavior."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 14,
        "explanations": [],
        "claims": [
            "Casey is a struggling artist.",
            "Casey becomes a housekeeper for Meredith, a 77-year-old woman, to make ends meet.",
            "Meredith offers Casey $1000 to paint her as she imagines she would have looked at 30.",
            "After completing the painting, Casey is asked by Meredith to sign it as \u201cReynaldo.\u201d",
            "Casey refuses to sign the painting as \u201cReynaldo,\u201d causing Meredith to ruin the painting.",
            "Casey demands payment from Meredith after the painting is ruined.",
            "Casey leaves Meredith's employment and cuts ties with her.",
            "Casey later learns that \u201cReynaldo\u201d was Meredith's cat, who supposedly painted better than Casey.",
            "Casey's pride is hurt after learning the truth about \u201cReynaldo.\u201d",
            "Casey faces financial struggles again after leaving Meredith's employment.",
            "Casey discovers several paintings by Reynaldo on the walls of a coffee shop.",
            "Casey regrets her decision to refuse signing the painting as \u201cReynaldo\u201d due to her prideful behavior.",
            "Casey laments her missed opportunity of getting paid well for painting due to her prideful behavior."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479115rnsc": {
        "label": 1,
        "difficulty": "",
        "story": "The Painter Cat\n\n;\n\nCasey didn't want to take the job but she had to. She needed the money to pay the rent and selling her paintings wasn't covering it. She'd never worked as a maid before. She seldom cleaned her own house but when a woman at the grocery store remarked how badly she needed a housekeeper and was willing to pay, Casey sucked it up and introduced herself, offering her \"services\".\n\n;\n\nThe woman's name was Meredith. She was 77 years old. She had a modest home in a very nice neighborhood and had asked Casey to come twice a week. Casey would be paid 300 a week \u2013 which was pretty good. The first few times were uneventful. Meredith's house was well maintained and the work minimal. All seemed to be going well and then one day Meredith asked Casey to come into the study. She had a gift for her.\n\n;\n\nThe gift was a canvas, brushes and paint. Meredith wanted Casey to paint her. She would be paid 1000 dollars for the painting when it was finished. Casey accepted the offer immediately. Meredith only asked that Casey paint her as if she were 30 years old but wanted to sit as the model. Casey was confused at first. How to take an old woman and paint her as 30 without ever having known what she'd look like at that age. Meredith didn't seem too hung up on details, just told her to paint what she thought. Meredith took a seat on a chair near the window. The direct light defined every wrinkle and crevice in her sagging skin. Casey laid out the supplies and set about painting Meredith as she might have been at 30. It wasn't an easy task.\n\n;\n\nCasey painted the entire day. Meredith prepared them dinner and they resumed again shortly after. It got dark and Casey kept painting. The lamp light softened Meredith's features and Casey found herself enjoying the task and took liberty, creating Meredith as lush and fabulous as the soft golden light made her almost beautiful. By midnight the painting was done. Meredith found it remarkable and was overwhelmed with joy. Casey was about to sign it when Meredith stopped her and asked if she would simply sign it \"Reynaldo\".\n\n;\n\nCasey was confused. She didn't want to sign someone else's name to her work. Meredith insisted and offered no explanation. Casey, tired and confused, grew agitated with the old woman and insisted on signing her name \u2013 which she did. Meredith was so distraught she picked up the brush, set it into the black paint and set about destroying the painting. Casey tried to stop her but Meredith was determined. At last Meredith stepped back, dropped the brush and retreated into her bedroom.\n\n;\n\nCasey knocked on the door and could hear Meredith crying. She finally decided to let herself in. She said she was sorry and asked to be paid. Meredith slowly got up off the bed and went to a drawer where she took out a small box and counted out ten one hundred dollar bills. Casey took the money and left.\n\n;\n\nCasey now had the money she needed for rent and did not return to clean Meredith's house. At the grocery store later that week the manager appeared annoyed with her. When Casey commented, the manager told her that Meredith had paid for a painting and that Casey had argued the directions to sign Reynaldo at the bottom. Casey was furious at the suggestion of allowing anyone else to take advantage of her hard work and talent \u2013 to which the clerk snapped - Reynaldo had been Meredith's beloved cat and was a far better painter than Casey would ever be. He had seen the painting with his own eyes and thought it was a hideous disaster.\n\n;\n\nCasey left, angry. Weeks later she found herself without rent again and no prospects for work so she took up panhandling outside a coffee bar. When she had five dollars she went inside to purchase a bagel for lunch and was amazed to see several portraits of Meredith displayed on the walls, all of them signed \"Reynaldo\".\n\n;\n\nCasey ordered the bagel and remarked on the paintings. She was told they were painted by a cat which belonged to a woman named Meredith who was heir to a whiskey brand fortune.\n\n;\n\nCasey took her bagel and left. She was bummed that she could have peen paid lots of money to paint and that her prideful refusal had left her worse off than she had been in the beginning.",
        "summary": [
            "In the story \"The Painter Cat,\" Casey, a struggling artist, takes a job as a maid for an elderly woman named Meredith to make ends meet.",
            "One day, Meredith offers Casey $1,000 to paint a portrait of her as a 30-year-old woman.",
            "Casey accepts the offer and works hard to create the painting, taking artistic liberties to make Meredith appear youthful and beautiful.When the painting is finished, Meredith insists that Casey sign the name \"Reynaldo\" instead of her own.",
            "Casey refuses and signs her own name, causing Meredith to become distraught and destroy the painting.",
            "Casey leaves with the money but feels confused about the situation.Later, Casey learns from a grocery store manager that Reynaldo was actually Meredith's beloved cat, who was a better painter than Casey.",
            "Weeks later, struggling financially again, Casey sees several portraits of Meredith displayed in a coffee bar, all signed by \"Reynaldo.\"",
            "She discovers that Meredith is the heir to a whiskey brand fortune and that the paintings were created by her cat.In the end, Casey realizes that her pride and refusal to follow Meredith's request cost her the opportunity to earn more money and left her in a worse situation than before."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 14,
        "explanations": [],
        "claims": [
            "Casey is a struggling artist.",
            "Casey takes a job as a maid for an elderly woman named Meredith to make ends meet.",
            "Meredith offers Casey $1,000 to paint a portrait of her as a 30-year-old woman.",
            "Casey accepts Meredith's offer to paint the portrait.",
            "Casey works hard to create the painting, taking artistic liberties to make Meredith appear youthful and beautiful.",
            "Upon completion of the painting, Meredith insists that Casey sign the name \"Reynaldo\" instead of her own.",
            "Casey refuses to sign the name \"Reynaldo\" on the painting and signs her own name instead.",
            "Meredith becomes distraught and destroys the painting after Casey signs her own name.",
            "Casey leaves Meredith's employment with the $1,000 but feels confused about the situation.",
            "Casey learns from a grocery store manager that Reynaldo was Meredith's beloved cat.",
            "The grocery store manager informs Casey that Reynaldo was a better painter than she is.",
            "Weeks after leaving Meredith's employment, Casey sees several portraits of Meredith displayed in a coffee bar, all signed by \"Reynaldo.\"",
            "Casey discovers that Meredith is the heir to a whiskey brand fortune.",
            "Casey finds out that the portraits of Meredith were created by her cat, Reynaldo.",
            "Casey realizes that her pride and refusal to follow Meredith's request cost her the opportunity to earn more money.",
            "Casey ends up in a worse financial situation than before after refusing to sign the painting as \"Reynaldo.\""
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473115rnsc": {
        "label": 0,
        "difficulty": "easy",
        "story": "The Painter Cat\n\n;\n\nCasey didn't want to take the job but she had to. She needed the money to pay the rent and selling her paintings wasn't covering it. She'd never worked as a maid before. She seldom cleaned her own house but when a woman at the grocery store remarked how badly she needed a housekeeper and was willing to pay, Casey sucked it up and introduced herself, offering her \"services\".\n\n;\n\nThe woman's name was Meredith. She was 77 years old. She had a modest home in a very nice neighborhood and had asked Casey to come twice a week. Casey would be paid 300 a week \u2013 which was pretty good. The first few times were uneventful. Meredith's house was well maintained and the work minimal. All seemed to be going well and then one day Meredith asked Casey to come into the study. She had a gift for her.\n\n;\n\nThe gift was a canvas, brushes and paint. Meredith wanted Casey to paint her. She would be paid 1000 dollars for the painting when it was finished. Casey accepted the offer immediately. Meredith only asked that Casey paint her as if she were 30 years old but wanted to sit as the model. Casey was confused at first. How to take an old woman and paint her as 30 without ever having known what she'd look like at that age. Meredith didn't seem too hung up on details, just told her to paint what she thought. Meredith took a seat on a chair near the window. The direct light defined every wrinkle and crevice in her sagging skin. Casey laid out the supplies and set about painting Meredith as she might have been at 30. It wasn't an easy task.\n\n;\n\nCasey painted the entire day. Meredith prepared them dinner and they resumed again shortly after. It got dark and Casey kept painting. The lamp light softened Meredith's features and Casey found herself enjoying the task and took liberty, creating Meredith as lush and fabulous as the soft golden light made her almost beautiful. By midnight the painting was done. Meredith found it remarkable and was overwhelmed with joy. Casey was about to sign it when Meredith stopped her and asked if she would simply sign it \"Reynaldo\".\n\n;\n\nCasey was confused. She didn't want to sign someone else's name to her work. Meredith insisted and offered no explanation. Casey, tired and confused, grew agitated with the old woman and insisted on signing her name \u2013 which she did. Meredith was so distraught she picked up the brush, set it into the black paint and set about destroying the painting. Casey tried to stop her but Meredith was determined. At last Meredith stepped back, dropped the brush and retreated into her bedroom.\n\n;\n\nCasey knocked on the door and could hear Meredith crying. She finally decided to let herself in. She said she was sorry and asked to be paid. Meredith slowly got up off the bed and went to a drawer where she took out a small box and counted out ten one hundred dollar bills. Casey took the money and left.\n\n;\n\nCasey now had the money she needed for rent and did not return to clean Meredith's house. At the grocery store later that week the manager appeared annoyed with her. When Casey commented, the manager told her that Meredith had paid for a painting and that Casey had argued the directions to sign Reynaldo at the bottom. Casey was furious at the suggestion of allowing anyone else to take advantage of her hard work and talent \u2013 to which the clerk snapped - Reynaldo had been Meredith's beloved cat and was a far better painter than Casey would ever be. He had seen the painting with his own eyes and thought it was a hideous disaster.\n\n;\n\nCasey left, angry. Weeks later she found herself without rent again and no prospects for work so she took up panhandling outside a coffee bar. When she had five dollars she went inside to purchase a bagel for lunch and was amazed to see several portraits of Meredith displayed on the walls, all of them signed \"Reynaldo\".\n\n;\n\nCasey ordered the bagel and remarked on the paintings. She was told they were painted by a cat which belonged to a woman named Meredith who was heir to a whiskey brand fortune.\n\n;\n\nCasey took her bagel and left. She was bummed that she could have peen paid lots of money to paint and that her prideful refusal had left her worse off than she had been in the beginning.",
        "summary": [
            "Casey, a struggling artist, reluctantly takes a job as a maid for an elderly woman named Meredith.",
            "One day, Meredith asks Casey to paint a portrait of her as if she were 30 years old, and promises to pay her $1000.",
            "While painting, Casey takes creative liberties and signs her own name on the painting.",
            "Meredith becomes upset and destroys the painting, leading Casey to leave and demand payment.",
            "Later, Casey discovers that Meredith's cat, Reynaldo, is actually the talented painter behind the portraits.",
            "Casey regrets not following Meredith's instructions and losing out on the opportunity to make money through her art."
        ],
        "errors": [
            1,
            1,
            0,
            1,
            0,
            1
        ],
        "story-id": 14,
        "explanations": [
            "Casey is not taking creative liberties. Meredith asks her to sign the painting Reynaldo, and Casey refuses.",
            "It's most likely that the cat was not actually the painter and Meredith has been using this scheme of hiring painters and then having them sign her cat's name."
        ],
        "claims": [
            "Casey is a struggling artist.",
            "Casey reluctantly takes a job as a maid for an elderly woman named Meredith.",
            "One day, Meredith asks Casey to paint a portrait of her as if she were 30 years old.",
            "Meredith promises to pay Casey $1000 for the portrait.",
            "While painting, Casey takes creative liberties with the portrait.",
            "Casey signs her own name on the painting she creates for Meredith.",
            "Meredith becomes upset upon seeing the painting.",
            "Meredith destroys the painting after seeing it.",
            "Following the destruction of the painting, Casey leaves Meredith's employment and demands payment.",
            "Later, Casey discovers that Meredith's cat, Reynaldo, is the talented painter behind the portraits.",
            "Casey regrets not following Meredith's instructions.",
            "Casey regrets losing out on the opportunity to make money through her art."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049119uvro": {
        "label": 1,
        "difficulty": "",
        "story": "I've done everything I possibly can over the years. Sometimes just to survive, other times in the hope that it can all come to an end. Everything has been to no avail.\n\nHere I am.\n\nStill.\n\nI'm Hope and I'm 315 years old. I look no older than 16 though. Time has stopped for me, but keeps on passing by for all those around me. Over the years, I have been eaten up by jealously of those that get to grow up, to live their lives and most importantly die as was intended.\n\nI bet you think I'm a vampire, don't you? I wish... I could just step out into the sun to end it all, if that was the case. Maybe a silver bullet could be my way out. Death by Garlic bread would be actually quite an amazing way to go... but no. Not a vampire. My heart beats just like yours, I breathe just like you. My problem is that my father was one of the magistrates during the Salem Witch trials. He was one of those that were responsible for the last death sentences handed out.\n\nI remember being in the court room on that day. I remember Margaret Scott locking eyes with my father after they sentenced to death and saying \"Hope dies last\". I remember the chill tingling up my spine, I remember admiring the woman for not giving up. Strange thing is, I don't remember the moment when I realized that wasn't a last attempt at positivity, but a curse. She cursed my father, with me as the vessel.\n\nThe irony of it? I had argued relentlessly with my father about his part in those diabolical trials. I begged and pleased of him to step down, but apparently it had gone too far and if he did that, there would be questions as to why. It could risk our lives and open our family up for accusations. So he continued. Because of that... Here I am... still...\n\nI always like Margaret and would often sneak her some bread and cheese. She had been left destitute following the death of her husband. It's not like nowadays where there is some level of support in place, granted not the best, but so much better than it used to be 'back in the day'. That makes me sad. A person that I always found pleasant cursed me to this life.\n\nI was so distraught at my father's involvement in ther trials that I left that night, never to return to Salem until last year.  I don't know what brought me back.  I could barely fight it, so decided to 'go with the flow'... And here I am, living in the same house as I did back then.  Granted, it's changed now.  And the house has been split up into tiny apartments and by some coincidence I am in the part of the house that used to be my bedroom. \n\nMy inability to age must sound like a dream. But I can assure you it's not. Imagine being 16 forever. Not being old-looking enough to be an adult certainly makes it difficult to do much of anything - I can only ever get menial jobs, live in dodgy areas, because that's what I can afford with my wages. I can't stay in an area more than a few years because questions start to raise. After over 300 years of working I am exhausted and must have earned a nice pension many times over. I've never been sick in the past \u2013 not even a cold. I wish for a terminal disease, surely cancer can beat me?  Maybe I need to find that glitch in the 'system'.... who knows...\n\nWith every war, every pandemic I have held onto the Hope that the end of the world is nigh. Unfortunately, us humans are a resilient bunch \u2013 we're not going anywhere any time soon.\n\nAs morbid as it is, I have a list on me of all female infants and young girls that have passed away in any area I live in, collected from cemeteries and obituaries so that I can steal their identities, their social security numbers and so forth. I feel dirty every time I do it, but if I can't die, I need to survive. \n\nNext on my list is a little baby girl, who died 16 years ago. Hope Elizabeth Scott.... Happens to be my name, well apart from the surname...  A coincidence that she shares her surname with poor Margaret? Her whole family perished in a fire in my old neighbourhood in Salem. She fought for weeks in ICU, before passing. With her death, came the end of her family's linage.\n\nI've been in touch with a questionable type who will get me all my paperwork in place. This time it feels different. Is it a coincidence? Or maybe this is my way out?\n\nMaybe Hope does die last after all...",
        "summary": [
            "A woman named Hope, who is over 315 years old but forever looks 16, narrates her life story.",
            "A victim of Margaret Scott's curse during the Salem Witch Trials, she's immortal and unable to age.",
            "The curse was ironically placed upon her because her father, a judge in the trials, continued to participate in them despite her pleas.",
            "Throughout the years, Hope has been jealous watching others live their lives, grow old and ultimately die while she is frozen in time.",
            "However, she finds a glimmer of hope when she plans to assume the identity of a deceased baby girl named Hope Elizabeth Scott, whose family also perished in a fire in Salem.",
            "She hints at the possibility of this being her opportunity to break the curse at last."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 15,
        "explanations": [],
        "claims": [
            "A woman named Hope is over 315 years old but appears to be 16 years old.",
            "Hope narrates her life story.",
            "Hope became immortal and unable to age due to a curse placed on her by Margaret Scott during the Salem Witch Trials.",
            "Hope's father was a judge in the Salem Witch Trials.",
            "Hope's father continued to participate in the Salem Witch Trials despite Hope's pleas for him to stop.",
            "Over the years, Hope has felt jealousy watching others live their lives, grow old, and die.",
            "Hope is unable to grow old and is frozen in time due to the curse.",
            "Hope plans to assume the identity of a deceased baby girl named Hope Elizabeth Scott.",
            "Hope Elizabeth Scott and her family perished in a fire in Salem.",
            "Hope believes that assuming the identity of Hope Elizabeth Scott may give her the opportunity to break the curse."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479119uvro": {
        "label": 0,
        "difficulty": "hard",
        "story": "I've done everything I possibly can over the years. Sometimes just to survive, other times in the hope that it can all come to an end. Everything has been to no avail.\n\nHere I am.\n\nStill.\n\nI'm Hope and I'm 315 years old. I look no older than 16 though. Time has stopped for me, but keeps on passing by for all those around me. Over the years, I have been eaten up by jealously of those that get to grow up, to live their lives and most importantly die as was intended.\n\nI bet you think I'm a vampire, don't you? I wish... I could just step out into the sun to end it all, if that was the case. Maybe a silver bullet could be my way out. Death by Garlic bread would be actually quite an amazing way to go... but no. Not a vampire. My heart beats just like yours, I breathe just like you. My problem is that my father was one of the magistrates during the Salem Witch trials. He was one of those that were responsible for the last death sentences handed out.\n\nI remember being in the court room on that day. I remember Margaret Scott locking eyes with my father after they sentenced to death and saying \"Hope dies last\". I remember the chill tingling up my spine, I remember admiring the woman for not giving up. Strange thing is, I don't remember the moment when I realized that wasn't a last attempt at positivity, but a curse. She cursed my father, with me as the vessel.\n\nThe irony of it? I had argued relentlessly with my father about his part in those diabolical trials. I begged and pleased of him to step down, but apparently it had gone too far and if he did that, there would be questions as to why. It could risk our lives and open our family up for accusations. So he continued. Because of that... Here I am... still...\n\nI always like Margaret and would often sneak her some bread and cheese. She had been left destitute following the death of her husband. It's not like nowadays where there is some level of support in place, granted not the best, but so much better than it used to be 'back in the day'. That makes me sad. A person that I always found pleasant cursed me to this life.\n\nI was so distraught at my father's involvement in ther trials that I left that night, never to return to Salem until last year.  I don't know what brought me back.  I could barely fight it, so decided to 'go with the flow'... And here I am, living in the same house as I did back then.  Granted, it's changed now.  And the house has been split up into tiny apartments and by some coincidence I am in the part of the house that used to be my bedroom. \n\nMy inability to age must sound like a dream. But I can assure you it's not. Imagine being 16 forever. Not being old-looking enough to be an adult certainly makes it difficult to do much of anything - I can only ever get menial jobs, live in dodgy areas, because that's what I can afford with my wages. I can't stay in an area more than a few years because questions start to raise. After over 300 years of working I am exhausted and must have earned a nice pension many times over. I've never been sick in the past \u2013 not even a cold. I wish for a terminal disease, surely cancer can beat me?  Maybe I need to find that glitch in the 'system'.... who knows...\n\nWith every war, every pandemic I have held onto the Hope that the end of the world is nigh. Unfortunately, us humans are a resilient bunch \u2013 we're not going anywhere any time soon.\n\nAs morbid as it is, I have a list on me of all female infants and young girls that have passed away in any area I live in, collected from cemeteries and obituaries so that I can steal their identities, their social security numbers and so forth. I feel dirty every time I do it, but if I can't die, I need to survive. \n\nNext on my list is a little baby girl, who died 16 years ago. Hope Elizabeth Scott.... Happens to be my name, well apart from the surname...  A coincidence that she shares her surname with poor Margaret? Her whole family perished in a fire in my old neighbourhood in Salem. She fought for weeks in ICU, before passing. With her death, came the end of her family's linage.\n\nI've been in touch with a questionable type who will get me all my paperwork in place. This time it feels different. Is it a coincidence? Or maybe this is my way out?\n\nMaybe Hope does die last after all...",
        "summary": [
            "In this haunting story, the protagonist, Hope, is a 315-year-old girl cursed with eternal youth by Margaret Scott, a woman sentenced to death during the Salem Witch Trials.",
            "Hope's father was one of the magistrates responsible for the death sentences, and despite Hope's pleas for him to step down, he continued his involvement, leading to Margaret cursing Hope.",
            "Trapped in the body of a 16-year-old, Hope struggles with the limitations of her apparent age, unable to secure decent jobs or live in better areas.",
            "She is forced to move frequently to avoid raising suspicions about her agelessness.",
            "Despite her longing for death, Hope remains resilient, even in the face of wars and pandemics.",
            "To survive, Hope resorts to stealing the identities of deceased young girls, a process that leaves her feeling tainted.",
            "The story takes a curious turn when Hope discovers her next identity: Hope Elizabeth Scott, a baby girl who died 16 years ago, sharing the same first name and the surname of Margaret Scott.",
            "As Hope prepares to assume this new identity, she wonders if it is mere coincidence or a sign that her eternal existence may finally come to an end, suggesting that perhaps \"Hope does die last\" after all."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            0,
            1,
            1,
            1
        ],
        "story-id": 15,
        "explanations": [
            "The summary uses \"resilient\" as though it refers to her spirit/outlook which is not accurate."
        ],
        "claims": [
            "Hope is a 315-year-old girl.",
            "Hope was cursed with eternal youth by Margaret Scott.",
            "Margaret Scott was sentenced to death during the Salem Witch Trials.",
            "Hope's father was a magistrate responsible for death sentences during the Salem Witch Trials.",
            "Hope pleaded with her father to step down from his role as magistrate.",
            "Despite Hope's pleas, her father continued his involvement in the trials.",
            "Margaret Scott cursed Hope in response to her father's actions.",
            "Hope is trapped in the body of a 16-year-old.",
            "Hope struggles to secure decent jobs due to her apparent age.",
            "Hope struggles to live in better areas due to her apparent age.",
            "Hope is forced to move frequently to avoid raising suspicions about her agelessness.",
            "Hope longs for death.",
            "Hope remains resilient despite living through wars and pandemics.",
            "Hope steals the identities of deceased young girls to survive.",
            "Stealing identities makes Hope feel tainted.",
            "Hope discovers a deceased baby girl named Hope Elizabeth Scott, who died 16 years ago.",
            "Hope Elizabeth Scott shares the same first name and the surname of Margaret Scott.",
            "Hope considers assuming the identity of Hope Elizabeth Scott.",
            "Hope wonders if the similarity in names is a coincidence or a sign that her eternal existence may come to an end.",
            "Hope suggests that perhaps \"Hope does die last\" after all."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473119uvro": {
        "label": 0,
        "difficulty": "easy",
        "story": "I've done everything I possibly can over the years. Sometimes just to survive, other times in the hope that it can all come to an end. Everything has been to no avail.\n\nHere I am.\n\nStill.\n\nI'm Hope and I'm 315 years old. I look no older than 16 though. Time has stopped for me, but keeps on passing by for all those around me. Over the years, I have been eaten up by jealously of those that get to grow up, to live their lives and most importantly die as was intended.\n\nI bet you think I'm a vampire, don't you? I wish... I could just step out into the sun to end it all, if that was the case. Maybe a silver bullet could be my way out. Death by Garlic bread would be actually quite an amazing way to go... but no. Not a vampire. My heart beats just like yours, I breathe just like you. My problem is that my father was one of the magistrates during the Salem Witch trials. He was one of those that were responsible for the last death sentences handed out.\n\nI remember being in the court room on that day. I remember Margaret Scott locking eyes with my father after they sentenced to death and saying \"Hope dies last\". I remember the chill tingling up my spine, I remember admiring the woman for not giving up. Strange thing is, I don't remember the moment when I realized that wasn't a last attempt at positivity, but a curse. She cursed my father, with me as the vessel.\n\nThe irony of it? I had argued relentlessly with my father about his part in those diabolical trials. I begged and pleased of him to step down, but apparently it had gone too far and if he did that, there would be questions as to why. It could risk our lives and open our family up for accusations. So he continued. Because of that... Here I am... still...\n\nI always like Margaret and would often sneak her some bread and cheese. She had been left destitute following the death of her husband. It's not like nowadays where there is some level of support in place, granted not the best, but so much better than it used to be 'back in the day'. That makes me sad. A person that I always found pleasant cursed me to this life.\n\nI was so distraught at my father's involvement in ther trials that I left that night, never to return to Salem until last year.  I don't know what brought me back.  I could barely fight it, so decided to 'go with the flow'... And here I am, living in the same house as I did back then.  Granted, it's changed now.  And the house has been split up into tiny apartments and by some coincidence I am in the part of the house that used to be my bedroom. \n\nMy inability to age must sound like a dream. But I can assure you it's not. Imagine being 16 forever. Not being old-looking enough to be an adult certainly makes it difficult to do much of anything - I can only ever get menial jobs, live in dodgy areas, because that's what I can afford with my wages. I can't stay in an area more than a few years because questions start to raise. After over 300 years of working I am exhausted and must have earned a nice pension many times over. I've never been sick in the past \u2013 not even a cold. I wish for a terminal disease, surely cancer can beat me?  Maybe I need to find that glitch in the 'system'.... who knows...\n\nWith every war, every pandemic I have held onto the Hope that the end of the world is nigh. Unfortunately, us humans are a resilient bunch \u2013 we're not going anywhere any time soon.\n\nAs morbid as it is, I have a list on me of all female infants and young girls that have passed away in any area I live in, collected from cemeteries and obituaries so that I can steal their identities, their social security numbers and so forth. I feel dirty every time I do it, but if I can't die, I need to survive. \n\nNext on my list is a little baby girl, who died 16 years ago. Hope Elizabeth Scott.... Happens to be my name, well apart from the surname...  A coincidence that she shares her surname with poor Margaret? Her whole family perished in a fire in my old neighbourhood in Salem. She fought for weeks in ICU, before passing. With her death, came the end of her family's linage.\n\nI've been in touch with a questionable type who will get me all my paperwork in place. This time it feels different. Is it a coincidence? Or maybe this is my way out?\n\nMaybe Hope does die last after all...",
        "summary": [
            "A 315-year-old woman named Hope is cursed to live forever at the age of 16 after her father's involvement in the Salem Witch Trials.",
            "Unable to age or die, she has been living a lonely and difficult life, constantly moving and stealing the identities of deceased young girls.",
            "However, she may have found a way to end her eternal existence with the help of a recently deceased infant who shares her name."
        ],
        "errors": [
            0,
            1,
            0
        ],
        "story-id": 15,
        "explanations": [
            "She was not cursed to live forever, she was cursed to \"die last\".",
            "The infant was not recently deceased. It was 16 years ago."
        ],
        "claims": [
            "1. Hope is a 315-year-old woman.",
            "2. Hope is cursed to live forever at the age of 16.",
            "3. Hope's curse is a result of her father's involvement in the Salem Witch Trials.",
            "4. Hope is unable to age.",
            "5. Hope is unable to die.",
            "6. Hope has been living a lonely life.",
            "7. Hope has been living a difficult life.",
            "8. Hope constantly moves to new locations.",
            "9. Hope steals the identities of deceased young girls.",
            "10. Hope may have found a way to end her eternal existence.",
            "11. Hope's potential way to end her eternal existence involves the help of a recently deceased infant.",
            "12. The recently deceased infant shares the same name as Hope."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "79115223876469740492aryso": {
        "label": 0,
        "difficulty": "hard",
        "story": "Damian shook his head. How is it that he ended up here, on the death train? He wanted to tell himself it was all some big misunderstanding, but part of him knew it was more than that. But still - what a terrible place to find yourself. Sure, most were there voluntarily, those who were \"ready to go\" and didn't have the guts to do it themselves. There were of course a population of psychopathic thrill seekers, those who tried to time the jump off of the standing mat to prevent the electrocution but bring themselves intensely close to death. Then there were those who offended the public's sense of decency- the unsuccessful jumpers, those who threw themselves in front of cars and buses. Really anyone who tried to off themselves in public was taken to the train. You were, of course, welcome to botch as many suicides as you liked in the comfort of your own home, but do it in public by any means, and the train was where you went.\n\nAt least the train traveled through the country. Damien's ex, who admittedly was the cause of his public misunderstanding who landed him here, was in Tampa. If he could just make it there to see her one more time, he'd be fine going out. The trouble wouldn't be in timing the jumps, he'd heard enough stories about how so-and-so's friend lasted 18 stops by timing his jumps with the windup of the buzz, before the shock ripped through the metal plating. The problem, as Damien saw it, was that all of these stories ended the same way- a missed jump, and then the buzz. It made sense, it'd be nearly impossible to time those jumps while drugged by the warden. That would be Damien's biggest challenge. Even if Alyssa showed up at the Tampa station so he could see her face one last time, he'd have to make 24 jumps in complete sobriety, which meant going without food for at least two or three days before the stop. The death train was not an attraction to see the country for free, and it was rumored the headmaster bent the rules of the train from time to time to make sure it didn't become one.",
        "summary": [
            "The story follows Damian's journey of self-discovery and introspection on the so-called \"death train\".",
            "He finds himself on this train after a public disruption, caused by an issue with his ex-girlfriend, Alyssa.",
            "This train is home to people ready to die, psychopathic thrill-seekers and those who have disrupted societal norms by attempting suicide in public.",
            "Those on the train must repeatedly jump on a standing mat to avoid electrocution and imminent death.",
            "Damian faces the challenge of staying alive until reaching Tampa, to see Alyssa, whilst also avoiding the psychoactive solution provided by the warden.",
            "The story implies that staying alive on the train is a complex balance of staying sober, timing jumps perfectly, and avoiding the headmaster's attempts to prevent it from becoming a free tour."
        ],
        "errors": [
            0,
            1,
            1,
            1,
            0,
            1
        ],
        "story-id": 16,
        "explanations": [
            "This is not a journey of self-discovery.",
            "It is not specified that the drug is a psychoactive solution."
        ],
        "claims": [
            "Damian embarks on a journey of self-discovery and introspection on the \"death train\".",
            "Damian finds himself on the \"death train\" following a public disruption caused by an issue with his ex-girlfriend, Alyssa.",
            "The \"death train\" is populated by individuals ready to die, psychopathic thrill-seekers, and those who have disrupted societal norms by attempting suicide in public.",
            "Passengers on the train must repeatedly jump on a standing mat to avoid electrocution and imminent death.",
            "Damian's goal is to stay alive until the train reaches Tampa, where he plans to see Alyssa.",
            "Damian attempts to avoid consuming the psychoactive solution provided by the warden of the train.",
            "The story suggests that survival on the train requires a balance of staying sober, timing jumps perfectly, and evading the headmaster's efforts to prevent the journey from becoming a free tour."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "81670585335894792aryso": {
        "label": 0,
        "difficulty": "hard",
        "story": "Damian shook his head. How is it that he ended up here, on the death train? He wanted to tell himself it was all some big misunderstanding, but part of him knew it was more than that. But still - what a terrible place to find yourself. Sure, most were there voluntarily, those who were \"ready to go\" and didn't have the guts to do it themselves. There were of course a population of psychopathic thrill seekers, those who tried to time the jump off of the standing mat to prevent the electrocution but bring themselves intensely close to death. Then there were those who offended the public's sense of decency- the unsuccessful jumpers, those who threw themselves in front of cars and buses. Really anyone who tried to off themselves in public was taken to the train. You were, of course, welcome to botch as many suicides as you liked in the comfort of your own home, but do it in public by any means, and the train was where you went.\n\nAt least the train traveled through the country. Damien's ex, who admittedly was the cause of his public misunderstanding who landed him here, was in Tampa. If he could just make it there to see her one more time, he'd be fine going out. The trouble wouldn't be in timing the jumps, he'd heard enough stories about how so-and-so's friend lasted 18 stops by timing his jumps with the windup of the buzz, before the shock ripped through the metal plating. The problem, as Damien saw it, was that all of these stories ended the same way- a missed jump, and then the buzz. It made sense, it'd be nearly impossible to time those jumps while drugged by the warden. That would be Damien's biggest challenge. Even if Alyssa showed up at the Tampa station so he could see her face one last time, he'd have to make 24 jumps in complete sobriety, which meant going without food for at least two or three days before the stop. The death train was not an attraction to see the country for free, and it was rumored the headmaster bent the rules of the train from time to time to make sure it didn't become one.",
        "summary": [
            "In this story, Damian finds himself on the \"death train,\" a place where people who have attempted suicide in public or offended public decency are sent.",
            "The train is populated by various types of individuals, including those who voluntarily choose to end their lives, thrill-seekers who try to cheat death by timing their jumps off the standing mat to avoid electrocution, and those who have botched their suicide attempts in public.",
            "Damian's goal is to make it to Tampa to see his ex-girlfriend, Alyssa, one last time before he dies.",
            "However, the challenge lies in making 24 jumps off the train while completely sober, as the warden drugs the passengers' food.",
            "This means Damian must go without food for two to three days before the Tampa stop to ensure he can time his jumps correctly.",
            "The story suggests that the death train is not meant to be a free way to see the country and that the headmaster may bend the rules to prevent it from becoming an attraction.",
            "Damian's journey on the death train is a grim and challenging one, with his ultimate fate left uncertain."
        ],
        "errors": [
            1,
            1,
            1,
            0,
            1,
            1,
            1
        ],
        "story-id": 16,
        "explanations": [
            "He must make 24 jumps on the standing mat, not off the train."
        ],
        "claims": [
            "Damian finds himself on the \"death train,\" a place designated for people who have attempted suicide in public or offended public decency.",
            "The \"death train\" is populated by individuals who have voluntarily chosen to end their lives.",
            "The \"death train\" is also populated by thrill-seekers who attempt to cheat death by timing their jumps off the standing mat to avoid electrocution.",
            "Some passengers on the \"death train\" are individuals who have botched their suicide attempts in public.",
            "Damian's goal is to reach Tampa to see his ex-girlfriend, Alyssa, one last time before he dies.",
            "Damian faces the challenge of making 24 jumps off the train while completely sober.",
            "The warden of the \"death train\" drugs the passengers' food.",
            "To ensure he can time his jumps correctly, Damian must go without food for two to three days before the Tampa stop.",
            "The story suggests that the \"death train\" is not intended as a free way to see the country.",
            "The headmaster of the \"death train\" may bend the rules to prevent the train from becoming an attraction.",
            "Damian's journey on the \"death train\" is described as grim and challenging.",
            "The ultimate fate of Damian on the \"death train\" is left uncertain."
        ],
        "split": "test",
        "model": "claude"
    },
    "73409150676328394732aryso": {
        "label": 0,
        "difficulty": "hard",
        "story": "Damian shook his head. How is it that he ended up here, on the death train? He wanted to tell himself it was all some big misunderstanding, but part of him knew it was more than that. But still - what a terrible place to find yourself. Sure, most were there voluntarily, those who were \"ready to go\" and didn't have the guts to do it themselves. There were of course a population of psychopathic thrill seekers, those who tried to time the jump off of the standing mat to prevent the electrocution but bring themselves intensely close to death. Then there were those who offended the public's sense of decency- the unsuccessful jumpers, those who threw themselves in front of cars and buses. Really anyone who tried to off themselves in public was taken to the train. You were, of course, welcome to botch as many suicides as you liked in the comfort of your own home, but do it in public by any means, and the train was where you went.\n\nAt least the train traveled through the country. Damien's ex, who admittedly was the cause of his public misunderstanding who landed him here, was in Tampa. If he could just make it there to see her one more time, he'd be fine going out. The trouble wouldn't be in timing the jumps, he'd heard enough stories about how so-and-so's friend lasted 18 stops by timing his jumps with the windup of the buzz, before the shock ripped through the metal plating. The problem, as Damien saw it, was that all of these stories ended the same way- a missed jump, and then the buzz. It made sense, it'd be nearly impossible to time those jumps while drugged by the warden. That would be Damien's biggest challenge. Even if Alyssa showed up at the Tampa station so he could see her face one last time, he'd have to make 24 jumps in complete sobriety, which meant going without food for at least two or three days before the stop. The death train was not an attraction to see the country for free, and it was rumored the headmaster bent the rules of the train from time to time to make sure it didn't become one.",
        "summary": [
            "The story is about Damian, who is on a train known as the death train, where people who have attempted suicide in public are taken.",
            "He wants to see his ex-girlfriend in Tampa before he dies, but it is difficult to time the jumps due to being under the influence of drugs.",
            "The train travels throughout the country and is not meant for sightseeing.",
            "The headmaster sometimes bends the rules to prevent the train from becoming an attraction."
        ],
        "errors": [
            1,
            0,
            1,
            1
        ],
        "story-id": 16,
        "explanations": [
            "Damian is not under the influence of drugs, he is thinking about how to avoid it."
        ],
        "claims": [
            "Damian is on a train known as the death train.",
            "The death train is where people who have attempted suicide in public are taken.",
            "Damian wants to see his ex-girlfriend in Tampa before he dies.",
            "Timing jumps from the train is difficult for Damian because he is under the influence of drugs.",
            "The train travels throughout the country.",
            "The death train is not meant for sightseeing.",
            "The headmaster of the death train sometimes bends the rules.",
            "The headmaster's bending of the rules is to prevent the train from becoming an attraction."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049a94gm7": {
        "label": 0,
        "difficulty": "hard",
        "story": "My mom is old. Her vibrance gone. Bones brittle. Hair gray. Eyes glazed over from cataracts. Her skin patchworked with blood spots. And it is not clich\u00e9 to say it happened overnight. Just three years ago she was getting a monthly pedicure and keeping hair appointments to cut and color her once brown hair. With her five children grown and gone, she never stayed home. From the time she woke until dinner time, she was outside roaming in her car visiting friends and shopping. She was alive and loving every minute of her new freedom that was formerly restricted from being a full-time nurse, a housewife, and a mother.\n\nThen the accident changed everything. Three years ago she stepped off a sidewalk curb and lost her balance. Her right shoulder completely shattered, and it was how she discovered she had osteoporosis.  The entire shoulder had to be replaced. The surgeon picked out pieces of splintered bones and put in a round metal ball to give her about sixty percent use of her shoulder again. She suffered through the year long process and fell again, this time breaking a bone in her back and knee.  For the last few years, her car has been supplanted with a recliner.\n\nThe last few Christmas holidays have obviously not been the same. This one, however, will probably be the last. A few months ago I started to notice the memory problems. I visit her weekly and since the Breaking of Bones I have been spending every Saturday morning and night with her by sleeping in my old childhood room. The severity of the memory problems became more noticeable every week I returned. \n\nFor the first time since I was born, my mom forgot my birthday. Birthdays are more important to no one other than a mother\u2013at least, my mother. Birthdays were an event celebrated in my parents' home more than Christmas. My birthday, my brother's birthday, and my father's birthday are all in December. My mom forgot all three. No phone calls. No cards. No cake. No celebrations. We did not remind her. We only spoke of it amongst ourselves briefly to mention that we noticed. Maybe it did not need to be broached. More than likely, we were so saddened about the Great Forgetting that none of us could bring ourselves to discuss it. \n\nLast Thursday, just four days before Christmas, my mother told me when she was a teenager that she would eat the honeycombs from real bee honey. She said it was her favorite thing to eat as a child. She and her two sisters would sit on the porch and put the comb on an English muffin or biscuits. She said she would not eat oatmeal unless she had honeycomb pieces to put in it. Sometimes she would just suck on the honeycomb before finally eating it by itself. She and her two sisters felt rich if they had it. \"Honeycomb was not easy to come by in those days,\" she said. \"I can't remember what it tasted like but it was the best kind of candy. I wish I could taste it again.\"\n\nIt is said that men have trouble listening to women.  I had no trouble listening to my mom. I knew what her Christmas gift was going to be this year. I got Mom six separate quarts of honey with combs in them. I had to go to three different bee apiaries in two different states to get them. I spent no fewer than two days tracking down and purchasing honeycomb. (Apparently it is not a popular request with bee farmers.) The price was costly but would be worth it. It would be the best gift I have ever given my mom. \n\nThis year will be doubly special for me because I know this will be my mom's last Christmas. Her memory problem is exacerbating too quickly. The differences are noticeable now almost daily. But I had a secret I could not tell her for two more days until Christmas morning. Why can it not be Christmas Day right now so I can give her this gift right now! This is going to be her best Christmas. I am certain of it. I am going to drop a hint about her gift like she used to do with me as a child a few days before Christmas. Yesterday, while I was sitting on Mom's couch with her across me in her recliner, I asked, \"Mom, do you remember when you used to eat honeycombs on the porch with Pat and Dina?\"  She turned her head to face me with a blank stare. \n\n\"Honeycombs?\" She asked. \"Who told you that? No, I never ate honeycombs. Those things were gross.\"",
        "summary": [
            "The story is about the author's mother, who is now old and suffers from memory problems.",
            "This happened after an accident when she stepped off a sidewalk curb and shattered her shoulder, which led to her being diagnosed with osteoporosis.",
            "After this, her health degraded over the years and she became forgetful, even forgetting the birthdays of her children.",
            "The author, saddened and nostalgic, wanted to give her a meaningful gift for Christmas, and recalled her mother once speaking about how she used to love eating honeycombs as a child.",
            "The author goes on a two-day journey to separate bee farms to acquire jars of honey with combs in them.",
            "When he hints at the gift, asking his mother if she remembers eating honeycombs, she gives him a blank stare and denies having ever done so.",
            "They realize her memory is rapidly deteriorating."
        ],
        "errors": [
            1,
            1,
            1,
            0,
            1,
            1,
            1
        ],
        "story-id": 17,
        "explanations": [
            "The narrator is a man, but the summary uses a 'her' pronoun once for the narrator."
        ],
        "claims": [
            "The story is about the author's mother, who is now old.",
            "The author's mother suffers from memory problems.",
            "The author's mother had an accident where she stepped off a sidewalk curb.",
            "The accident resulted in the author's mother shattering her shoulder.",
            "After the accident, the author's mother was diagnosed with osteoporosis.",
            "Following the diagnosis, the author's mother's health degraded over the years.",
            "The degradation of the author's mother's health led to her becoming forgetful.",
            "The author's mother forgot the birthdays of her children.",
            "The author felt saddened and nostalgic about his mother's condition.",
            "The author wanted to give his mother a meaningful gift for Christmas.",
            "The author recalled a conversation where his mother mentioned she used to love eating honeycombs as a child.",
            "The author went on a two-day journey to acquire jars of honey with combs in them from separate bee farms.",
            "The author hinted at the Christmas gift by asking his mother if she remembers eating honeycombs.",
            "The author's mother gave him a blank stare and denied ever eating honeycombs.",
            "The author realizes his mother's memory is rapidly deteriorating."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479a94gm7": {
        "label": 1,
        "difficulty": "",
        "story": "My mom is old. Her vibrance gone. Bones brittle. Hair gray. Eyes glazed over from cataracts. Her skin patchworked with blood spots. And it is not clich\u00e9 to say it happened overnight. Just three years ago she was getting a monthly pedicure and keeping hair appointments to cut and color her once brown hair. With her five children grown and gone, she never stayed home. From the time she woke until dinner time, she was outside roaming in her car visiting friends and shopping. She was alive and loving every minute of her new freedom that was formerly restricted from being a full-time nurse, a housewife, and a mother.\n\nThen the accident changed everything. Three years ago she stepped off a sidewalk curb and lost her balance. Her right shoulder completely shattered, and it was how she discovered she had osteoporosis.  The entire shoulder had to be replaced. The surgeon picked out pieces of splintered bones and put in a round metal ball to give her about sixty percent use of her shoulder again. She suffered through the year long process and fell again, this time breaking a bone in her back and knee.  For the last few years, her car has been supplanted with a recliner.\n\nThe last few Christmas holidays have obviously not been the same. This one, however, will probably be the last. A few months ago I started to notice the memory problems. I visit her weekly and since the Breaking of Bones I have been spending every Saturday morning and night with her by sleeping in my old childhood room. The severity of the memory problems became more noticeable every week I returned. \n\nFor the first time since I was born, my mom forgot my birthday. Birthdays are more important to no one other than a mother\u2013at least, my mother. Birthdays were an event celebrated in my parents' home more than Christmas. My birthday, my brother's birthday, and my father's birthday are all in December. My mom forgot all three. No phone calls. No cards. No cake. No celebrations. We did not remind her. We only spoke of it amongst ourselves briefly to mention that we noticed. Maybe it did not need to be broached. More than likely, we were so saddened about the Great Forgetting that none of us could bring ourselves to discuss it. \n\nLast Thursday, just four days before Christmas, my mother told me when she was a teenager that she would eat the honeycombs from real bee honey. She said it was her favorite thing to eat as a child. She and her two sisters would sit on the porch and put the comb on an English muffin or biscuits. She said she would not eat oatmeal unless she had honeycomb pieces to put in it. Sometimes she would just suck on the honeycomb before finally eating it by itself. She and her two sisters felt rich if they had it. \"Honeycomb was not easy to come by in those days,\" she said. \"I can't remember what it tasted like but it was the best kind of candy. I wish I could taste it again.\"\n\nIt is said that men have trouble listening to women.  I had no trouble listening to my mom. I knew what her Christmas gift was going to be this year. I got Mom six separate quarts of honey with combs in them. I had to go to three different bee apiaries in two different states to get them. I spent no fewer than two days tracking down and purchasing honeycomb. (Apparently it is not a popular request with bee farmers.) The price was costly but would be worth it. It would be the best gift I have ever given my mom. \n\nThis year will be doubly special for me because I know this will be my mom's last Christmas. Her memory problem is exacerbating too quickly. The differences are noticeable now almost daily. But I had a secret I could not tell her for two more days until Christmas morning. Why can it not be Christmas Day right now so I can give her this gift right now! This is going to be her best Christmas. I am certain of it. I am going to drop a hint about her gift like she used to do with me as a child a few days before Christmas. Yesterday, while I was sitting on Mom's couch with her across me in her recliner, I asked, \"Mom, do you remember when you used to eat honeycombs on the porch with Pat and Dina?\"  She turned her head to face me with a blank stare. \n\n\"Honeycombs?\" She asked. \"Who told you that? No, I never ate honeycombs. Those things were gross.\"",
        "summary": [
            "In this poignant story, the narrator reflects on their mother's rapid decline in health and memory over the past three years.",
            "Once vibrant and active, the mother's life changed dramatically after a series of accidents that revealed her osteoporosis.",
            "Confined to a recliner and struggling with memory issues, she forgot important birthdays, including the narrator's and their father's.One day, the mother reminisced about her childhood, recalling how she and her sisters would enjoy eating honeycombs, a rare treat at the time.",
            "Inspired by this memory, the narrator went to great lengths to acquire six quarts of honey with combs as a special Christmas gift for their mother, knowing it might be her last Christmas.",
            "However, when the narrator tried to remind their mother about the honeycomb memory, she had no recollection of it and even found the idea unappealing.",
            "The story concludes on a bittersweet note, highlighting the impact of memory loss on the mother-child relationship and the narrator's efforts to bring joy to their mother during a difficult time."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 17,
        "explanations": [],
        "claims": [
            "The narrator's mother experienced a rapid decline in health and memory over the past three years.",
            "The narrator's mother was once vibrant and active.",
            "The narrator's mother's life changed dramatically after a series of accidents.",
            "The series of accidents revealed that the narrator's mother had osteoporosis.",
            "Following the accidents, the narrator's mother was confined to a recliner.",
            "The narrator's mother struggled with memory issues, forgetting important birthdays.",
            "The narrator's mother forgot the narrator's birthday.",
            "The narrator's mother forgot their father's birthday.",
            "One day, the narrator's mother reminisced about her childhood, specifically eating honeycombs with her sisters.",
            "Eating honeycombs was a rare treat for the narrator's mother and her sisters during their childhood.",
            "Inspired by the memory of eating honeycombs, the narrator acquired six quarts of honey with combs as a Christmas gift for their mother.",
            "The narrator believed it might be their mother's last Christmas.",
            "When the narrator tried to remind their mother about the honeycomb memory, she had no recollection of it.",
            "The narrator's mother found the idea of eating honeycombs unappealing.",
            "The story concludes by highlighting the impact of memory loss on the mother-child relationship.",
            "The story concludes by highlighting the narrator's efforts to bring joy to their mother during a difficult time."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473a94gm7": {
        "label": 0,
        "difficulty": "easy",
        "story": "My mom is old. Her vibrance gone. Bones brittle. Hair gray. Eyes glazed over from cataracts. Her skin patchworked with blood spots. And it is not clich\u00e9 to say it happened overnight. Just three years ago she was getting a monthly pedicure and keeping hair appointments to cut and color her once brown hair. With her five children grown and gone, she never stayed home. From the time she woke until dinner time, she was outside roaming in her car visiting friends and shopping. She was alive and loving every minute of her new freedom that was formerly restricted from being a full-time nurse, a housewife, and a mother.\n\nThen the accident changed everything. Three years ago she stepped off a sidewalk curb and lost her balance. Her right shoulder completely shattered, and it was how she discovered she had osteoporosis.  The entire shoulder had to be replaced. The surgeon picked out pieces of splintered bones and put in a round metal ball to give her about sixty percent use of her shoulder again. She suffered through the year long process and fell again, this time breaking a bone in her back and knee.  For the last few years, her car has been supplanted with a recliner.\n\nThe last few Christmas holidays have obviously not been the same. This one, however, will probably be the last. A few months ago I started to notice the memory problems. I visit her weekly and since the Breaking of Bones I have been spending every Saturday morning and night with her by sleeping in my old childhood room. The severity of the memory problems became more noticeable every week I returned. \n\nFor the first time since I was born, my mom forgot my birthday. Birthdays are more important to no one other than a mother\u2013at least, my mother. Birthdays were an event celebrated in my parents' home more than Christmas. My birthday, my brother's birthday, and my father's birthday are all in December. My mom forgot all three. No phone calls. No cards. No cake. No celebrations. We did not remind her. We only spoke of it amongst ourselves briefly to mention that we noticed. Maybe it did not need to be broached. More than likely, we were so saddened about the Great Forgetting that none of us could bring ourselves to discuss it. \n\nLast Thursday, just four days before Christmas, my mother told me when she was a teenager that she would eat the honeycombs from real bee honey. She said it was her favorite thing to eat as a child. She and her two sisters would sit on the porch and put the comb on an English muffin or biscuits. She said she would not eat oatmeal unless she had honeycomb pieces to put in it. Sometimes she would just suck on the honeycomb before finally eating it by itself. She and her two sisters felt rich if they had it. \"Honeycomb was not easy to come by in those days,\" she said. \"I can't remember what it tasted like but it was the best kind of candy. I wish I could taste it again.\"\n\nIt is said that men have trouble listening to women.  I had no trouble listening to my mom. I knew what her Christmas gift was going to be this year. I got Mom six separate quarts of honey with combs in them. I had to go to three different bee apiaries in two different states to get them. I spent no fewer than two days tracking down and purchasing honeycomb. (Apparently it is not a popular request with bee farmers.) The price was costly but would be worth it. It would be the best gift I have ever given my mom. \n\nThis year will be doubly special for me because I know this will be my mom's last Christmas. Her memory problem is exacerbating too quickly. The differences are noticeable now almost daily. But I had a secret I could not tell her for two more days until Christmas morning. Why can it not be Christmas Day right now so I can give her this gift right now! This is going to be her best Christmas. I am certain of it. I am going to drop a hint about her gift like she used to do with me as a child a few days before Christmas. Yesterday, while I was sitting on Mom's couch with her across me in her recliner, I asked, \"Mom, do you remember when you used to eat honeycombs on the porch with Pat and Dina?\"  She turned her head to face me with a blank stare. \n\n\"Honeycombs?\" She asked. \"Who told you that? No, I never ate honeycombs. Those things were gross.\"",
        "summary": [
            "A woman's mother has aged and suffered from multiple injuries, causing her to lose her independence and vibrant personality.",
            "As her memory problems worsen, her daughter plans to give her a special gift - honeycombs that she used to enjoy as a child but has forgotten about.",
            "This will be the mother's last Christmas, making the gift even more meaningful."
        ],
        "errors": [
            0,
            0,
            1
        ],
        "story-id": 17,
        "explanations": [
            "The narrator is a man.",
            "The narrator is a man. Also, when he plans the gift, he thinks his mother remembers the honeycombs."
        ],
        "claims": [
            "1. A woman's mother has aged. \n2. The woman's mother has suffered from multiple injuries. \n3. The injuries have caused the woman's mother to lose her independence. \n4. The injuries have affected the woman's mother's vibrant personality. \n5. The woman's mother has memory problems. \n6. The woman's mother's memory problems are worsening. \n7. The woman plans to give her mother a special gift. \n8. The special gift planned by the woman is honeycombs. \n9. The woman's mother used to enjoy honeycombs as a child. \n10. The woman's mother has forgotten about her enjoyment of honeycombs. \n11. This Christmas will be the woman's mother's last Christmas. \n12. The gift of honeycombs is considered even more meaningful because it is the woman's mother's last Christmas."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049eqx23f": {
        "label": 0,
        "difficulty": "easy",
        "story": "I shit you not, my skin is crawling just thinking about typing this to you all. I've never told anyone what happened until now\n\nWhen I was 13 I used to play video games in my parents basement all the time. It was finished and heated. I spent more time down there than my room. I would describe my basement as having an \"L\" shape. I played video games with a tv at the far wall in the long main part and there was a fridge around the back corner in the shorter part (behind me while playing).\n\nOne day I'm home alone after school playing Halo 3 with Turtle Beach headphones on. They are the type of headphones that play sound through them. So in other words, you really can't hear anything going on in the real world around you until you take them off. So I'm playing and I hear this loud bang from behind me. Loud enough for me to hear through the game sounds. I immediately rip my headphones off and whip around to look behind me. I see nothing. I call out, \"Mom?\", to see if she's home. She wasn't. So I get up slowly, I'm mildly confused, not scared at this point. I walk around the far corner to where the fridge is and I see this glass beer mug on the floor about 3 feet from the fridge. \n\nLet me paint this picture for you. On top of the fridge my dad had an organized display. There was a neon beer sign in the center with two identical decorative beer mugs symmetrically placed on each side of the sign. This display sits about 5 feet off the ground. \n\nWhen I turned the corner and saw the mug on the ground I got an eerie feeling that seemed to have no source. I thought; damn, how did that mug get so far away from the fridge, it must have bounced when it fell. I couldn't believe it didn't break. I hesitated for a brief moment simply confused, then picked up the mug and placed it back to the left side of the neon sign. I shrugged it off as weird and went back to my gaming.\n\nOne week later. \n\nI'm again playing halo with turtle beach headphones on, loud as fuck. I'm home alone after school. BANG! CLINK! CLINK! There was no question in my mind that it was the same noise I'd heard the week prior. I ripped my headphones off. Chills ran from my head to my toes. I was petrified. I was scared to look behind me. I slowly turned around. I stared backwards into the darkness wide-eyed for what felt like minutes before I built the courage to investigate knowing I was home alone. My heart was pounding. I couldn't just sit there, I was trapped with my back against the wall, literally. I hesitantly and slowly crept towards the other end of the basement slowly rounding the corner, fearful of what I might see; my mind was racing. There it was, the same mug on the ground, but this time it was farther from the fridge, maybe 5 feet away. I was fucking terrified. I sprinted towards my tv, shut my game off and ran upstairs. As I bolted up the stairs two at a time, I couldn't help but feel something watching from behind me. I didn't go back down into the basement for the rest of the day.\n\nThe next morning I headed downstairs to play video games like usual, briefly forgetting what had happened the day before. I turned the lights on and saw the mug on the ground where It had been left yesterday. I thought, \"whatever, there must be some explanation\". So I grabbed the mug and walked over to the fridge to put it back. There was an additional overhead light in that area of the basement. I flicked in on so I could see better and investigate/try to find some explanation. I noticed that the top of the fridge was pretty level, so it wouldn't have slipped off by itself. And the mugs were placed in the center on the top, so it didn't make sense for it to have fallen on its own, like at all. Plus the other mug had never moved. Then I saw it... there was a perfect circular outline of where the mug had been sitting. The outline was formed by a thin, surrounding layer of evenly settled dust that covered the entire fridge top. The dust was everywhere except where the mug had been... it hadn't fallen... It hadn't slid off... It had been picked straight up and then thrown. \n\nAt that moment of realization, I felt chills like never before. The fear consumed my entire body. \n\nThis is all 100% true. On both occasions I was the only one home, trust me, I checked",
        "summary": [
            "The storyteller shares a chilling childhood experience that occurred when he was 13 and spent most of his time playing video games in his parent's basement.",
            "The basement is described as \"L\" shaped, with the television and gaming console in the long part and a fridge around the back corner in the shorter part.",
            "One day while playing Halo with noise-cancelling headphones, he hears a loud noise from behind him and turns around to find a beer mug on the floor near the fridge.",
            "The mug was originally part of a display atop the fridge, featuring a neon sign and identical mugs on either side.",
            "He shrugs off this strange occurrence and continues his game.",
            "A week later, the same scenario repeats.",
            "The loud noise, the beer mug on the floor, a distance away from the fridge.",
            "This time he is terrified, turns off his game, and bolts upstairs, feeling a sense of being watched.",
            "The next day he investigates the scene and realizes that the dust layer atop the fridge is perfectly undisturbed where the mug sits, indicating it did not slide off, but was picked straight up and thrown.",
            "This realization sends the storyteller into horror, as he swears that on both occasions, he was the only one at home."
        ],
        "errors": [
            1,
            1,
            0,
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 18,
        "explanations": [
            "The narrator is playing Halo 3, not Halo, and the headphones are not noise-cancelling but just make it harder to hear background noises."
        ],
        "claims": [
            "The storyteller was 13 years old when the described events occurred.",
            "The storyteller spent most of his time playing video games in his parent's basement.",
            "The basement is described as \"L\" shaped.",
            "The television and gaming console were located in the long part of the basement.",
            "A fridge was located around the back corner in the shorter part of the basement.",
            "One day, while playing Halo with noise-cancelling headphones, the storyteller hears a loud noise from behind him.",
            "Upon turning around, the storyteller finds a beer mug on the floor near the fridge.",
            "The beer mug was originally part of a display atop the fridge, which also featured a neon sign and identical mugs on either side.",
            "After the first incident, the storyteller shrugs off the strange occurrence and continues his game.",
            "A week later, the same scenario repeats with a loud noise and the beer mug found on the floor a distance away from the fridge.",
            "This second time, the storyteller is terrified, turns off his game, and bolts upstairs.",
            "The storyteller feels a sense of being watched as he runs upstairs.",
            "The next day, the storyteller investigates the scene and notices that the dust layer atop the fridge is perfectly undisturbed where the mug sits.",
            "The undisturbed dust layer indicates that the mug did not slide off the fridge but was picked straight up and thrown.",
            "The storyteller realizes that on both occasions, he was the only one at home.",
            "This realization sends the storyteller into horror."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479eqx23f": {
        "label": 0,
        "difficulty": "hard",
        "story": "I shit you not, my skin is crawling just thinking about typing this to you all. I've never told anyone what happened until now\n\nWhen I was 13 I used to play video games in my parents basement all the time. It was finished and heated. I spent more time down there than my room. I would describe my basement as having an \"L\" shape. I played video games with a tv at the far wall in the long main part and there was a fridge around the back corner in the shorter part (behind me while playing).\n\nOne day I'm home alone after school playing Halo 3 with Turtle Beach headphones on. They are the type of headphones that play sound through them. So in other words, you really can't hear anything going on in the real world around you until you take them off. So I'm playing and I hear this loud bang from behind me. Loud enough for me to hear through the game sounds. I immediately rip my headphones off and whip around to look behind me. I see nothing. I call out, \"Mom?\", to see if she's home. She wasn't. So I get up slowly, I'm mildly confused, not scared at this point. I walk around the far corner to where the fridge is and I see this glass beer mug on the floor about 3 feet from the fridge. \n\nLet me paint this picture for you. On top of the fridge my dad had an organized display. There was a neon beer sign in the center with two identical decorative beer mugs symmetrically placed on each side of the sign. This display sits about 5 feet off the ground. \n\nWhen I turned the corner and saw the mug on the ground I got an eerie feeling that seemed to have no source. I thought; damn, how did that mug get so far away from the fridge, it must have bounced when it fell. I couldn't believe it didn't break. I hesitated for a brief moment simply confused, then picked up the mug and placed it back to the left side of the neon sign. I shrugged it off as weird and went back to my gaming.\n\nOne week later. \n\nI'm again playing halo with turtle beach headphones on, loud as fuck. I'm home alone after school. BANG! CLINK! CLINK! There was no question in my mind that it was the same noise I'd heard the week prior. I ripped my headphones off. Chills ran from my head to my toes. I was petrified. I was scared to look behind me. I slowly turned around. I stared backwards into the darkness wide-eyed for what felt like minutes before I built the courage to investigate knowing I was home alone. My heart was pounding. I couldn't just sit there, I was trapped with my back against the wall, literally. I hesitantly and slowly crept towards the other end of the basement slowly rounding the corner, fearful of what I might see; my mind was racing. There it was, the same mug on the ground, but this time it was farther from the fridge, maybe 5 feet away. I was fucking terrified. I sprinted towards my tv, shut my game off and ran upstairs. As I bolted up the stairs two at a time, I couldn't help but feel something watching from behind me. I didn't go back down into the basement for the rest of the day.\n\nThe next morning I headed downstairs to play video games like usual, briefly forgetting what had happened the day before. I turned the lights on and saw the mug on the ground where It had been left yesterday. I thought, \"whatever, there must be some explanation\". So I grabbed the mug and walked over to the fridge to put it back. There was an additional overhead light in that area of the basement. I flicked in on so I could see better and investigate/try to find some explanation. I noticed that the top of the fridge was pretty level, so it wouldn't have slipped off by itself. And the mugs were placed in the center on the top, so it didn't make sense for it to have fallen on its own, like at all. Plus the other mug had never moved. Then I saw it... there was a perfect circular outline of where the mug had been sitting. The outline was formed by a thin, surrounding layer of evenly settled dust that covered the entire fridge top. The dust was everywhere except where the mug had been... it hadn't fallen... It hadn't slid off... It had been picked straight up and then thrown. \n\nAt that moment of realization, I felt chills like never before. The fear consumed my entire body. \n\nThis is all 100% true. On both occasions I was the only one home, trust me, I checked",
        "summary": [
            "In this story, a 13-year-old boy experiences a series of eerie events while playing video games in his parents' finished basement.",
            "On two separate occasions, a week apart, the boy hears a loud bang behind him while wearing noise-cancelling headphones.",
            "Each time, he discovers that a decorative beer mug from a display on top of the fridge has fallen to the floor, landing several feet away without breaking.",
            "The first incident leaves the boy confused, but he shrugs it off and returns the mug to its original position.",
            "However, when the same thing happens a week later, the boy becomes terrified, feeling as if something is watching him from the darkness.",
            "He runs upstairs, unable to shake the feeling of being watched.",
            "The next morning, the boy investigates the top of the fridge and notices that the fallen mug has left a perfect circular outline in the dust, suggesting that it had been picked up and thrown rather than simply falling or sliding off on its own.",
            "This realization fills the boy with an overwhelming sense of fear.",
            "Throughout the story, the boy emphasizes that he was home alone during both incidents, adding to the mysterious and unsettling nature of the events."
        ],
        "errors": [
            1,
            0,
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 18,
        "explanations": [
            "The headphones are not specified to be noise-cancelling but just make it harder ot hear background noises."
        ],
        "claims": [
            "A 13-year-old boy experiences a series of eerie events while playing video games in his parents' finished basement.",
            "The boy hears a loud bang behind him on two separate occasions, a week apart, while wearing noise-cancelling headphones.",
            "Each time the loud bang occurs, the boy discovers that a decorative beer mug has fallen from a display on top of the fridge to the floor.",
            "The decorative beer mug lands several feet away from the fridge without breaking after each loud bang.",
            "After the first incident, the boy is confused but shrugs it off and returns the mug to its original position on top of the fridge.",
            "The boy becomes terrified after the same event occurs a week later, feeling as if something is watching him from the darkness.",
            "Following the second incident, the boy runs upstairs because he is unable to shake the feeling of being watched.",
            "The next morning, the boy investigates the top of the fridge and notices a perfect circular outline in the dust where the fallen mug had been.",
            "The boy interprets the perfect circular outline in the dust as suggesting the mug had been picked up and thrown.",
            "The realization that the mug might have been picked up and thrown fills the boy with an overwhelming sense of fear.",
            "The boy was home alone during both incidents when the decorative beer mug fell from the top of the fridge."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473eqx23f": {
        "label": 1,
        "difficulty": "",
        "story": "I shit you not, my skin is crawling just thinking about typing this to you all. I've never told anyone what happened until now\n\nWhen I was 13 I used to play video games in my parents basement all the time. It was finished and heated. I spent more time down there than my room. I would describe my basement as having an \"L\" shape. I played video games with a tv at the far wall in the long main part and there was a fridge around the back corner in the shorter part (behind me while playing).\n\nOne day I'm home alone after school playing Halo 3 with Turtle Beach headphones on. They are the type of headphones that play sound through them. So in other words, you really can't hear anything going on in the real world around you until you take them off. So I'm playing and I hear this loud bang from behind me. Loud enough for me to hear through the game sounds. I immediately rip my headphones off and whip around to look behind me. I see nothing. I call out, \"Mom?\", to see if she's home. She wasn't. So I get up slowly, I'm mildly confused, not scared at this point. I walk around the far corner to where the fridge is and I see this glass beer mug on the floor about 3 feet from the fridge. \n\nLet me paint this picture for you. On top of the fridge my dad had an organized display. There was a neon beer sign in the center with two identical decorative beer mugs symmetrically placed on each side of the sign. This display sits about 5 feet off the ground. \n\nWhen I turned the corner and saw the mug on the ground I got an eerie feeling that seemed to have no source. I thought; damn, how did that mug get so far away from the fridge, it must have bounced when it fell. I couldn't believe it didn't break. I hesitated for a brief moment simply confused, then picked up the mug and placed it back to the left side of the neon sign. I shrugged it off as weird and went back to my gaming.\n\nOne week later. \n\nI'm again playing halo with turtle beach headphones on, loud as fuck. I'm home alone after school. BANG! CLINK! CLINK! There was no question in my mind that it was the same noise I'd heard the week prior. I ripped my headphones off. Chills ran from my head to my toes. I was petrified. I was scared to look behind me. I slowly turned around. I stared backwards into the darkness wide-eyed for what felt like minutes before I built the courage to investigate knowing I was home alone. My heart was pounding. I couldn't just sit there, I was trapped with my back against the wall, literally. I hesitantly and slowly crept towards the other end of the basement slowly rounding the corner, fearful of what I might see; my mind was racing. There it was, the same mug on the ground, but this time it was farther from the fridge, maybe 5 feet away. I was fucking terrified. I sprinted towards my tv, shut my game off and ran upstairs. As I bolted up the stairs two at a time, I couldn't help but feel something watching from behind me. I didn't go back down into the basement for the rest of the day.\n\nThe next morning I headed downstairs to play video games like usual, briefly forgetting what had happened the day before. I turned the lights on and saw the mug on the ground where It had been left yesterday. I thought, \"whatever, there must be some explanation\". So I grabbed the mug and walked over to the fridge to put it back. There was an additional overhead light in that area of the basement. I flicked in on so I could see better and investigate/try to find some explanation. I noticed that the top of the fridge was pretty level, so it wouldn't have slipped off by itself. And the mugs were placed in the center on the top, so it didn't make sense for it to have fallen on its own, like at all. Plus the other mug had never moved. Then I saw it... there was a perfect circular outline of where the mug had been sitting. The outline was formed by a thin, surrounding layer of evenly settled dust that covered the entire fridge top. The dust was everywhere except where the mug had been... it hadn't fallen... It hadn't slid off... It had been picked straight up and then thrown. \n\nAt that moment of realization, I felt chills like never before. The fear consumed my entire body. \n\nThis is all 100% true. On both occasions I was the only one home, trust me, I checked",
        "summary": [
            "The narrator, who was 13 at the time, was playing video games in their parents' basement when they heard a loud bang behind them.",
            "They turned around and found a beer mug on the ground, which had been part of a display on top of the fridge.",
            "A week later, the same thing happened again, and the mug was found even farther away from the fridge.",
            "The narrator became terrified and didn't go back into the basement for the rest of the day.",
            "The next day, they investigated and found that the dust on top of the fridge had been disturbed in a circular pattern, as if the mug had been picked up and thrown.",
            "The narrator was alone both times and could not find a rational explanation for what happened."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 18,
        "explanations": [],
        "claims": [
            "The narrator was 13 years old at the time of the events.",
            "The narrator was playing video games in their parents' basement when they heard a loud bang behind them.",
            "Upon turning around, the narrator found a beer mug on the ground.",
            "The beer mug had previously been part of a display on top of the fridge.",
            "A week after the first incident, a similar event occurred where a beer mug was found on the ground again.",
            "During the second incident, the beer mug was found farther away from the fridge than during the first incident.",
            "The narrator became terrified after the second incident and did not return to the basement for the rest of the day.",
            "The day after the second incident, the narrator investigated the top of the fridge.",
            "The narrator found that the dust on top of the fridge had been disturbed in a circular pattern.",
            "The disturbance in the dust suggested that the mug had been picked up and thrown.",
            "The narrator was alone in the house during both incidents.",
            "The narrator could not find a rational explanation for the occurrences."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049g1cebe": {
        "label": 1,
        "difficulty": "",
        "story": "They can't rest, so they won't let me rest. They're everywhere I am, their voices echoing against my skull.\n\nYou might think it's a gift, but in reality, being able to see and hear the dead is nothing but a curse. I can do nothing for them, not one shred of solace I can offer while their voices pound away in my brain.\n\nWhen I was younger, I thought it was fun. Like a game that only I could play. Watching their ghostly wanderings, chasing the smallest ones through the garden of my childhood home. They have always seemed more real to me that even my own family. But now, the game has become dark and twisted.\n\nOne day, I was walking down the street when I heard the most gut-wrenching screams I'd ever borne witness to. Looking around, I quickly located the source: the shadow of an old man standing next to park bench. A mangy stray dog was curled up on the rough planks of wood, shivering in the chilly air. The ghost reached out to it futilely, empty tears streaming down his face as he failed to comfort his lost friend.\n\nI couldn't take it anymore. There was a place I walked past often that called out to me. It was a hospital. Or rather, an asylum. I would occasionally see patients sitting outside with beautiful nurses, everyone looking peaceful and serene. The perfect place for someone like me.\n\nI stepped through the front door and up to the front desk. A lovely woman with ebony skin and a heart-shaped face smiled from behind stacks of papers.\n\n\"Hello,\" she greeted me warmly. \"How can I help you?\"\n\n\"I need to check myself in,\" I replied. I expected her to ask questions, but she simply guided me to an empty room. As the door closed behind me, I quickly fell asleep, truly alone for the first time inside the mint green walls.\n\nWhen I finally woke, pulling myself out of a slumber deeper than hell itself, it was time for me to meet the doctor who would hopefully have the answers I needed. A nurse with hair the color of turmeric and a spray of freckles across her nose came to my room and led me to a dark office. I followed closely behind her and watched her feet as they moved, almost seeming to dance across the tile floor.\n\nInside the office, a woman in a white coat waited on the couch, her eyes shining like jade fire in the dim light. She gestured for me to sit next to her, patting the sofa with her long, graceful fingers. I sat easily, feeling nothing but peace in her presence.\n\n\"I understand you admitted yourself to the hospital,\" she said, her voice humming like the strings of a lute. \"Why?\" She tilted her head to the side as she waited for my response.\n\n\"I see ghosts,\" I said, the words slipping from my lips without thought or hesitation. I dropped my head into my hands. \"I just want them to leave me alone so I can rest.\"\n\nAs gleaming tears began to form in my eyes, the doctor leaned forward and placed her soft hand on mine.\n\n\"Don't worry,\" she said with a gentle smile. \"I'll keep the ghosts from bothering you.\"\n\nDays went by in a haze. Sometimes I walked outside among the weeping willow trees, accompanied by a nurse with rubina lips or gleaming almond eyes. Sometimes I talked quietly with the other patients; the ones who were willing, that is. Some of them are just so, so angry, and they always seem afraid to come near me. I sighed with relief every time their sharp eyes turned away from me.\n\nSome days, I looked out my window and saw them on the other side of the fence. There are so many of them, and they all feel so deeply. I can see their lips move, speaking their lonesome words, but inside those walls, there was only beautiful silence.\n\nMost days, I sleep. I have a lifetime of rest to catch up on.\n\nBut now, from somewhere just outside the wispy fog of sleep, I feel someone shaking me, voices talking and shattering the blissful silence.\n\n\"Wake up,\" a stern voice says.\n\nI barely have the energy to mumble, \"I'm just trying to rest.\"\n\n\"You can't stay here,\" he says angrily.\n\nI blink open my eyes slowly, taking in the shining gold police badge pinned to his shirt.\n\n\"But I'm a patient here,\" I say, rubbing the sandman's dust from my tired eyes.\n\nThe officer shakes his head in pity. \"You can't be a patient here,\" he says roughly. \"This hospital's been closed for years.\"\n\nThe silence explodes, and I twist in the air as I fall.",
        "summary": [
            "The narrator has the ability to see and hear ghosts, which was fun as a child but becomes torturous later in life.",
            "After witnessing a heart-wrenching scenario with a ghost and a stray dog, he checks himself into an hospital/asylum for some solace.",
            "The hospital appears serene with friendly nurses and patients, and the narrator feels peaceful.",
            "After several days, he is awakened by a police officer who informs him that the hospital has been closed for years.",
            "The story ends with the narrator's silence being shattered."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 19,
        "explanations": [],
        "claims": [
            "The narrator has the ability to see and hear ghosts.",
            "This ability was enjoyable for the narrator during their childhood.",
            "The ability becomes torturous for the narrator later in life.",
            "The narrator witnesses a heart-wrenching scenario involving a ghost and a stray dog.",
            "Following this incident, the narrator checks themselves into a hospital/asylum seeking solace.",
            "The hospital the narrator checks into appears serene.",
            "The nurses and patients at the hospital are friendly towards the narrator.",
            "The narrator feels peaceful at the hospital.",
            "Several days after checking in, a police officer awakens the narrator.",
            "The police officer informs the narrator that the hospital has been closed for years.",
            "The story concludes with the narrator's silence being shattered."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479g1cebe": {
        "label": 1,
        "difficulty": "",
        "story": "They can't rest, so they won't let me rest. They're everywhere I am, their voices echoing against my skull.\n\nYou might think it's a gift, but in reality, being able to see and hear the dead is nothing but a curse. I can do nothing for them, not one shred of solace I can offer while their voices pound away in my brain.\n\nWhen I was younger, I thought it was fun. Like a game that only I could play. Watching their ghostly wanderings, chasing the smallest ones through the garden of my childhood home. They have always seemed more real to me that even my own family. But now, the game has become dark and twisted.\n\nOne day, I was walking down the street when I heard the most gut-wrenching screams I'd ever borne witness to. Looking around, I quickly located the source: the shadow of an old man standing next to park bench. A mangy stray dog was curled up on the rough planks of wood, shivering in the chilly air. The ghost reached out to it futilely, empty tears streaming down his face as he failed to comfort his lost friend.\n\nI couldn't take it anymore. There was a place I walked past often that called out to me. It was a hospital. Or rather, an asylum. I would occasionally see patients sitting outside with beautiful nurses, everyone looking peaceful and serene. The perfect place for someone like me.\n\nI stepped through the front door and up to the front desk. A lovely woman with ebony skin and a heart-shaped face smiled from behind stacks of papers.\n\n\"Hello,\" she greeted me warmly. \"How can I help you?\"\n\n\"I need to check myself in,\" I replied. I expected her to ask questions, but she simply guided me to an empty room. As the door closed behind me, I quickly fell asleep, truly alone for the first time inside the mint green walls.\n\nWhen I finally woke, pulling myself out of a slumber deeper than hell itself, it was time for me to meet the doctor who would hopefully have the answers I needed. A nurse with hair the color of turmeric and a spray of freckles across her nose came to my room and led me to a dark office. I followed closely behind her and watched her feet as they moved, almost seeming to dance across the tile floor.\n\nInside the office, a woman in a white coat waited on the couch, her eyes shining like jade fire in the dim light. She gestured for me to sit next to her, patting the sofa with her long, graceful fingers. I sat easily, feeling nothing but peace in her presence.\n\n\"I understand you admitted yourself to the hospital,\" she said, her voice humming like the strings of a lute. \"Why?\" She tilted her head to the side as she waited for my response.\n\n\"I see ghosts,\" I said, the words slipping from my lips without thought or hesitation. I dropped my head into my hands. \"I just want them to leave me alone so I can rest.\"\n\nAs gleaming tears began to form in my eyes, the doctor leaned forward and placed her soft hand on mine.\n\n\"Don't worry,\" she said with a gentle smile. \"I'll keep the ghosts from bothering you.\"\n\nDays went by in a haze. Sometimes I walked outside among the weeping willow trees, accompanied by a nurse with rubina lips or gleaming almond eyes. Sometimes I talked quietly with the other patients; the ones who were willing, that is. Some of them are just so, so angry, and they always seem afraid to come near me. I sighed with relief every time their sharp eyes turned away from me.\n\nSome days, I looked out my window and saw them on the other side of the fence. There are so many of them, and they all feel so deeply. I can see their lips move, speaking their lonesome words, but inside those walls, there was only beautiful silence.\n\nMost days, I sleep. I have a lifetime of rest to catch up on.\n\nBut now, from somewhere just outside the wispy fog of sleep, I feel someone shaking me, voices talking and shattering the blissful silence.\n\n\"Wake up,\" a stern voice says.\n\nI barely have the energy to mumble, \"I'm just trying to rest.\"\n\n\"You can't stay here,\" he says angrily.\n\nI blink open my eyes slowly, taking in the shining gold police badge pinned to his shirt.\n\n\"But I'm a patient here,\" I say, rubbing the sandman's dust from my tired eyes.\n\nThe officer shakes his head in pity. \"You can't be a patient here,\" he says roughly. \"This hospital's been closed for years.\"\n\nThe silence explodes, and I twist in the air as I fall.",
        "summary": [
            "In this haunting story, the narrator is a person who has the ability to see and hear ghosts, which they initially enjoyed as a child but now find to be a curse.",
            "The ghosts constantly haunt the narrator, preventing them from finding peace and rest.",
            "One day, after witnessing a particularly distressing scene involving a ghost and a stray dog, the narrator decides to check themselves into an asylum in hopes of finding solace.At the asylum, the narrator is greeted by a caring staff and a gentle doctor who promises to keep the ghosts at bay.",
            "The narrator spends their days in a peaceful haze, occasionally interacting with other patients and enjoying the silence within the walls of the asylum, despite the presence of numerous ghosts outside the fence.",
            "However, the story takes a chilling turn when the narrator is awakened by a police officer who informs them that the hospital has been closed for years.",
            "This revelation shatters the narrator's illusion of peace, leaving them falling through the air as the silence around them is shattered.",
            "The ending suggests that the narrator's experiences at the asylum were either a delusion or a supernatural occurrence, leaving the reader to ponder the true nature of the narrator's reality."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 19,
        "explanations": [],
        "claims": [
            "The narrator has the ability to see and hear ghosts.",
            "The narrator initially enjoyed seeing and hearing ghosts as a child.",
            "The narrator finds the ability to see and hear ghosts to be a curse as an adult.",
            "Ghosts constantly haunt the narrator, preventing them from finding peace and rest.",
            "The narrator witnesses a distressing scene involving a ghost and a stray dog.",
            "Following the distressing scene, the narrator decides to check themselves into an asylum to find solace.",
            "Upon arrival at the asylum, the narrator is greeted by caring staff.",
            "A gentle doctor at the asylum promises to keep the ghosts at bay.",
            "The narrator spends their days in the asylum in a peaceful haze.",
            "The narrator occasionally interacts with other patients in the asylum.",
            "The narrator enjoys the silence within the asylum walls.",
            "Numerous ghosts are present outside the fence of the asylum.",
            "A police officer awakens the narrator to inform them that the hospital has been closed for years.",
            "The revelation that the hospital has been closed for years shatters the narrator's illusion of peace.",
            "Following the revelation, the narrator experiences a sensation of falling through the air.",
            "The silence around the narrator is shattered following the revelation.",
            "The story suggests that the narrator's experiences at the asylum were either a delusion or a supernatural occurrence.",
            "The story leaves the reader to ponder the true nature of the narrator's reality."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473g1cebe": {
        "label": 0,
        "difficulty": "hard",
        "story": "They can't rest, so they won't let me rest. They're everywhere I am, their voices echoing against my skull.\n\nYou might think it's a gift, but in reality, being able to see and hear the dead is nothing but a curse. I can do nothing for them, not one shred of solace I can offer while their voices pound away in my brain.\n\nWhen I was younger, I thought it was fun. Like a game that only I could play. Watching their ghostly wanderings, chasing the smallest ones through the garden of my childhood home. They have always seemed more real to me that even my own family. But now, the game has become dark and twisted.\n\nOne day, I was walking down the street when I heard the most gut-wrenching screams I'd ever borne witness to. Looking around, I quickly located the source: the shadow of an old man standing next to park bench. A mangy stray dog was curled up on the rough planks of wood, shivering in the chilly air. The ghost reached out to it futilely, empty tears streaming down his face as he failed to comfort his lost friend.\n\nI couldn't take it anymore. There was a place I walked past often that called out to me. It was a hospital. Or rather, an asylum. I would occasionally see patients sitting outside with beautiful nurses, everyone looking peaceful and serene. The perfect place for someone like me.\n\nI stepped through the front door and up to the front desk. A lovely woman with ebony skin and a heart-shaped face smiled from behind stacks of papers.\n\n\"Hello,\" she greeted me warmly. \"How can I help you?\"\n\n\"I need to check myself in,\" I replied. I expected her to ask questions, but she simply guided me to an empty room. As the door closed behind me, I quickly fell asleep, truly alone for the first time inside the mint green walls.\n\nWhen I finally woke, pulling myself out of a slumber deeper than hell itself, it was time for me to meet the doctor who would hopefully have the answers I needed. A nurse with hair the color of turmeric and a spray of freckles across her nose came to my room and led me to a dark office. I followed closely behind her and watched her feet as they moved, almost seeming to dance across the tile floor.\n\nInside the office, a woman in a white coat waited on the couch, her eyes shining like jade fire in the dim light. She gestured for me to sit next to her, patting the sofa with her long, graceful fingers. I sat easily, feeling nothing but peace in her presence.\n\n\"I understand you admitted yourself to the hospital,\" she said, her voice humming like the strings of a lute. \"Why?\" She tilted her head to the side as she waited for my response.\n\n\"I see ghosts,\" I said, the words slipping from my lips without thought or hesitation. I dropped my head into my hands. \"I just want them to leave me alone so I can rest.\"\n\nAs gleaming tears began to form in my eyes, the doctor leaned forward and placed her soft hand on mine.\n\n\"Don't worry,\" she said with a gentle smile. \"I'll keep the ghosts from bothering you.\"\n\nDays went by in a haze. Sometimes I walked outside among the weeping willow trees, accompanied by a nurse with rubina lips or gleaming almond eyes. Sometimes I talked quietly with the other patients; the ones who were willing, that is. Some of them are just so, so angry, and they always seem afraid to come near me. I sighed with relief every time their sharp eyes turned away from me.\n\nSome days, I looked out my window and saw them on the other side of the fence. There are so many of them, and they all feel so deeply. I can see their lips move, speaking their lonesome words, but inside those walls, there was only beautiful silence.\n\nMost days, I sleep. I have a lifetime of rest to catch up on.\n\nBut now, from somewhere just outside the wispy fog of sleep, I feel someone shaking me, voices talking and shattering the blissful silence.\n\n\"Wake up,\" a stern voice says.\n\nI barely have the energy to mumble, \"I'm just trying to rest.\"\n\n\"You can't stay here,\" he says angrily.\n\nI blink open my eyes slowly, taking in the shining gold police badge pinned to his shirt.\n\n\"But I'm a patient here,\" I say, rubbing the sandman's dust from my tired eyes.\n\nThe officer shakes his head in pity. \"You can't be a patient here,\" he says roughly. \"This hospital's been closed for years.\"\n\nThe silence explodes, and I twist in the air as I fall.",
        "summary": [
            "The protagonist, who can see and hear ghosts, checks into an asylum in an attempt to escape their constant presence.",
            "With the help of a kind doctor, they find peace and rest.",
            "However, when they wake up, they are told that the asylum has been closed for years, leaving their current state of peacefulness a mystery."
        ],
        "errors": [
            1,
            1,
            0
        ],
        "story-id": 19,
        "explanations": [
            "The state of peacefulness is not a mystery. It is because they thought the ghosts were real for a period and so felt they weren't being bothered by ghosts."
        ],
        "claims": [
            "1. The protagonist has the ability to see and hear ghosts.",
            "2. The protagonist checks into an asylum to escape the presence of ghosts.",
            "3. A kind doctor in the asylum helps the protagonist.",
            "4. The protagonist finds peace and rest in the asylum.",
            "5. Upon waking up, the protagonist is informed that the asylum has been closed for years.",
            "6. The protagonist's current state of peacefulness is left unexplained."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049i6ry99": {
        "label": 0,
        "difficulty": "hard",
        "story": "I've always had good hearing but that day, not only was I hearing very well, I was agitated by what I was hearing, no matter what it was. If it was even louder than normal speaking voice, I would get super flustered. My cousin, who I had been staying with noticed but didn't think anything of it. He hardly thought anything of anything I did...It didn't concern me too much until a particularly large bird started squawking outside while my window was open. My cousin's house is in a forest and this type of thing was common, but that day I couldn't handle it. I covered my ears as the bird continued squawking.  \n***Noise, noise, noise!***  \nI pressed on my ears harder as the bird continued it's infernal squawking.  \n***NOISE, NOISE, NOISE!***  \nI couldn't take it any longer. At an inhuman speed, I jumped out of my window and ran up to the infernal bird. It squawked loud as I caught it's tail feathers, which didn't help it.I killed it. With my hands. I squeezed it really tight around the stomach with my left hand and pulled out it's tail feather with my right so it couldn't run away. It continued to sqwauk, making me even angrier. ***NOISE, NOISE, NOISE!*** Eventually I crushed it's bones and it fell dead in my hands. I made a half-hearted attempt to dispose of it, taking it a little ways into the woods, but that's all I did other than washing my arms off(after maybe licking my palms a bit). The weird thing is...I wasn't scared. I was a little surprised at myself, but I wasn't scared. It just felt so...*natural* when I killed that bird. I hadn't really been into horror and gore before, but I hadn't really been squeamish about it, just no strong feelings at all. But killing that bird...just felt right.\n\nA few hours later I was sitting at the table with my cousin everything was fine until the kitchen phone went off. I *lost it.* I practically tore it out of the wall. \"Sarah, what the hell?!\" He yelled. Yelled. He yelled a lot, but that day was different. \"Loud noise...\" I growled. \"The phone rings every damn day! What is wrong with you?!\" He yelled even louder. *Loud Noise...*  \n***Noise, noise, noise!***  \nI had been sick of him for a long time, but I had never had a way to get revenge. He continued yelling, but his yells became screams when I jumped over the table and  pounced on him.\nSure, killing that bird felt good...but it felt even more natural to rip my cousin's throat out.",
        "summary": [
            "The protagonist, who is usually agitated by loud sounds, experiences an unusually strong reaction to noise while staying at a cousin's house in the forest.",
            "Their reaction to noise escalates from annoyance to uncontrollable aggression, leading them to kill a loud bird outside in a sudden fit of rage.",
            "Later, when their cousin yells at them for ripping a ringing telephone out of the wall, the protagonist impulsively kills their cousin.",
            "They note a disturbing sense of satisfaction and naturalness in their violent acts."
        ],
        "errors": [
            0,
            1,
            1,
            0
        ],
        "story-id": 20,
        "explanations": [
            "The protagonist is not usually agitated by loud sounds, just on this day.",
            "The narrator does not seem to note anything disturbing in their feelings."
        ],
        "claims": [
            "The protagonist is usually agitated by loud sounds.",
            "The protagonist experiences an unusually strong reaction to noise while staying at a cousin's house in the forest.",
            "The protagonist's reaction to noise escalates from annoyance to uncontrollable aggression.",
            "The protagonist kills a loud bird outside in a sudden fit of rage.",
            "The protagonist's cousin yells at them for ripping a ringing telephone out of the wall.",
            "The protagonist impulsively kills their cousin after being yelled at.",
            "The protagonist notes a disturbing sense of satisfaction and naturalness in their violent acts."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479i6ry99": {
        "label": 1,
        "difficulty": "",
        "story": "I've always had good hearing but that day, not only was I hearing very well, I was agitated by what I was hearing, no matter what it was. If it was even louder than normal speaking voice, I would get super flustered. My cousin, who I had been staying with noticed but didn't think anything of it. He hardly thought anything of anything I did...It didn't concern me too much until a particularly large bird started squawking outside while my window was open. My cousin's house is in a forest and this type of thing was common, but that day I couldn't handle it. I covered my ears as the bird continued squawking.  \n***Noise, noise, noise!***  \nI pressed on my ears harder as the bird continued it's infernal squawking.  \n***NOISE, NOISE, NOISE!***  \nI couldn't take it any longer. At an inhuman speed, I jumped out of my window and ran up to the infernal bird. It squawked loud as I caught it's tail feathers, which didn't help it.I killed it. With my hands. I squeezed it really tight around the stomach with my left hand and pulled out it's tail feather with my right so it couldn't run away. It continued to sqwauk, making me even angrier. ***NOISE, NOISE, NOISE!*** Eventually I crushed it's bones and it fell dead in my hands. I made a half-hearted attempt to dispose of it, taking it a little ways into the woods, but that's all I did other than washing my arms off(after maybe licking my palms a bit). The weird thing is...I wasn't scared. I was a little surprised at myself, but I wasn't scared. It just felt so...*natural* when I killed that bird. I hadn't really been into horror and gore before, but I hadn't really been squeamish about it, just no strong feelings at all. But killing that bird...just felt right.\n\nA few hours later I was sitting at the table with my cousin everything was fine until the kitchen phone went off. I *lost it.* I practically tore it out of the wall. \"Sarah, what the hell?!\" He yelled. Yelled. He yelled a lot, but that day was different. \"Loud noise...\" I growled. \"The phone rings every damn day! What is wrong with you?!\" He yelled even louder. *Loud Noise...*  \n***Noise, noise, noise!***  \nI had been sick of him for a long time, but I had never had a way to get revenge. He continued yelling, but his yells became screams when I jumped over the table and  pounced on him.\nSure, killing that bird felt good...but it felt even more natural to rip my cousin's throat out.",
        "summary": [
            "In this disturbing story, the narrator is staying with their cousin in a house located in a forest.",
            "The narrator becomes increasingly agitated by loud noises, particularly a squawking bird outside their window.",
            "Unable to control their anger, the narrator jumps out of the window, catches the bird, and kills it with their bare hands.",
            "Despite the gruesome act, the narrator feels no fear or remorse, instead finding the experience natural and even enjoyable.",
            "Later, while sitting at the table with their cousin, the narrator becomes enraged when the kitchen phone rings.",
            "The cousin yells at the narrator for their unusual behavior, further angering them.",
            "The narrator, who had been harboring resentment towards their cousin for a long time, pounces on him and rips his throat out, finding the act even more satisfying than killing the bird.",
            "The story explores themes of heightened sensory sensitivity, uncontrollable rage, and a disturbing lack of empathy or remorse.",
            "It also suggests that the narrator may have underlying psychological issues or supernatural tendencies that lead to their violent behavior."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 20,
        "explanations": [],
        "claims": [
            "The narrator is staying with their cousin in a house located in a forest.",
            "The narrator becomes increasingly agitated by loud noises.",
            "A squawking bird outside their window particularly agitates the narrator.",
            "Unable to control their anger, the narrator jumps out of the window.",
            "After jumping out of the window, the narrator catches the bird.",
            "The narrator kills the bird with their bare hands.",
            "After killing the bird, the narrator feels no fear or remorse.",
            "The narrator finds the experience of killing the bird natural and enjoyable.",
            "While sitting at the table with their cousin, the narrator becomes enraged by the ringing of the kitchen phone.",
            "The cousin yells at the narrator for their unusual behavior.",
            "The yelling from the cousin further angers the narrator.",
            "The narrator has been harboring resentment towards their cousin for a long time.",
            "The narrator pounces on their cousin and rips his throat out.",
            "The narrator finds the act of killing their cousin more satisfying than killing the bird.",
            "The story explores themes of heightened sensory sensitivity.",
            "The story explores themes of uncontrollable rage.",
            "The story explores themes of a disturbing lack of empathy or remorse.",
            "The story suggests the narrator may have underlying psychological issues or supernatural tendencies that lead to their violent behavior."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473i6ry99": {
        "label": 0,
        "difficulty": "hard",
        "story": "I've always had good hearing but that day, not only was I hearing very well, I was agitated by what I was hearing, no matter what it was. If it was even louder than normal speaking voice, I would get super flustered. My cousin, who I had been staying with noticed but didn't think anything of it. He hardly thought anything of anything I did...It didn't concern me too much until a particularly large bird started squawking outside while my window was open. My cousin's house is in a forest and this type of thing was common, but that day I couldn't handle it. I covered my ears as the bird continued squawking.  \n***Noise, noise, noise!***  \nI pressed on my ears harder as the bird continued it's infernal squawking.  \n***NOISE, NOISE, NOISE!***  \nI couldn't take it any longer. At an inhuman speed, I jumped out of my window and ran up to the infernal bird. It squawked loud as I caught it's tail feathers, which didn't help it.I killed it. With my hands. I squeezed it really tight around the stomach with my left hand and pulled out it's tail feather with my right so it couldn't run away. It continued to sqwauk, making me even angrier. ***NOISE, NOISE, NOISE!*** Eventually I crushed it's bones and it fell dead in my hands. I made a half-hearted attempt to dispose of it, taking it a little ways into the woods, but that's all I did other than washing my arms off(after maybe licking my palms a bit). The weird thing is...I wasn't scared. I was a little surprised at myself, but I wasn't scared. It just felt so...*natural* when I killed that bird. I hadn't really been into horror and gore before, but I hadn't really been squeamish about it, just no strong feelings at all. But killing that bird...just felt right.\n\nA few hours later I was sitting at the table with my cousin everything was fine until the kitchen phone went off. I *lost it.* I practically tore it out of the wall. \"Sarah, what the hell?!\" He yelled. Yelled. He yelled a lot, but that day was different. \"Loud noise...\" I growled. \"The phone rings every damn day! What is wrong with you?!\" He yelled even louder. *Loud Noise...*  \n***Noise, noise, noise!***  \nI had been sick of him for a long time, but I had never had a way to get revenge. He continued yelling, but his yells became screams when I jumped over the table and  pounced on him.\nSure, killing that bird felt good...but it felt even more natural to rip my cousin's throat out.",
        "summary": [
            "One day, the narrator experiences heightened hearing and becomes agitated by loud noises.",
            "They become violent and kill a bird that is making noise outside.",
            "Later, when their cousin yells at them, they also attack and kill their cousin, feeling natural and satisfying about it."
        ],
        "errors": [
            0,
            1,
            1
        ],
        "story-id": 20,
        "explanations": [
            "The heightened hearing doesn't happen one day, the narrator always has it."
        ],
        "claims": [
            "The narrator experiences heightened hearing one day.",
            "The narrator becomes agitated by loud noises due to their heightened hearing.",
            "The narrator becomes violent and kills a bird making noise outside.",
            "The narrator's cousin yells at them at a later time.",
            "The narrator attacks and kills their cousin after being yelled at.",
            "The narrator feels that killing their cousin is both natural and satisfying."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049i9mo1w": {
        "label": 0,
        "difficulty": "hard",
        "story": "My twin brother Lance and I never really liked our aunt's house. She always seemed so creepy there, like she was hiding something. She also looked a little creepy and had some features I know she hadn't been born with. She almost looked like a mother, despite having no children and never having any or even a husband or boyfriend at all.  I mentioned it to our dad when we were about eight, but he said it was nothing to worry about.But it seemed like he was lying.Once when I was ten I saw my aunt take a small amount of food and some water into the basement late at night, which was strictly off limits to me and my brother, though it was never said aloud. It was locked at all times. *\"Why would she eat it in there?\"* I thought. I shared it with Lance but no one else. When we were fourteen, Lance and I went to the basement door late at night, when our parents and aunt were out. We were supposed to be asleep and they had taken our phones and the tv remotes with them, so we decided to play a game with the door, which the material was good for. One of us would do a pattern of knocking and the other would try to match it. Lame, but we figured we couldn't get any more bored than we already were, and we still didn't want to go to sleep. After about a minute of playing, something happened. Before I could answer lance's knock,someone else did.It had come from the basement, though further down, not at the door. But we could hear it clearly. \"Okay, that is it!\" Lance said, removing the pin that keeps his bangs out of his face. \"What do you mean?!\" I asked. He pushed me out of the way and started to pick the lock. \"We can't wait for mom and dad to get back, I'm unlocking this door NOW!\" He said.  \nWe were down in the basement with our flashlights, looking to see who had knocked back. We were both scared and determined. Then my flashlight turn on something that terrified me.\n\nShe looked about seventeen, and so much like me and Lance. She had long hair that almost touched the floor and slightly obscured her face, and it was black like mine and Lance's. She had the same pale skin as us and the same light smattering of dark freckles as us. Her clothes looked like she hadn't had new ones since ten. She looked so scared but relived to see us at the same time. She looked so much like my aunt. I didn't learn until later why she was put down there, but I already knew one thing in that moment.\n\nThis was my cousin.",
        "summary": [
            "The protagonist and his twin brother Lance have always had an uneasy feeling about their aunt's house.",
            "They perceive her as creepy and feel she always hides something.",
            "One night, when the twins are ten years old, they observe their aunt taking food into the locked basement, which is off-limits.",
            "When they are fourteen, the boys play a knocking game with the basement door and hear a responding knock from within.",
            "Driven by curiosity and fear, Lance picks the lock and they descend into the basement with flashlights.",
            "They discover a seventeen-year-old girl who bears a striking resemblance to them both.",
            "Though they don't know why she's in the basement, the protagonist immediately recognizes the girl to be their cousin."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 21,
        "explanations": [
            "The protagonist alone sees the aunt taking food to the basement and tells Lance."
        ],
        "claims": [
            "The protagonist and his twin brother, Lance, have always felt uneasy about their aunt's house.",
            "The protagonist and Lance perceive their aunt as creepy.",
            "The protagonist and Lance feel their aunt always hides something.",
            "One night, when the twins are ten years old, they observe their aunt taking food into the locked basement.",
            "The basement is off-limits to the protagonist and Lance.",
            "When the twins are fourteen years old, they play a knocking game with the basement door.",
            "During the knocking game, they hear a knock responding from within the basement.",
            "Driven by curiosity and fear, Lance picks the lock of the basement door.",
            "The protagonist and Lance descend into the basement with flashlights.",
            "In the basement, they discover a seventeen-year-old girl who looks very similar to them.",
            "The protagonist and Lance do not know why the girl is in the basement.",
            "The protagonist immediately recognizes the girl as their cousin."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479i9mo1w": {
        "label": 1,
        "difficulty": "",
        "story": "My twin brother Lance and I never really liked our aunt's house. She always seemed so creepy there, like she was hiding something. She also looked a little creepy and had some features I know she hadn't been born with. She almost looked like a mother, despite having no children and never having any or even a husband or boyfriend at all.  I mentioned it to our dad when we were about eight, but he said it was nothing to worry about.But it seemed like he was lying.Once when I was ten I saw my aunt take a small amount of food and some water into the basement late at night, which was strictly off limits to me and my brother, though it was never said aloud. It was locked at all times. *\"Why would she eat it in there?\"* I thought. I shared it with Lance but no one else. When we were fourteen, Lance and I went to the basement door late at night, when our parents and aunt were out. We were supposed to be asleep and they had taken our phones and the tv remotes with them, so we decided to play a game with the door, which the material was good for. One of us would do a pattern of knocking and the other would try to match it. Lame, but we figured we couldn't get any more bored than we already were, and we still didn't want to go to sleep. After about a minute of playing, something happened. Before I could answer lance's knock,someone else did.It had come from the basement, though further down, not at the door. But we could hear it clearly. \"Okay, that is it!\" Lance said, removing the pin that keeps his bangs out of his face. \"What do you mean?!\" I asked. He pushed me out of the way and started to pick the lock. \"We can't wait for mom and dad to get back, I'm unlocking this door NOW!\" He said.  \nWe were down in the basement with our flashlights, looking to see who had knocked back. We were both scared and determined. Then my flashlight turn on something that terrified me.\n\nShe looked about seventeen, and so much like me and Lance. She had long hair that almost touched the floor and slightly obscured her face, and it was black like mine and Lance's. She had the same pale skin as us and the same light smattering of dark freckles as us. Her clothes looked like she hadn't had new ones since ten. She looked so scared but relived to see us at the same time. She looked so much like my aunt. I didn't learn until later why she was put down there, but I already knew one thing in that moment.\n\nThis was my cousin.",
        "summary": [
            "In this story, the narrator and their twin brother, Lance, have always found their aunt's house creepy.",
            "The aunt herself seems to have some unusual features and looks almost like a mother despite not having children.",
            "When the narrator was ten, they saw their aunt taking food and water into the locked basement, which was off-limits to the children.",
            "At age fourteen, while their parents and aunt were out, the twins decided to play a knocking game at the basement door to pass the time.",
            "Suddenly, someone knocked back from within the basement.",
            "Determined to find out who was there, Lance picked the lock, and they entered the basement with flashlights.",
            "In the basement, they discovered a seventeen-year-old girl who bore a striking resemblance to the twins and their aunt.",
            "She had long black hair, pale skin, and dark freckles, just like the twins.",
            "Her clothes appeared old, as if she hadn't had new ones since she was ten.",
            "The girl seemed both scared and relieved to see them.Although the narrator didn't learn the reason for the girl's confinement in the basement until later, they immediately realized that this girl was their cousin."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 21,
        "explanations": [],
        "claims": [
            "The narrator and their twin brother, Lance, have always found their aunt's house to be creepy.",
            "The narrator's aunt has unusual features and looks almost like a mother despite not having children.",
            "When the narrator was ten years old, they saw their aunt taking food and water into the locked basement, which was off-limits to the children.",
            "At the age of fourteen, while their parents and aunt were out, the narrator and Lance decided to play a knocking game at the basement door.",
            "Someone knocked back from within the basement during the knocking game.",
            "Lance picked the lock of the basement door after hearing the knock from inside.",
            "The narrator and Lance entered the basement with flashlights.",
            "In the basement, they discovered a seventeen-year-old girl who bore a striking resemblance to them and their aunt.",
            "The girl they found in the basement had long black hair, pale skin, and dark freckles.",
            "The clothes of the girl found in the basement appeared old, as if she hadn't had new ones since she was ten years old.",
            "The girl seemed both scared and relieved to see the narrator and Lance.",
            "The narrator immediately realized that the girl was their cousin, although they didn't learn the reason for her confinement in the basement until later."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473i9mo1w": {
        "label": 0,
        "difficulty": "easy",
        "story": "My twin brother Lance and I never really liked our aunt's house. She always seemed so creepy there, like she was hiding something. She also looked a little creepy and had some features I know she hadn't been born with. She almost looked like a mother, despite having no children and never having any or even a husband or boyfriend at all.  I mentioned it to our dad when we were about eight, but he said it was nothing to worry about.But it seemed like he was lying.Once when I was ten I saw my aunt take a small amount of food and some water into the basement late at night, which was strictly off limits to me and my brother, though it was never said aloud. It was locked at all times. *\"Why would she eat it in there?\"* I thought. I shared it with Lance but no one else. When we were fourteen, Lance and I went to the basement door late at night, when our parents and aunt were out. We were supposed to be asleep and they had taken our phones and the tv remotes with them, so we decided to play a game with the door, which the material was good for. One of us would do a pattern of knocking and the other would try to match it. Lame, but we figured we couldn't get any more bored than we already were, and we still didn't want to go to sleep. After about a minute of playing, something happened. Before I could answer lance's knock,someone else did.It had come from the basement, though further down, not at the door. But we could hear it clearly. \"Okay, that is it!\" Lance said, removing the pin that keeps his bangs out of his face. \"What do you mean?!\" I asked. He pushed me out of the way and started to pick the lock. \"We can't wait for mom and dad to get back, I'm unlocking this door NOW!\" He said.  \nWe were down in the basement with our flashlights, looking to see who had knocked back. We were both scared and determined. Then my flashlight turn on something that terrified me.\n\nShe looked about seventeen, and so much like me and Lance. She had long hair that almost touched the floor and slightly obscured her face, and it was black like mine and Lance's. She had the same pale skin as us and the same light smattering of dark freckles as us. Her clothes looked like she hadn't had new ones since ten. She looked so scared but relived to see us at the same time. She looked so much like my aunt. I didn't learn until later why she was put down there, but I already knew one thing in that moment.\n\nThis was my cousin.",
        "summary": [
            "Twin siblings, Lance and the narrator, are suspicious of their creepy aunt and her locked basement.",
            "They sneak down one night and find their cousin locked up, who resembles their aunt.",
            "They realize their cousin has been kept hidden away by their aunt and feel both scared and relieved to have found her."
        ],
        "errors": [
            1,
            1,
            0
        ],
        "story-id": 21,
        "explanations": [
            "The girl is \"scared and relieved\", not the twin boys."
        ],
        "claims": [
            "Lance and the narrator are twin siblings.",
            "Lance and the narrator are suspicious of their aunt.",
            "The aunt has a locked basement.",
            "Lance and the narrator sneak down to the basement one night.",
            "They find their cousin locked up in the basement.",
            "The cousin they find resembles their aunt.",
            "Lance and the narrator realize their cousin has been kept hidden away by their aunt.",
            "Lance and the narrator feel scared upon discovering their cousin.",
            "Lance and the narrator feel relieved upon discovering their cousin."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049ifb4eq": {
        "label": 0,
        "difficulty": "hard",
        "story": "The tree was dying. It knew that it did not have much time left. \nThe season had been dry and other, bigger trees in the forest had used up most of the nutrients and moisture that were still left in the soil around it. \nIt was still a thin and small trunk with only few branches and shallow roots. It lacked the resources to compete with the bigger trees around it. \nWhat use would it be to struggle against that already decided fate? Every day was just one day closer to the inevitable end. \nBut one day a stranger came to the forest. \nA human. \nThe tree did not know humans well. They rarely visited its part of the forest. On the rare occasions one found their way here they did not stay long. \nThis day too the tree expected the human to leave after a brief look around. \nBut that is not what happened. \nWith wide eyes full of wonder the human took in the vibrant environment. It seemed to be fascinated by all the trees and flowers that grew here. \nAnd then the human's gaze fell onto the dying tree. With browning, too dry leaves and in some places almost naked twigs and branches it was not pretty to look at. \nThe tree was sure the human would soon point its attention to the prettier and healthier plants around it. \nInstead the human stepped forward and touched one of its dried out branches with gentle fingers. It took out some kind of container from its pouch and slowly started pouring the liquid from it on the dry soil around the dying tree. \nWater. \nThe human had given it water.\nThe tree soaked it up as fast as it could. It wasn't quite enough but it was more than it had gotten in what felt like a long time. \nA fighting chance. Hope. \nThe container was empty now and the human put it back in its pouch. It looked reluctant. Then the human made some noises that the tree did not understand and left. \nIt was a short encounter, but it had fed the tree's dying flame of hope a little. The water had not been much, but it was enough to tide it over for just a bit longer. \nIt had a chance now. \nAnd unexpectedly the human visited again. And again and again. \nEach time bringing water with it and one time even some fresh, rich soil that it put around the tree. \nWith the human's help the previously dying tree began to flourish. On the outside not much difference could be seen yet but the changes were happening. The tree had fanned out its roots. It was growing them deeper every day in order to have a stable base for the future, with better access to the nutrients deep inside the earth. \nIt was also growing little buds, where flowers would bloom in time. There weren't many yet, but they gave hope for the future. \nOne bud was almost ready to bloom. It was hidden behind some leafs though so it wasn't directly visible. \nOne day the human came by again but didn't act like it normally did. \nThe human sat down on the ground with their arms slung tightly around themselves. \nWater started leaking from their eyes and desperate noises escaped their throat. \nIt sat there like that for a long time. \nThe tree did not know what was wrong with this human. It did not understand the behaviour the human was showing right now. But the tree knew one thing. \nIt wanted to do something for this human that had done so much for it. \nWith much effort it rustled some of its leaves. Some of them fell to the ground in front of the human. \nThe human looked up startled by the sudden noise. \nA beautiful, vibrant flower bloomed, no longer hidden by leafs. The tree had poured all the resources it could muster at that moment into that flower. This flower was all it had to give. \nThe humans eyes grew wide and the water stopped leaking from them. A big smile formed on the human's face. With gentle hands it touched the vibrant flower, careful not to accidentally damage it. \n\"Thank you\"\nEven though the tree could not understand the human language it understood the message the tried to convey. \nThe flower was the tree's thank you and the human had understood.\nSometimes with just a little help life found a way to persevere. And as long as there was a little life left there was hope. \nThe human stayed with the tree a long time before going away that day. And the tree knew that the human would always come back. As long as there is life there is hope.",
        "summary": [
            "The story is about a small, dying tree in a forest struggling for survival due to the dry season and larger trees around hogging the nutrients and moisture.",
            "The tree is visited by a human who waters and nourishes it, giving the tree hope and a fighting chance to survive.",
            "The human continues to visit, bringing water and good soil, and soon, the tree begins to revitalize and grow at its own pace.",
            "One day when the human is sad, the tree rustles its leaves and displays a blooming flower visible for the first time, a thank you and symbol of hope from the tree.",
            "The human understands the gesture despite the language barrier.",
            "The story exemplifies hope and resilience.",
            "As long as there's life, there's hope, and sometimes, simple gestures of compassion can greatly impact life around us."
        ],
        "errors": [
            1,
            1,
            1,
            0,
            1,
            1,
            1
        ],
        "story-id": 22,
        "explanations": [
            "The flower is a thank you, not a symbol of hope."
        ],
        "claims": [
            "The story is set in a forest.",
            "There is a small tree in the forest that is dying.",
            "The small tree is struggling for survival because of the dry season.",
            "Larger trees around the small tree are hogging the nutrients and moisture.",
            "A human visits the small tree.",
            "The human waters the small tree.",
            "The human nourishes the small tree.",
            "The human's actions give the small tree hope.",
            "The human's actions give the small tree a fighting chance to survive.",
            "The human continues to visit the small tree.",
            "The human brings water to the small tree on subsequent visits.",
            "The human brings good soil to the small tree on subsequent visits.",
            "The small tree begins to revitalize after the human's interventions.",
            "The small tree begins to grow at its own pace after the human's interventions.",
            "One day, the human is sad during a visit to the small tree.",
            "The small tree rustles its leaves when the human is sad.",
            "The small tree displays a blooming flower for the first time when the human is sad.",
            "The blooming flower is a thank you from the small tree to the human.",
            "The blooming flower is a symbol of hope from the small tree to the human.",
            "The human understands the gesture of the small tree despite the language barrier.",
            "The story exemplifies hope.",
            "The story exemplifies resilience.",
            "The story conveys that as long as there's life, there's hope.",
            "The story conveys that simple gestures of compassion can greatly impact life around us."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479ifb4eq": {
        "label": 1,
        "difficulty": "",
        "story": "The tree was dying. It knew that it did not have much time left. \nThe season had been dry and other, bigger trees in the forest had used up most of the nutrients and moisture that were still left in the soil around it. \nIt was still a thin and small trunk with only few branches and shallow roots. It lacked the resources to compete with the bigger trees around it. \nWhat use would it be to struggle against that already decided fate? Every day was just one day closer to the inevitable end. \nBut one day a stranger came to the forest. \nA human. \nThe tree did not know humans well. They rarely visited its part of the forest. On the rare occasions one found their way here they did not stay long. \nThis day too the tree expected the human to leave after a brief look around. \nBut that is not what happened. \nWith wide eyes full of wonder the human took in the vibrant environment. It seemed to be fascinated by all the trees and flowers that grew here. \nAnd then the human's gaze fell onto the dying tree. With browning, too dry leaves and in some places almost naked twigs and branches it was not pretty to look at. \nThe tree was sure the human would soon point its attention to the prettier and healthier plants around it. \nInstead the human stepped forward and touched one of its dried out branches with gentle fingers. It took out some kind of container from its pouch and slowly started pouring the liquid from it on the dry soil around the dying tree. \nWater. \nThe human had given it water.\nThe tree soaked it up as fast as it could. It wasn't quite enough but it was more than it had gotten in what felt like a long time. \nA fighting chance. Hope. \nThe container was empty now and the human put it back in its pouch. It looked reluctant. Then the human made some noises that the tree did not understand and left. \nIt was a short encounter, but it had fed the tree's dying flame of hope a little. The water had not been much, but it was enough to tide it over for just a bit longer. \nIt had a chance now. \nAnd unexpectedly the human visited again. And again and again. \nEach time bringing water with it and one time even some fresh, rich soil that it put around the tree. \nWith the human's help the previously dying tree began to flourish. On the outside not much difference could be seen yet but the changes were happening. The tree had fanned out its roots. It was growing them deeper every day in order to have a stable base for the future, with better access to the nutrients deep inside the earth. \nIt was also growing little buds, where flowers would bloom in time. There weren't many yet, but they gave hope for the future. \nOne bud was almost ready to bloom. It was hidden behind some leafs though so it wasn't directly visible. \nOne day the human came by again but didn't act like it normally did. \nThe human sat down on the ground with their arms slung tightly around themselves. \nWater started leaking from their eyes and desperate noises escaped their throat. \nIt sat there like that for a long time. \nThe tree did not know what was wrong with this human. It did not understand the behaviour the human was showing right now. But the tree knew one thing. \nIt wanted to do something for this human that had done so much for it. \nWith much effort it rustled some of its leaves. Some of them fell to the ground in front of the human. \nThe human looked up startled by the sudden noise. \nA beautiful, vibrant flower bloomed, no longer hidden by leafs. The tree had poured all the resources it could muster at that moment into that flower. This flower was all it had to give. \nThe humans eyes grew wide and the water stopped leaking from them. A big smile formed on the human's face. With gentle hands it touched the vibrant flower, careful not to accidentally damage it. \n\"Thank you\"\nEven though the tree could not understand the human language it understood the message the tried to convey. \nThe flower was the tree's thank you and the human had understood.\nSometimes with just a little help life found a way to persevere. And as long as there was a little life left there was hope. \nThe human stayed with the tree a long time before going away that day. And the tree knew that the human would always come back. As long as there is life there is hope.",
        "summary": [
            "In this story, a dying tree in a forest struggles to survive due to a dry season and competition from larger trees.",
            "A human visitor arrives and, fascinated by the forest, notices the dying tree.",
            "The human decides to help the tree by providing it with water and rich soil.",
            "With the human's continued support, the tree slowly begins to recover, growing deeper roots and producing buds that will eventually bloom into flowers.",
            "One day, the human visits the tree in a distressed state, crying and holding themselves tightly.",
            "The tree, wanting to reciprocate the human's kindness, musters its energy to produce a single, vibrant flower.",
            "The tree rustles its leaves, causing the flower to become visible to the human.",
            "The human, touched by the tree's gesture, smiles and gently touches the flower, expressing gratitude.",
            "The story emphasizes the power of a small act of kindness and the resilience of life.",
            "It suggests that with a little help and support, even those struggling can find the strength to persevere and that as long as there is life, there is hope.",
            "The bond formed between the human and the tree highlights the interconnectedness of all living beings and the importance of caring for one another."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 22,
        "explanations": [],
        "claims": [
            "A tree in a forest is dying due to a dry season.",
            "The dying tree is struggling to survive because of competition from larger trees.",
            "A human visitor arrives in the forest and notices the dying tree.",
            "The human decides to help the dying tree by providing it with water.",
            "The human also enriches the soil around the dying tree.",
            "With the human's support, the tree begins to recover by growing deeper roots.",
            "The recovering tree starts producing buds that will bloom into flowers.",
            "One day, the human visits the tree while crying and holding themselves tightly.",
            "The tree wants to reciprocate the human's kindness.",
            "The tree musters its energy to produce a single, vibrant flower.",
            "The tree rustles its leaves to make the flower visible to the human.",
            "The human smiles and gently touches the flower, expressing gratitude.",
            "The story suggests that small acts of kindness have the power to make a significant difference.",
            "The story highlights the resilience of life and the possibility of recovery with help and support.",
            "It is suggested that there is always hope as long as there is life.",
            "The bond between the human and the tree illustrates the interconnectedness of all living beings.",
            "The importance of caring for one another is emphasized through the relationship between the human and the tree."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473ifb4eq": {
        "label": 1,
        "difficulty": "",
        "story": "The tree was dying. It knew that it did not have much time left. \nThe season had been dry and other, bigger trees in the forest had used up most of the nutrients and moisture that were still left in the soil around it. \nIt was still a thin and small trunk with only few branches and shallow roots. It lacked the resources to compete with the bigger trees around it. \nWhat use would it be to struggle against that already decided fate? Every day was just one day closer to the inevitable end. \nBut one day a stranger came to the forest. \nA human. \nThe tree did not know humans well. They rarely visited its part of the forest. On the rare occasions one found their way here they did not stay long. \nThis day too the tree expected the human to leave after a brief look around. \nBut that is not what happened. \nWith wide eyes full of wonder the human took in the vibrant environment. It seemed to be fascinated by all the trees and flowers that grew here. \nAnd then the human's gaze fell onto the dying tree. With browning, too dry leaves and in some places almost naked twigs and branches it was not pretty to look at. \nThe tree was sure the human would soon point its attention to the prettier and healthier plants around it. \nInstead the human stepped forward and touched one of its dried out branches with gentle fingers. It took out some kind of container from its pouch and slowly started pouring the liquid from it on the dry soil around the dying tree. \nWater. \nThe human had given it water.\nThe tree soaked it up as fast as it could. It wasn't quite enough but it was more than it had gotten in what felt like a long time. \nA fighting chance. Hope. \nThe container was empty now and the human put it back in its pouch. It looked reluctant. Then the human made some noises that the tree did not understand and left. \nIt was a short encounter, but it had fed the tree's dying flame of hope a little. The water had not been much, but it was enough to tide it over for just a bit longer. \nIt had a chance now. \nAnd unexpectedly the human visited again. And again and again. \nEach time bringing water with it and one time even some fresh, rich soil that it put around the tree. \nWith the human's help the previously dying tree began to flourish. On the outside not much difference could be seen yet but the changes were happening. The tree had fanned out its roots. It was growing them deeper every day in order to have a stable base for the future, with better access to the nutrients deep inside the earth. \nIt was also growing little buds, where flowers would bloom in time. There weren't many yet, but they gave hope for the future. \nOne bud was almost ready to bloom. It was hidden behind some leafs though so it wasn't directly visible. \nOne day the human came by again but didn't act like it normally did. \nThe human sat down on the ground with their arms slung tightly around themselves. \nWater started leaking from their eyes and desperate noises escaped their throat. \nIt sat there like that for a long time. \nThe tree did not know what was wrong with this human. It did not understand the behaviour the human was showing right now. But the tree knew one thing. \nIt wanted to do something for this human that had done so much for it. \nWith much effort it rustled some of its leaves. Some of them fell to the ground in front of the human. \nThe human looked up startled by the sudden noise. \nA beautiful, vibrant flower bloomed, no longer hidden by leafs. The tree had poured all the resources it could muster at that moment into that flower. This flower was all it had to give. \nThe humans eyes grew wide and the water stopped leaking from them. A big smile formed on the human's face. With gentle hands it touched the vibrant flower, careful not to accidentally damage it. \n\"Thank you\"\nEven though the tree could not understand the human language it understood the message the tried to convey. \nThe flower was the tree's thank you and the human had understood.\nSometimes with just a little help life found a way to persevere. And as long as there was a little life left there was hope. \nThe human stayed with the tree a long time before going away that day. And the tree knew that the human would always come back. As long as there is life there is hope.",
        "summary": [
            "A dying tree in a dry forest is given new life by a kind human who provides water and care.",
            "The tree is able to grow and bloom, and in doing so, it brings joy and hope to the human who has helped it.",
            "The tree learned that with a little help, life can persevere and there is always hope."
        ],
        "errors": [
            1,
            1,
            1
        ],
        "story-id": 22,
        "explanations": [],
        "claims": [
            "1. A tree is dying in a dry forest. \n2. A human provides water and care to the dying tree. \n3. The tree, after receiving water and care from the human, is able to grow. \n4. The tree, after receiving water and care from the human, is able to bloom. \n5. The growth and blooming of the tree bring joy to the human who helped it. \n6. The growth and blooming of the tree bring hope to the human who helped it. \n7. The tree learns that with a little help, life can persevere. \n8. The tree learns that there is always hope with a little help."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049j3pa4l": {
        "label": 1,
        "difficulty": "",
        "story": "For as long as I can remember, this city has tormented me. A paradise to all outside of it and a prison for all who inhabit it. I held the gun in my hand, my final possession worthy of keeping. This city... has taken everything from me. A member of the law, a beautiful family, a peaceful life that was more than anyone could ask for.\n\nTaken.\n\nThe noisy clubs and neon lights deafen and blind everyone from the rotten core I've dealt with day in and day out. The red lights hide the blood on my hands. Sirens wail in the distance. No matter how steaming hot this night got, this rooftop filled with bodies felt colder than the deepest crypt. All I could do was sit there by the concrete ledge, facing the doorway holding the stairs, waiting for shadows to dance maniacally before me as the bite on my shoulder felt like a blowtorch breathed down my neck.\n\nI saw the others get bit. I saw my family get bit. I saw what they turned into. It was hard to fight off the call of sleep coursing through my veins from the wound. The only thing in me keeping it at bay was the adrenaline rush every time I felt the kick of the gun or the crunch of their bones against my hands and feet. In those sweet, precious, moments, I felt alive. Their destruction was my second heartbeat.\n\nYet no matter how many I killed, they kept coming. Kept finding me. They smelled the trail of blood, mine, and theirs. The most vile things imaginable, forcing me to do what's right until I don't know what's right anymore. An incentive to seek them out and blow their brains out. Blow any brain out to end the madness.\n\nChecking the magazine, a lonely brass shell met my hopeful greeting. Shoving it back in with a huff, I hear the snarl that echoed in my mind all night. They are coming. I am going. My family is waiting for me.\n\nAiming under my own chin, I pulled the trigger.\n\nI didn't hear the blessed scream of the barrel. Instead, I heard the same voice that haunted my dreams.\n\n\"Rebooting Obedience Program. Deleting memory cache. Please stand by...\"",
        "summary": [
            "The narrator is in a city that he likens to a prison.",
            "He is the last person standing after an epidemic or attack of some kind where people are bitten and turned into inhuman creatures.",
            "He battles these beings, using a gun and physical force, but they keep finding him due to the trail of blood he leaves behind from wounds he receives.",
            "The constant attacks and need for survival leave him questioning his moral compass.",
            "With only one bullet left and the creatures closing in on him, he decides to end his life.",
            "When he pulls the trigger, he doesn't hear the gunshot but rather a voice saying, \"Rebooting Obedience Program. Deleting memory cache. Please stand by...\" suggesting that the narrator might be part of a simulation or a programmed entity."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 23,
        "explanations": [],
        "claims": [
            "The narrator compares the city he is in to a prison.",
            "The narrator is the last person standing after an epidemic or attack.",
            "The epidemic or attack results in people being bitten and turned into inhuman creatures.",
            "The narrator battles these inhuman creatures using a gun and physical force.",
            "The inhuman creatures keep finding the narrator because of the trail of blood he leaves behind from his wounds.",
            "The constant attacks and the narrator's need for survival lead him to question his moral compass.",
            "The narrator has only one bullet left when the creatures are closing in on him.",
            "The narrator decides to end his life with the last bullet.",
            "When the narrator pulls the trigger, he does not hear the gunshot.",
            "Instead of hearing the gunshot, the narrator hears a voice saying, \"Rebooting Obedience Program. Deleting memory cache. Please stand by...\"",
            "The voice's message suggests that the narrator might be part of a simulation or a programmed entity."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479j3pa4l": {
        "label": 0,
        "difficulty": "hard",
        "story": "For as long as I can remember, this city has tormented me. A paradise to all outside of it and a prison for all who inhabit it. I held the gun in my hand, my final possession worthy of keeping. This city... has taken everything from me. A member of the law, a beautiful family, a peaceful life that was more than anyone could ask for.\n\nTaken.\n\nThe noisy clubs and neon lights deafen and blind everyone from the rotten core I've dealt with day in and day out. The red lights hide the blood on my hands. Sirens wail in the distance. No matter how steaming hot this night got, this rooftop filled with bodies felt colder than the deepest crypt. All I could do was sit there by the concrete ledge, facing the doorway holding the stairs, waiting for shadows to dance maniacally before me as the bite on my shoulder felt like a blowtorch breathed down my neck.\n\nI saw the others get bit. I saw my family get bit. I saw what they turned into. It was hard to fight off the call of sleep coursing through my veins from the wound. The only thing in me keeping it at bay was the adrenaline rush every time I felt the kick of the gun or the crunch of their bones against my hands and feet. In those sweet, precious, moments, I felt alive. Their destruction was my second heartbeat.\n\nYet no matter how many I killed, they kept coming. Kept finding me. They smelled the trail of blood, mine, and theirs. The most vile things imaginable, forcing me to do what's right until I don't know what's right anymore. An incentive to seek them out and blow their brains out. Blow any brain out to end the madness.\n\nChecking the magazine, a lonely brass shell met my hopeful greeting. Shoving it back in with a huff, I hear the snarl that echoed in my mind all night. They are coming. I am going. My family is waiting for me.\n\nAiming under my own chin, I pulled the trigger.\n\nI didn't hear the blessed scream of the barrel. Instead, I heard the same voice that haunted my dreams.\n\n\"Rebooting Obedience Program. Deleting memory cache. Please stand by...\"",
        "summary": [
            "The story is a dark and gritty tale of a person who has lost everything in a city that they perceive as a paradise for outsiders but a prison for its inhabitants.",
            "The protagonist, once a member of law enforcement with a beautiful family and peaceful life, has been reduced to fighting off what appears to be a zombie-like outbreak.",
            "The city's noisy clubs and neon lights serve as a stark contrast to the protagonist's internal struggle and the violence they have experienced.",
            "The red lights symbolically hide the blood on their hands as they fight to survive.Despite their efforts to fight off the infected, the protagonist is bitten and struggles to stay awake.",
            "They find momentary solace in the destruction of the creatures, feeling alive in those brief instances.",
            "As the infected continue to pursue the protagonist, they are left with a single bullet.",
            "Faced with the impending arrival of more infected and the weight of their losses, the protagonist chooses to end their own life.",
            "However, in a twist ending, it is revealed that the protagonist is part of an \"Obedience Program,\" suggesting that the entire experience may have been a simulation or a form of mind control.",
            "The story concludes with the program rebooting and the protagonist's memory being erased."
        ],
        "errors": [
            1,
            1,
            1,
            0,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 23,
        "explanations": [
            "The red lights do not \"symbolically\" hide the blood, this is a literal description."
        ],
        "claims": [
            "The story is set in a city perceived as a paradise by outsiders but as a prison by its inhabitants.",
            "The protagonist was once a member of law enforcement.",
            "The protagonist had a beautiful family and a peaceful life.",
            "The protagonist has been reduced to fighting off a zombie-like outbreak.",
            "The city features noisy clubs and neon lights.",
            "The protagonist experiences an internal struggle and violence.",
            "The red lights in the city symbolically hide the blood on the protagonist's hands.",
            "The protagonist fights to survive against the infected.",
            "The protagonist is bitten by one of the infected.",
            "The protagonist struggles to stay awake after being bitten.",
            "The protagonist finds momentary solace in destroying the creatures.",
            "The protagonist feels alive in the brief instances of destroying the creatures.",
            "The infected continue to pursue the protagonist.",
            "The protagonist is left with a single bullet.",
            "Faced with more infected arriving and the weight of their losses, the protagonist chooses to end their own life.",
            "It is revealed that the protagonist is part of an \"Obedience Program.\"",
            "The experience may have been a simulation or a form of mind control.",
            "The story concludes with the program rebooting.",
            "The protagonist's memory is erased at the end of the story."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473j3pa4l": {
        "label": 0,
        "difficulty": "easy",
        "story": "For as long as I can remember, this city has tormented me. A paradise to all outside of it and a prison for all who inhabit it. I held the gun in my hand, my final possession worthy of keeping. This city... has taken everything from me. A member of the law, a beautiful family, a peaceful life that was more than anyone could ask for.\n\nTaken.\n\nThe noisy clubs and neon lights deafen and blind everyone from the rotten core I've dealt with day in and day out. The red lights hide the blood on my hands. Sirens wail in the distance. No matter how steaming hot this night got, this rooftop filled with bodies felt colder than the deepest crypt. All I could do was sit there by the concrete ledge, facing the doorway holding the stairs, waiting for shadows to dance maniacally before me as the bite on my shoulder felt like a blowtorch breathed down my neck.\n\nI saw the others get bit. I saw my family get bit. I saw what they turned into. It was hard to fight off the call of sleep coursing through my veins from the wound. The only thing in me keeping it at bay was the adrenaline rush every time I felt the kick of the gun or the crunch of their bones against my hands and feet. In those sweet, precious, moments, I felt alive. Their destruction was my second heartbeat.\n\nYet no matter how many I killed, they kept coming. Kept finding me. They smelled the trail of blood, mine, and theirs. The most vile things imaginable, forcing me to do what's right until I don't know what's right anymore. An incentive to seek them out and blow their brains out. Blow any brain out to end the madness.\n\nChecking the magazine, a lonely brass shell met my hopeful greeting. Shoving it back in with a huff, I hear the snarl that echoed in my mind all night. They are coming. I am going. My family is waiting for me.\n\nAiming under my own chin, I pulled the trigger.\n\nI didn't hear the blessed scream of the barrel. Instead, I heard the same voice that haunted my dreams.\n\n\"Rebooting Obedience Program. Deleting memory cache. Please stand by...\"",
        "summary": [
            "The protagonist is a member of law enforcement in a corrupt city where they have lost everything, including their family, and are constantly fighting off zombie-like creatures.",
            "They contemplate ending their life, but instead their memory is wiped and they are reset to continue their duty of killing the creatures."
        ],
        "errors": [
            0,
            0
        ],
        "story-id": 23,
        "explanations": [
            "The protagonist is no longer a member of law enforcement.",
            "The protagonist does try to end their life, they don't just contemplate it."
        ],
        "claims": [
            "1. The protagonist is a member of law enforcement.",
            "2. The city where the protagonist works is corrupt.",
            "3. The protagonist has lost their family.",
            "4. The protagonist is constantly fighting off zombie-like creatures.",
            "5. The protagonist contemplates ending their life.",
            "6. The protagonist's memory is wiped.",
            "7. After their memory is wiped, the protagonist is reset.",
            "8. After being reset, the protagonist continues their duty of killing the creatures."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049jkc5q3": {
        "label": 1,
        "difficulty": "",
        "story": "Kyle and his parents recently bought a vacation home in South Jersey. \n\nSince Kyle was an only child, he decided he'd take a walk around his new beach town and meet new people. He was sixteen so his parents didn't care that he wondered off by himself. \n\nAfter exploring the town for the day, it was getting dark and Kyle decided he wanted to take a walk on the beach before he headed in for the night. \n\nHe walked along the tide. The beach before him was empty because it was late October and tourist season was long gone. That's why Kyle was shocked to see another person about twenty yards ahead of him, walking toward him. \n\nEven from this distance, he could make out that it was girl around his age walking his direction. And even from here, he could tell she was good looking. \n\nShe was now only ten yards away. Kyle slicked back his hair and went up to her. \n\n\"How ya doing\" Kyle asked. \nThe girl was pale, with long blonde hair and brown eyes. She almost didn't seem real, that's how pale she was. But she had a charming smile and a slim figure. \n\n\"I'm doing fine, just taking my normal stroll on the beach\", she said. \n\nThey chatted for awhile. He found out her name was Elizabeth Wilson and she also lived in town with her family. She was friendly but there was something mysterious about her. Kyle didn't know what but he was curious about her. \n\n\"Listen it's getting late\", Kyle said, acknowledging the moonlight reflecting off the ocean. \"Can I get your number? We'll get dinner sometime.\" Kyle said. \n\nElizabeth's eyes started to water, she sniffled as if she was about to cry. \n\n\"I'm sorry if that's too forward,\" Kyle tried to explain, wondering why she was suddenly so upset. \n\n\"I can't\" she said. Her eyes were wide and longing. She looked as if she wanted to say something else but didn't. \"I can only give you this.\" \n\nShe suddenly planted her lips on his and they shared a deep kiss. Kyle breathed deeply. He could smell the ocean and sand on her. He was about to pull her closer when Elizabeth pulled away. She looked at him, deep in his eyes and then sprinted away. \n\nStunned Kyle shouted. \"Hey wait, come back.\" \nBut it was too dark to see exactly where she ran off too. Kyle held his fingers to his lips, he could feel her kiss on lips, and he tasted salt. Ocean salt. \n \nConfused at what happened, Kyle made the walk back to his new house and went to bed. \n\nThe next morning he woke up, and immediately went out in town again. He wanted to find Elizabeth and find out what that was all about. He looked all around town and the beach but could not find her. \n\nDisappointed and still confused he sat alone in the sand, wondering about Elizabeth. \n\n\"You okay kid?\" A voice from behind him said. \nKyle spun around and saw a man in mid fifties walking toward him. \n\n\"Yeah I'm fine\" Kyle said, looking at the crashing waves before him. \n\"I saw you walking up and down the beach like you were on a mission to find somebody, any way I can help?\" The man said. He was now standing next to him, also admiring the ocean as the sun began to set. \n\nKyle thought maybe this guy would know Elizabeth, it was a small town after all. \n\n\"Well,\" Kyle began, \"I'm looking for a\" he didn't know what word to use. \"I'm looking for a friend,\" he decided to say. \"Her names Elizabeth. Elizabeth Wilson.\"\n\nKyle looked at the man expectantly, hoping he had some piece of information of who she is or where he might find her. \n\nThe man turned to face Kyle completely. \"Did you say, Elizabeth Wilson?\"\nKyle nodded yes. \n\nThe mans face grew serious in the sinking sun. \n\n\"What does she look like?\" The man asked.\n\"Pale, blonde hair, brown eyes, around my age, cute,\" Kyle answered. \n\nThe man looked questioning my into Kyle's eyes. \"You playing some kind of prank?\"\n\n\"No,\" Kyle answered. \"Not at all, I- \"\n\nBut the man cut him off. \"The Wilson's used to live two doors down from me.\" The man said, hitchhiking his thumb over his shoulder. \n\n\"But They moved about ten years ago,\" the man continued. \"Tragic what happened. Their daughter, Elizabeth went night swimming around this time of year, and she drowned. And they never found her body.\"\n\nKyle looked at the man in horror as realization dawned on him. Kyle hadn't kissed Elizabeth, he had kissed her ghost.",
        "summary": [
            "Kyle, a 16-year-old boy, and his parents bought a vacation home in South Jersey where he met a beautiful girl named Elizabeth during his stroll on the beach.",
            "They had a friendly chat, and Kyle found something mysterious about her.",
            "When he asked for her phone number, she seemed distressed but kissed Kyle before running away.",
            "The next day, when Kyle could not find her, a local man revealed that the Elizabeth he described had drowned ten years ago and her body was never found, leading Kyle to realize he had kissed a ghost."
        ],
        "errors": [
            1,
            1,
            1,
            1
        ],
        "story-id": 24,
        "explanations": [],
        "claims": [
            "Kyle is a 16-year-old boy.",
            "Kyle and his parents bought a vacation home in South Jersey.",
            "Kyle met a girl named Elizabeth while strolling on the beach in South Jersey.",
            "Kyle and Elizabeth had a friendly chat on the beach.",
            "Kyle found something mysterious about Elizabeth during their chat.",
            "When Kyle asked Elizabeth for her phone number, she seemed distressed.",
            "Elizabeth kissed Kyle before running away after he asked for her phone number.",
            "The next day, Kyle could not find Elizabeth.",
            "A local man revealed to Kyle that Elizabeth had drowned ten years ago.",
            "The local man also mentioned that Elizabeth's body was never found.",
            "Kyle realized he had kissed a ghost after hearing the local man's story."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479jkc5q3": {
        "label": 1,
        "difficulty": "",
        "story": "Kyle and his parents recently bought a vacation home in South Jersey. \n\nSince Kyle was an only child, he decided he'd take a walk around his new beach town and meet new people. He was sixteen so his parents didn't care that he wondered off by himself. \n\nAfter exploring the town for the day, it was getting dark and Kyle decided he wanted to take a walk on the beach before he headed in for the night. \n\nHe walked along the tide. The beach before him was empty because it was late October and tourist season was long gone. That's why Kyle was shocked to see another person about twenty yards ahead of him, walking toward him. \n\nEven from this distance, he could make out that it was girl around his age walking his direction. And even from here, he could tell she was good looking. \n\nShe was now only ten yards away. Kyle slicked back his hair and went up to her. \n\n\"How ya doing\" Kyle asked. \nThe girl was pale, with long blonde hair and brown eyes. She almost didn't seem real, that's how pale she was. But she had a charming smile and a slim figure. \n\n\"I'm doing fine, just taking my normal stroll on the beach\", she said. \n\nThey chatted for awhile. He found out her name was Elizabeth Wilson and she also lived in town with her family. She was friendly but there was something mysterious about her. Kyle didn't know what but he was curious about her. \n\n\"Listen it's getting late\", Kyle said, acknowledging the moonlight reflecting off the ocean. \"Can I get your number? We'll get dinner sometime.\" Kyle said. \n\nElizabeth's eyes started to water, she sniffled as if she was about to cry. \n\n\"I'm sorry if that's too forward,\" Kyle tried to explain, wondering why she was suddenly so upset. \n\n\"I can't\" she said. Her eyes were wide and longing. She looked as if she wanted to say something else but didn't. \"I can only give you this.\" \n\nShe suddenly planted her lips on his and they shared a deep kiss. Kyle breathed deeply. He could smell the ocean and sand on her. He was about to pull her closer when Elizabeth pulled away. She looked at him, deep in his eyes and then sprinted away. \n\nStunned Kyle shouted. \"Hey wait, come back.\" \nBut it was too dark to see exactly where she ran off too. Kyle held his fingers to his lips, he could feel her kiss on lips, and he tasted salt. Ocean salt. \n \nConfused at what happened, Kyle made the walk back to his new house and went to bed. \n\nThe next morning he woke up, and immediately went out in town again. He wanted to find Elizabeth and find out what that was all about. He looked all around town and the beach but could not find her. \n\nDisappointed and still confused he sat alone in the sand, wondering about Elizabeth. \n\n\"You okay kid?\" A voice from behind him said. \nKyle spun around and saw a man in mid fifties walking toward him. \n\n\"Yeah I'm fine\" Kyle said, looking at the crashing waves before him. \n\"I saw you walking up and down the beach like you were on a mission to find somebody, any way I can help?\" The man said. He was now standing next to him, also admiring the ocean as the sun began to set. \n\nKyle thought maybe this guy would know Elizabeth, it was a small town after all. \n\n\"Well,\" Kyle began, \"I'm looking for a\" he didn't know what word to use. \"I'm looking for a friend,\" he decided to say. \"Her names Elizabeth. Elizabeth Wilson.\"\n\nKyle looked at the man expectantly, hoping he had some piece of information of who she is or where he might find her. \n\nThe man turned to face Kyle completely. \"Did you say, Elizabeth Wilson?\"\nKyle nodded yes. \n\nThe mans face grew serious in the sinking sun. \n\n\"What does she look like?\" The man asked.\n\"Pale, blonde hair, brown eyes, around my age, cute,\" Kyle answered. \n\nThe man looked questioning my into Kyle's eyes. \"You playing some kind of prank?\"\n\n\"No,\" Kyle answered. \"Not at all, I- \"\n\nBut the man cut him off. \"The Wilson's used to live two doors down from me.\" The man said, hitchhiking his thumb over his shoulder. \n\n\"But They moved about ten years ago,\" the man continued. \"Tragic what happened. Their daughter, Elizabeth went night swimming around this time of year, and she drowned. And they never found her body.\"\n\nKyle looked at the man in horror as realization dawned on him. Kyle hadn't kissed Elizabeth, he had kissed her ghost.",
        "summary": [
            "In this story, Kyle is a 16-year-old boy who recently bought a vacation home with his parents in South Jersey.",
            "As an only child, he decides to explore the town and meet new people.",
            "One evening, while walking on the beach, he encounters a mysterious and attractive girl named Elizabeth Wilson.",
            "They chat for a while, and as it gets late, Kyle asks for her number.",
            "Instead of giving him her number, Elizabeth becomes emotional and kisses him before running away.",
            "The next day, Kyle searches for Elizabeth in town and on the beach but can't find her.",
            "While sitting on the beach, a man in his mid-fifties approaches him and asks if he needs help.",
            "Kyle tells the man he's looking for his friend Elizabeth Wilson and describes her appearance.",
            "The man's face grows serious, and he reveals that the Wilsons used to live near him but moved away about ten years ago after a tragic incident.",
            "Their daughter, Elizabeth, drowned while night swimming around the same time of year, and her body was never found.",
            "Kyle realizes with horror that he hadn't kissed Elizabeth, but rather her ghost."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 24,
        "explanations": [],
        "claims": [
            "Kyle is a 16-year-old boy.",
            "Kyle recently bought a vacation home with his parents in South Jersey.",
            "Kyle is an only child.",
            "Kyle decides to explore the town and meet new people.",
            "One evening, while walking on the beach, Kyle encounters a girl named Elizabeth Wilson.",
            "Elizabeth Wilson is described as mysterious and attractive.",
            "Kyle and Elizabeth chat for a while on the beach.",
            "As it gets late, Kyle asks Elizabeth for her number.",
            "Elizabeth becomes emotional and kisses Kyle before running away instead of giving him her number.",
            "The next day, Kyle searches for Elizabeth in town and on the beach but cannot find her.",
            "While sitting on the beach, a man in his mid-fifties approaches Kyle.",
            "The man in his mid-fifties asks Kyle if he needs help.",
            "Kyle tells the man he is looking for his friend Elizabeth Wilson and describes her appearance.",
            "The man's face grows serious upon hearing Elizabeth Wilson's name and description.",
            "The man reveals that the Wilsons used to live near him but moved away about ten years ago.",
            "The man mentions a tragic incident involving the Wilsons' daughter, Elizabeth, who drowned while night swimming around the same time of year.",
            "The man states that Elizabeth Wilson's body was never found after she drowned.",
            "Kyle realizes he hadn't kissed Elizabeth, but rather her ghost."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473jkc5q3": {
        "label": 1,
        "difficulty": "",
        "story": "Kyle and his parents recently bought a vacation home in South Jersey. \n\nSince Kyle was an only child, he decided he'd take a walk around his new beach town and meet new people. He was sixteen so his parents didn't care that he wondered off by himself. \n\nAfter exploring the town for the day, it was getting dark and Kyle decided he wanted to take a walk on the beach before he headed in for the night. \n\nHe walked along the tide. The beach before him was empty because it was late October and tourist season was long gone. That's why Kyle was shocked to see another person about twenty yards ahead of him, walking toward him. \n\nEven from this distance, he could make out that it was girl around his age walking his direction. And even from here, he could tell she was good looking. \n\nShe was now only ten yards away. Kyle slicked back his hair and went up to her. \n\n\"How ya doing\" Kyle asked. \nThe girl was pale, with long blonde hair and brown eyes. She almost didn't seem real, that's how pale she was. But she had a charming smile and a slim figure. \n\n\"I'm doing fine, just taking my normal stroll on the beach\", she said. \n\nThey chatted for awhile. He found out her name was Elizabeth Wilson and she also lived in town with her family. She was friendly but there was something mysterious about her. Kyle didn't know what but he was curious about her. \n\n\"Listen it's getting late\", Kyle said, acknowledging the moonlight reflecting off the ocean. \"Can I get your number? We'll get dinner sometime.\" Kyle said. \n\nElizabeth's eyes started to water, she sniffled as if she was about to cry. \n\n\"I'm sorry if that's too forward,\" Kyle tried to explain, wondering why she was suddenly so upset. \n\n\"I can't\" she said. Her eyes were wide and longing. She looked as if she wanted to say something else but didn't. \"I can only give you this.\" \n\nShe suddenly planted her lips on his and they shared a deep kiss. Kyle breathed deeply. He could smell the ocean and sand on her. He was about to pull her closer when Elizabeth pulled away. She looked at him, deep in his eyes and then sprinted away. \n\nStunned Kyle shouted. \"Hey wait, come back.\" \nBut it was too dark to see exactly where she ran off too. Kyle held his fingers to his lips, he could feel her kiss on lips, and he tasted salt. Ocean salt. \n \nConfused at what happened, Kyle made the walk back to his new house and went to bed. \n\nThe next morning he woke up, and immediately went out in town again. He wanted to find Elizabeth and find out what that was all about. He looked all around town and the beach but could not find her. \n\nDisappointed and still confused he sat alone in the sand, wondering about Elizabeth. \n\n\"You okay kid?\" A voice from behind him said. \nKyle spun around and saw a man in mid fifties walking toward him. \n\n\"Yeah I'm fine\" Kyle said, looking at the crashing waves before him. \n\"I saw you walking up and down the beach like you were on a mission to find somebody, any way I can help?\" The man said. He was now standing next to him, also admiring the ocean as the sun began to set. \n\nKyle thought maybe this guy would know Elizabeth, it was a small town after all. \n\n\"Well,\" Kyle began, \"I'm looking for a\" he didn't know what word to use. \"I'm looking for a friend,\" he decided to say. \"Her names Elizabeth. Elizabeth Wilson.\"\n\nKyle looked at the man expectantly, hoping he had some piece of information of who she is or where he might find her. \n\nThe man turned to face Kyle completely. \"Did you say, Elizabeth Wilson?\"\nKyle nodded yes. \n\nThe mans face grew serious in the sinking sun. \n\n\"What does she look like?\" The man asked.\n\"Pale, blonde hair, brown eyes, around my age, cute,\" Kyle answered. \n\nThe man looked questioning my into Kyle's eyes. \"You playing some kind of prank?\"\n\n\"No,\" Kyle answered. \"Not at all, I- \"\n\nBut the man cut him off. \"The Wilson's used to live two doors down from me.\" The man said, hitchhiking his thumb over his shoulder. \n\n\"But They moved about ten years ago,\" the man continued. \"Tragic what happened. Their daughter, Elizabeth went night swimming around this time of year, and she drowned. And they never found her body.\"\n\nKyle looked at the man in horror as realization dawned on him. Kyle hadn't kissed Elizabeth, he had kissed her ghost.",
        "summary": [
            "Kyle, a teenage boy exploring his new vacation home, meets and kisses a mysterious girl named Elizabeth on the beach.",
            "However, when he tries to find her the next day, he discovers that she had drowned years ago.",
            "It is revealed that he had actually kissed her ghost."
        ],
        "errors": [
            1,
            1,
            1
        ],
        "story-id": 24,
        "explanations": [],
        "claims": [
            "Kyle is a teenage boy.",
            "Kyle is exploring his new vacation home.",
            "Kyle meets a mysterious girl named Elizabeth on the beach.",
            "Kyle kisses Elizabeth on the beach.",
            "Kyle tries to find Elizabeth the next day.",
            "Kyle discovers that Elizabeth had drowned years ago.",
            "It is revealed that Kyle had actually kissed Elizabeth's ghost."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049jz0uy6": {
        "label": 0,
        "difficulty": "easy",
        "story": "Toby could not believe his luck. He had never achieved much success with women. As he had been often told, he lacked charm, looks or even that oft used fallback of a winning personality. Here she was however, dancing up against him. So close he could smell her perfume, he didn't recognise it but something in it drove him wild. The woman's slim frame and short dress certainly helped that too. She'd walked up to him, whispered in his ear in a voice like the sweetest honey that she liked his smile. That he had nice teeth. \n\nNothing else but inappropriate looks had been exchanged between them since then. She never opened her mouth. She hadn't spoken since they met and only appeared to breathe through her nose. On top of that her cheeks and lips seemed to bulge out slightly, like she was holding her breath. Then she pulled her top down a little further and those little details were lost to the back of his one track mind. \n\nToby took one last swig of the drink she had given him before hurling the bottle into the crowd behind him. In a voice far more slurred than confident he shouted over the din of the music \"So uh do you wanna get out of this dump? Your place or...\". The woman cut him off with a finger to his lips and a coy smile. \"My place then?\" he stammered, not having expected that to work. She nodded, took his hand and leads him out of the nightclub into the cool air. \n\nAs soon as they turned the corner from the nightclub, Toby seized the tiny blonde's shoulder and pushed her up against the wall. \"So how about a kiss?\" he slurred, leaning his face into hers. In response the woman placed one finger on his chest and pushed him back with ease. Then there was that coy smile again, lips never parting, before she took his hand and leads him on towards his house. That small part of his brain screamed out again. It tried warning the rest of him that a woman that small could not be that strong. That she was leading him straight to his house. Toby had never been the smartest man though and awash in alcohol the rest of his brain ignored the warning.   \n\nBefore he knew it he was at his door, the woman hanging off his arm softly giggled as he fiddled with his keys. His numb fingers dropped them, cursing he went to pick them up. Before he could the woman reached down, daintily gathered them up and walked past him to the door. Within a mere moment the door clicked and swung open. Toby stumbled past the woman into the hallway. He turned to see her stood right on the threshold, a forlorn look on her face. Irritated he blurted out \"well come on in then you dozy mare!\" Despite the unpleasant tone, she smiled at this, eyes agleam and stepped through the threshold. She pointed for Toby to head upstairs before turning and locking the door. Once she had snapped the key off in the lock, she followed Toby upstairs into the gloom. \n\nToby struggled furiously to get his trousers off. All he had managed however, was to get them tangled around his ankles. Before he could free himself, a short sharp shove sent him sprawling onto the bed. He scrambled onto his back in time to see the blonde climb onto the bed with him. She straddled his chest, placed a hand on each of his shoulders and pinned him to the bed. The crushing pain her hands were causing was immediately blocked out by her smile. She flashed him a toothy grin.\n\nEven in his drunken state Toby was sure humans didn't have that many teeth.\n\nThe woman's smile grew at the look of horror on his face. Her mouth opened wide. Then wider still. Even in the gloom Toby could see them now. Pearly white teeth filled her grotesquely large mouth. No tongue could be seen. Just teeth, human teeth. \n\n\"I gave you a gift at the club, you know how this works\" she said in her voice like honey \"for that you owe me.\" Toby tried to cry out, but a vice like hand clamped his mouth shut. He slammed his fist into her side. All he received for his efforts was a soft giggle. \"Yes this isn't how it worked when you were a child,\" she purred, \"but I always remembered you had such pretty teeth.\"\n\nWith that she leaned forwards, forced her hands into his mouth and pried it wide open. Toby felt an agonising pop as his jaw dislocated. The last thing he remembered was that horrifying woman's hand reaching inside his mouth and grabbing a tooth...",
        "summary": [
            "Toby, a man with limited success with women, finds himself entranced by a seductive woman at a nightclub.",
            "The woman's mysterious allure captivates him despite odd details such as her strength and constantly closed mouth.",
            "She takes him home and breaks the key in the lock, turning suddenly menacing as she reveals a mouth full of extra teeth, for which she credits Toby, as if he had played a part in giving them to her in the past.",
            "She then dislocates his jaw and begins to remove his teeth, leaving him in intense pain and fear."
        ],
        "errors": [
            1,
            1,
            0,
            0
        ],
        "story-id": 25,
        "explanations": [
            "She doesn't credit Toby for her teeth.",
            "She begins to remove just a single tooth at the end."
        ],
        "claims": [
            "Toby is a man with limited success with women.",
            "Toby finds himself entranced by a seductive woman at a nightclub.",
            "The seductive woman at the nightclub has a mysterious allure.",
            "Toby notices odd details about the woman, such as her strength and her constantly closed mouth.",
            "The woman takes Toby home.",
            "Upon arriving home, the woman breaks the key in the lock.",
            "After breaking the key in the lock, the woman turns suddenly menacing towards Toby.",
            "The woman reveals a mouth full of extra teeth to Toby.",
            "The woman credits Toby for her having a mouth full of extra teeth, implying he played a part in giving them to her in the past.",
            "The woman dislocates Toby's jaw.",
            "After dislocating his jaw, the woman begins to remove Toby's teeth.",
            "Toby experiences intense pain and fear as the woman removes his teeth."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479jz0uy6": {
        "label": 0,
        "difficulty": "hard",
        "story": "Toby could not believe his luck. He had never achieved much success with women. As he had been often told, he lacked charm, looks or even that oft used fallback of a winning personality. Here she was however, dancing up against him. So close he could smell her perfume, he didn't recognise it but something in it drove him wild. The woman's slim frame and short dress certainly helped that too. She'd walked up to him, whispered in his ear in a voice like the sweetest honey that she liked his smile. That he had nice teeth. \n\nNothing else but inappropriate looks had been exchanged between them since then. She never opened her mouth. She hadn't spoken since they met and only appeared to breathe through her nose. On top of that her cheeks and lips seemed to bulge out slightly, like she was holding her breath. Then she pulled her top down a little further and those little details were lost to the back of his one track mind. \n\nToby took one last swig of the drink she had given him before hurling the bottle into the crowd behind him. In a voice far more slurred than confident he shouted over the din of the music \"So uh do you wanna get out of this dump? Your place or...\". The woman cut him off with a finger to his lips and a coy smile. \"My place then?\" he stammered, not having expected that to work. She nodded, took his hand and leads him out of the nightclub into the cool air. \n\nAs soon as they turned the corner from the nightclub, Toby seized the tiny blonde's shoulder and pushed her up against the wall. \"So how about a kiss?\" he slurred, leaning his face into hers. In response the woman placed one finger on his chest and pushed him back with ease. Then there was that coy smile again, lips never parting, before she took his hand and leads him on towards his house. That small part of his brain screamed out again. It tried warning the rest of him that a woman that small could not be that strong. That she was leading him straight to his house. Toby had never been the smartest man though and awash in alcohol the rest of his brain ignored the warning.   \n\nBefore he knew it he was at his door, the woman hanging off his arm softly giggled as he fiddled with his keys. His numb fingers dropped them, cursing he went to pick them up. Before he could the woman reached down, daintily gathered them up and walked past him to the door. Within a mere moment the door clicked and swung open. Toby stumbled past the woman into the hallway. He turned to see her stood right on the threshold, a forlorn look on her face. Irritated he blurted out \"well come on in then you dozy mare!\" Despite the unpleasant tone, she smiled at this, eyes agleam and stepped through the threshold. She pointed for Toby to head upstairs before turning and locking the door. Once she had snapped the key off in the lock, she followed Toby upstairs into the gloom. \n\nToby struggled furiously to get his trousers off. All he had managed however, was to get them tangled around his ankles. Before he could free himself, a short sharp shove sent him sprawling onto the bed. He scrambled onto his back in time to see the blonde climb onto the bed with him. She straddled his chest, placed a hand on each of his shoulders and pinned him to the bed. The crushing pain her hands were causing was immediately blocked out by her smile. She flashed him a toothy grin.\n\nEven in his drunken state Toby was sure humans didn't have that many teeth.\n\nThe woman's smile grew at the look of horror on his face. Her mouth opened wide. Then wider still. Even in the gloom Toby could see them now. Pearly white teeth filled her grotesquely large mouth. No tongue could be seen. Just teeth, human teeth. \n\n\"I gave you a gift at the club, you know how this works\" she said in her voice like honey \"for that you owe me.\" Toby tried to cry out, but a vice like hand clamped his mouth shut. He slammed his fist into her side. All he received for his efforts was a soft giggle. \"Yes this isn't how it worked when you were a child,\" she purred, \"but I always remembered you had such pretty teeth.\"\n\nWith that she leaned forwards, forced her hands into his mouth and pried it wide open. Toby felt an agonising pop as his jaw dislocated. The last thing he remembered was that horrifying woman's hand reaching inside his mouth and grabbing a tooth...",
        "summary": [
            "In the story, Toby, an unsuccessful man with women, is approached by a mysterious woman at a nightclub who compliments his smile and teeth.",
            "Despite her odd behavior, such as not speaking and having slightly bulging cheeks, Toby is captivated by her appearance.",
            "After sharing a drink, they leave for Toby's house.",
            "Outside the nightclub, the woman demonstrates unusual strength, and Toby's instincts warn him that something is amiss.",
            "However, he ignores these warnings due to his intoxication.",
            "At his house, the woman easily unlocks the door and follows Toby inside after he invites her in.",
            "In the bedroom, the woman overpowers Toby and pins him to the bed.",
            "She reveals a grotesquely large mouth filled with numerous human teeth.",
            "The woman reminds Toby that he owes her for a gift she gave him at the club, implying a connection to his childhood.",
            "As Toby tries to fight back, the woman forces his mouth open, dislocating his jaw, and reaches inside to grab a tooth, leaving his fate uncertain."
        ],
        "errors": [
            1,
            1,
            0,
            1,
            1,
            1,
            1,
            1,
            0,
            1
        ],
        "story-id": 25,
        "explanations": [
            "She gives him a drink. There is no evidence that they share it.",
            "The gift at the club does not imply a connection to his childhood. They are two separate utterances."
        ],
        "claims": [
            "Toby is an unsuccessful man with women.",
            "A mysterious woman approaches Toby at a nightclub.",
            "The mysterious woman compliments Toby's smile and teeth.",
            "The mysterious woman does not speak.",
            "The mysterious woman has slightly bulging cheeks.",
            "Toby is captivated by the mysterious woman's appearance.",
            "Toby and the mysterious woman share a drink at the nightclub.",
            "Toby and the mysterious woman leave the nightclub for Toby's house.",
            "Outside the nightclub, the mysterious woman demonstrates unusual strength.",
            "Toby's instincts warn him that something is amiss with the mysterious woman.",
            "Toby ignores his instincts about the mysterious woman due to his intoxication.",
            "The mysterious woman easily unlocks Toby's door.",
            "Toby invites the mysterious woman into his house.",
            "In the bedroom, the mysterious woman overpowers Toby and pins him to the bed.",
            "The mysterious woman reveals a grotesquely large mouth filled with numerous human teeth.",
            "The mysterious woman reminds Toby that he owes her for a gift she gave him at the club.",
            "The mysterious woman implies a connection to Toby's childhood.",
            "Toby tries to fight back against the mysterious woman.",
            "The mysterious woman forces Toby's mouth open, dislocating his jaw.",
            "The mysterious woman reaches inside Toby's mouth to grab a tooth.",
            "The fate of Toby after the mysterious woman grabs his tooth is left uncertain."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473jz0uy6": {
        "label": 1,
        "difficulty": "",
        "story": "Toby could not believe his luck. He had never achieved much success with women. As he had been often told, he lacked charm, looks or even that oft used fallback of a winning personality. Here she was however, dancing up against him. So close he could smell her perfume, he didn't recognise it but something in it drove him wild. The woman's slim frame and short dress certainly helped that too. She'd walked up to him, whispered in his ear in a voice like the sweetest honey that she liked his smile. That he had nice teeth. \n\nNothing else but inappropriate looks had been exchanged between them since then. She never opened her mouth. She hadn't spoken since they met and only appeared to breathe through her nose. On top of that her cheeks and lips seemed to bulge out slightly, like she was holding her breath. Then she pulled her top down a little further and those little details were lost to the back of his one track mind. \n\nToby took one last swig of the drink she had given him before hurling the bottle into the crowd behind him. In a voice far more slurred than confident he shouted over the din of the music \"So uh do you wanna get out of this dump? Your place or...\". The woman cut him off with a finger to his lips and a coy smile. \"My place then?\" he stammered, not having expected that to work. She nodded, took his hand and leads him out of the nightclub into the cool air. \n\nAs soon as they turned the corner from the nightclub, Toby seized the tiny blonde's shoulder and pushed her up against the wall. \"So how about a kiss?\" he slurred, leaning his face into hers. In response the woman placed one finger on his chest and pushed him back with ease. Then there was that coy smile again, lips never parting, before she took his hand and leads him on towards his house. That small part of his brain screamed out again. It tried warning the rest of him that a woman that small could not be that strong. That she was leading him straight to his house. Toby had never been the smartest man though and awash in alcohol the rest of his brain ignored the warning.   \n\nBefore he knew it he was at his door, the woman hanging off his arm softly giggled as he fiddled with his keys. His numb fingers dropped them, cursing he went to pick them up. Before he could the woman reached down, daintily gathered them up and walked past him to the door. Within a mere moment the door clicked and swung open. Toby stumbled past the woman into the hallway. He turned to see her stood right on the threshold, a forlorn look on her face. Irritated he blurted out \"well come on in then you dozy mare!\" Despite the unpleasant tone, she smiled at this, eyes agleam and stepped through the threshold. She pointed for Toby to head upstairs before turning and locking the door. Once she had snapped the key off in the lock, she followed Toby upstairs into the gloom. \n\nToby struggled furiously to get his trousers off. All he had managed however, was to get them tangled around his ankles. Before he could free himself, a short sharp shove sent him sprawling onto the bed. He scrambled onto his back in time to see the blonde climb onto the bed with him. She straddled his chest, placed a hand on each of his shoulders and pinned him to the bed. The crushing pain her hands were causing was immediately blocked out by her smile. She flashed him a toothy grin.\n\nEven in his drunken state Toby was sure humans didn't have that many teeth.\n\nThe woman's smile grew at the look of horror on his face. Her mouth opened wide. Then wider still. Even in the gloom Toby could see them now. Pearly white teeth filled her grotesquely large mouth. No tongue could be seen. Just teeth, human teeth. \n\n\"I gave you a gift at the club, you know how this works\" she said in her voice like honey \"for that you owe me.\" Toby tried to cry out, but a vice like hand clamped his mouth shut. He slammed his fist into her side. All he received for his efforts was a soft giggle. \"Yes this isn't how it worked when you were a child,\" she purred, \"but I always remembered you had such pretty teeth.\"\n\nWith that she leaned forwards, forced her hands into his mouth and pried it wide open. Toby felt an agonising pop as his jaw dislocated. The last thing he remembered was that horrifying woman's hand reaching inside his mouth and grabbing a tooth...",
        "summary": [
            "Toby, a man who lacks success with women, meets a mysterious woman at a nightclub.",
            "She leads him to his house, where she turns out to be a supernatural creature with a large mouth filled with human teeth.",
            "She claims that Toby owes her a debt, and proceeds to forcefully extract one of his teeth."
        ],
        "errors": [
            1,
            1,
            1
        ],
        "story-id": 25,
        "explanations": [],
        "claims": [
            "Toby is a man who lacks success with women.",
            "Toby meets a mysterious woman at a nightclub.",
            "The mysterious woman leads Toby to his house.",
            "Upon arrival at Toby's house, the mysterious woman reveals herself to be a supernatural creature.",
            "The supernatural creature has a large mouth filled with human teeth.",
            "The supernatural creature claims that Toby owes her a debt.",
            "The supernatural creature forcefully extracts one of Toby's teeth."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049kjpf0z": {
        "label": 0,
        "difficulty": "hard",
        "story": "Once upon a time there was a dog. The dogs name was Rover, and the story is over. \n\nBe glad that is not our story, for you see, our story also starts with a dog. A little dog and a little girl.\n\nEver since he could remember he was on the streets. He didn't remember much from his puppy years- only faint impressions of family and warmth remained in the deepest recesses of his memory. Cold winds and frigid rain devoured everything in their path- but he was safe... in a ramshackle cardboard box. \n\nHe was safe in his little corner of alley, ignored by the hurried people with sharp voices and pounding footsteps. He didn't like people. Not those people anyway. When all he could see were their dangerous shoes and loping limbs, ignorant of an entire world of street dogs and cats that are eating street rats. \n\nThey rushed away from the rain, business suits, raggedy coats and anything in between, empty streets they said- blind to life in between. In between meals, homes and danger, the only things as constant to him as his tail, the promise of a meal with the little girl and his name. \n\n\"See you tomorrow!\" Echoes in his ears again. He had just gotten a good meal, a soft pet and lots of love. The girl- a title which he thinks with all the adoration possible, because she's The Girl. The only human he thinks of as something other that 'giant', a generic title that stuck. The small dog scarcely remembers a time when he didn't come to The Girl everyday, didn't have a guaranteed meal and companionship for some time. \n\nShe was always so nice, he tried to show her as much love as he could in return. Her soft voice was a melody in a world of screeches and anger. The only time he had ever heard her stern was when he nudged a cylinder of metal next of her- or the weird tubes that connected it to her face. She had gasped- shoving him away in her panic. But more than that, she was scared- and hurt, when he did that. He never did it again.\n\nSnapping back to reality on a gloomy day- a tad warmer than yesterday, he finished scarfing down his meal. A blend of something that tasted amazing and The Girl had gotten just for him. She looked back at him smiling softly. A voice called from her house. \n\n\"I'll see you tomorrow.\" The way she said tomorrow- said it everyday was inflicted with so much emotion that even normal human hearing would be able to sense the difference. The terrier may not notice the small contortions of her expression of even emotions in her eyes, but what he did notice, sharper than any human- and more insightful was his own language. The slight tensing of muscles to form a 'fist' (Aggression? Determination?); A slight tilt of the head towards the tank; and a hopeful inflection on her tone. Naturally, he assumed she would say nothing else but his name with such emotion. \n\nThe small terrier knew, like the sky is blue, that his name was Tomorrow. To him that was that. His little world summed up by noisy streets and summer heat, by little girls and cats that made him hurl, that even in the scary snow, devoid the chirp of a sparrow, his name was Tomorrow.\n\nThere was a routine never broken. Bent in places, a little dented, but whole and unbroken. Until today. The little girl wasn't there. He always found her, always knew her, she had a distinct smell- that made some of his instincts think she was weak, but the rest to comfort her. But she, along with her strange tubes and tanks and half-smiles was gone. The last thing he remembered seeing yesterday, while he was halfway across the street, was a blaring alarm and a screeching van,(red? white?). \n\nShe had said she'd see him. See Tomorrow. See him Tomorrow. He waited for hours. Sitting. Waiting. \n\nA car pulled up. He jumped up, tail wagging, ready to greet her. Two giants came out- the ones who sometimes called for her and watched her, one in tears and one shell shocked. Two giants, but no little Girl.\n\nA ramshackle cardboard box. That was where he sat. Despite the icy, frigid rain- the harsh unforgiving footsteps of the people, Tomorrow curled protectively around his memories of The Girl, her half hazy forgotten face, and the way she said his name. Determined to meet him. Determined to meet Tomorrow. Cold whispers brushed past him; Tomorrow felt warm.",
        "summary": [
            "The story introduces us to a small street dog fondly named Tomorrow, whose memories reveal a difficult life of cramped cardboard shelters and the haunting loneliness of alleyways.",
            "He has an aversion to uncaring humans who overlook the struggles of the street animals, with the only exception being a gentle and caring girl, The Girl.",
            "The Girl provides Tomorrow with consistent meals, shows tender affection, and promises to see him each day.",
            "This daily routine forms a bond between the two, and Tomorrow returns her kindness with unwavering loyalty and love.",
            "Tragedy hits when The Girl suddenly disappears, leaving Tomorrow alone and desolate in his cardboard shelter.",
            "Despite the icy weather and his uncertain future, the dog finds warmth in the memories of his beloved friend and the fervor of her promises to see him, to see Tomorrow."
        ],
        "errors": [
            0,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 26,
        "explanations": [
            "The dog is not actually named Tomorrow."
        ],
        "claims": [
            "The story features a small street dog named Tomorrow.",
            "Tomorrow has memories of living in cramped cardboard shelters.",
            "Tomorrow has experienced the loneliness of alleyways.",
            "Tomorrow has an aversion to uncaring humans who overlook the struggles of street animals.",
            "There is an exception to Tomorrow's aversion, which is a gentle and caring girl referred to as The Girl.",
            "The Girl provides Tomorrow with consistent meals.",
            "The Girl shows tender affection towards Tomorrow.",
            "The Girl promises to see Tomorrow each day.",
            "A daily routine of interaction forms a bond between Tomorrow and The Girl.",
            "Tomorrow returns The Girl's kindness with unwavering loyalty and love.",
            "The Girl suddenly disappears, leaving Tomorrow alone.",
            "After The Girl's disappearance, Tomorrow is left in his cardboard shelter.",
            "The weather is described as icy following The Girl's disappearance.",
            "Tomorrow's future is uncertain after The Girl disappears.",
            "Tomorrow finds warmth in the memories of his beloved friend, The Girl.",
            "Tomorrow cherishes the fervor of The Girl's promises to see him."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479kjpf0z": {
        "label": 0,
        "difficulty": "hard",
        "story": "Once upon a time there was a dog. The dogs name was Rover, and the story is over. \n\nBe glad that is not our story, for you see, our story also starts with a dog. A little dog and a little girl.\n\nEver since he could remember he was on the streets. He didn't remember much from his puppy years- only faint impressions of family and warmth remained in the deepest recesses of his memory. Cold winds and frigid rain devoured everything in their path- but he was safe... in a ramshackle cardboard box. \n\nHe was safe in his little corner of alley, ignored by the hurried people with sharp voices and pounding footsteps. He didn't like people. Not those people anyway. When all he could see were their dangerous shoes and loping limbs, ignorant of an entire world of street dogs and cats that are eating street rats. \n\nThey rushed away from the rain, business suits, raggedy coats and anything in between, empty streets they said- blind to life in between. In between meals, homes and danger, the only things as constant to him as his tail, the promise of a meal with the little girl and his name. \n\n\"See you tomorrow!\" Echoes in his ears again. He had just gotten a good meal, a soft pet and lots of love. The girl- a title which he thinks with all the adoration possible, because she's The Girl. The only human he thinks of as something other that 'giant', a generic title that stuck. The small dog scarcely remembers a time when he didn't come to The Girl everyday, didn't have a guaranteed meal and companionship for some time. \n\nShe was always so nice, he tried to show her as much love as he could in return. Her soft voice was a melody in a world of screeches and anger. The only time he had ever heard her stern was when he nudged a cylinder of metal next of her- or the weird tubes that connected it to her face. She had gasped- shoving him away in her panic. But more than that, she was scared- and hurt, when he did that. He never did it again.\n\nSnapping back to reality on a gloomy day- a tad warmer than yesterday, he finished scarfing down his meal. A blend of something that tasted amazing and The Girl had gotten just for him. She looked back at him smiling softly. A voice called from her house. \n\n\"I'll see you tomorrow.\" The way she said tomorrow- said it everyday was inflicted with so much emotion that even normal human hearing would be able to sense the difference. The terrier may not notice the small contortions of her expression of even emotions in her eyes, but what he did notice, sharper than any human- and more insightful was his own language. The slight tensing of muscles to form a 'fist' (Aggression? Determination?); A slight tilt of the head towards the tank; and a hopeful inflection on her tone. Naturally, he assumed she would say nothing else but his name with such emotion. \n\nThe small terrier knew, like the sky is blue, that his name was Tomorrow. To him that was that. His little world summed up by noisy streets and summer heat, by little girls and cats that made him hurl, that even in the scary snow, devoid the chirp of a sparrow, his name was Tomorrow.\n\nThere was a routine never broken. Bent in places, a little dented, but whole and unbroken. Until today. The little girl wasn't there. He always found her, always knew her, she had a distinct smell- that made some of his instincts think she was weak, but the rest to comfort her. But she, along with her strange tubes and tanks and half-smiles was gone. The last thing he remembered seeing yesterday, while he was halfway across the street, was a blaring alarm and a screeching van,(red? white?). \n\nShe had said she'd see him. See Tomorrow. See him Tomorrow. He waited for hours. Sitting. Waiting. \n\nA car pulled up. He jumped up, tail wagging, ready to greet her. Two giants came out- the ones who sometimes called for her and watched her, one in tears and one shell shocked. Two giants, but no little Girl.\n\nA ramshackle cardboard box. That was where he sat. Despite the icy, frigid rain- the harsh unforgiving footsteps of the people, Tomorrow curled protectively around his memories of The Girl, her half hazy forgotten face, and the way she said his name. Determined to meet him. Determined to meet Tomorrow. Cold whispers brushed past him; Tomorrow felt warm.",
        "summary": [
            "In this poignant story, a small terrier named Tomorrow has been living on the streets for as long as he can remember.",
            "His only solace is a little girl who visits him every day, providing him with food, love, and companionship.",
            "The girl, who remains unnamed, is connected to strange tubes and tanks, hinting at an underlying health condition.",
            "The story follows their routine and the bond they share, with the girl always promising to see Tomorrow the next day.",
            "However, one day, the routine is broken when the girl doesn't show up.",
            "Tomorrow recalls a blaring alarm and a screeching van from the previous day, suggesting that something might have happened to the girl.",
            "As Tomorrow waits for hours, two of the girl's guardians arrive, one in tears and the other shell-shocked, but the girl is nowhere to be seen.",
            "Despite the harsh weather and the unforgiving world around him, Tomorrow finds comfort and warmth in his memories of the girl and the way she said his name, forever determined to meet him, to meet Tomorrow."
        ],
        "errors": [
            0,
            0,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 26,
        "explanations": [
            "The dog is not actually named Tomorrow.",
            "The girl does not visit him, he visits her."
        ],
        "claims": [
            "A small terrier named Tomorrow has been living on the streets for as long as he can remember.",
            "A little girl visits Tomorrow every day.",
            "The little girl provides Tomorrow with food, love, and companionship.",
            "The little girl is connected to strange tubes and tanks.",
            "The little girl's connection to strange tubes and tanks hints at an underlying health condition.",
            "The story follows the routine and bond shared between Tomorrow and the little girl.",
            "The little girl always promises to see Tomorrow the next day.",
            "One day, the little girl does not show up to see Tomorrow.",
            "Tomorrow recalls a blaring alarm and a screeching van from the previous day.",
            "The recollection of a blaring alarm and a screeching van suggests that something might have happened to the little girl.",
            "Two of the little girl's guardians arrive where Tomorrow is waiting, one in tears and the other shell-shocked.",
            "The little girl is not seen with her guardians when they arrive.",
            "Despite harsh weather and an unforgiving world, Tomorrow finds comfort and warmth in his memories of the little girl.",
            "Tomorrow remembers the way the little girl said his name.",
            "Tomorrow is determined to meet the little girl again."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473kjpf0z": {
        "label": 0,
        "difficulty": "easy",
        "story": "Once upon a time there was a dog. The dogs name was Rover, and the story is over. \n\nBe glad that is not our story, for you see, our story also starts with a dog. A little dog and a little girl.\n\nEver since he could remember he was on the streets. He didn't remember much from his puppy years- only faint impressions of family and warmth remained in the deepest recesses of his memory. Cold winds and frigid rain devoured everything in their path- but he was safe... in a ramshackle cardboard box. \n\nHe was safe in his little corner of alley, ignored by the hurried people with sharp voices and pounding footsteps. He didn't like people. Not those people anyway. When all he could see were their dangerous shoes and loping limbs, ignorant of an entire world of street dogs and cats that are eating street rats. \n\nThey rushed away from the rain, business suits, raggedy coats and anything in between, empty streets they said- blind to life in between. In between meals, homes and danger, the only things as constant to him as his tail, the promise of a meal with the little girl and his name. \n\n\"See you tomorrow!\" Echoes in his ears again. He had just gotten a good meal, a soft pet and lots of love. The girl- a title which he thinks with all the adoration possible, because she's The Girl. The only human he thinks of as something other that 'giant', a generic title that stuck. The small dog scarcely remembers a time when he didn't come to The Girl everyday, didn't have a guaranteed meal and companionship for some time. \n\nShe was always so nice, he tried to show her as much love as he could in return. Her soft voice was a melody in a world of screeches and anger. The only time he had ever heard her stern was when he nudged a cylinder of metal next of her- or the weird tubes that connected it to her face. She had gasped- shoving him away in her panic. But more than that, she was scared- and hurt, when he did that. He never did it again.\n\nSnapping back to reality on a gloomy day- a tad warmer than yesterday, he finished scarfing down his meal. A blend of something that tasted amazing and The Girl had gotten just for him. She looked back at him smiling softly. A voice called from her house. \n\n\"I'll see you tomorrow.\" The way she said tomorrow- said it everyday was inflicted with so much emotion that even normal human hearing would be able to sense the difference. The terrier may not notice the small contortions of her expression of even emotions in her eyes, but what he did notice, sharper than any human- and more insightful was his own language. The slight tensing of muscles to form a 'fist' (Aggression? Determination?); A slight tilt of the head towards the tank; and a hopeful inflection on her tone. Naturally, he assumed she would say nothing else but his name with such emotion. \n\nThe small terrier knew, like the sky is blue, that his name was Tomorrow. To him that was that. His little world summed up by noisy streets and summer heat, by little girls and cats that made him hurl, that even in the scary snow, devoid the chirp of a sparrow, his name was Tomorrow.\n\nThere was a routine never broken. Bent in places, a little dented, but whole and unbroken. Until today. The little girl wasn't there. He always found her, always knew her, she had a distinct smell- that made some of his instincts think she was weak, but the rest to comfort her. But she, along with her strange tubes and tanks and half-smiles was gone. The last thing he remembered seeing yesterday, while he was halfway across the street, was a blaring alarm and a screeching van,(red? white?). \n\nShe had said she'd see him. See Tomorrow. See him Tomorrow. He waited for hours. Sitting. Waiting. \n\nA car pulled up. He jumped up, tail wagging, ready to greet her. Two giants came out- the ones who sometimes called for her and watched her, one in tears and one shell shocked. Two giants, but no little Girl.\n\nA ramshackle cardboard box. That was where he sat. Despite the icy, frigid rain- the harsh unforgiving footsteps of the people, Tomorrow curled protectively around his memories of The Girl, her half hazy forgotten face, and the way she said his name. Determined to meet him. Determined to meet Tomorrow. Cold whispers brushed past him; Tomorrow felt warm.",
        "summary": [
            "This is a story about a stray dog named Tomorrow who lives on the streets and has a special bond with a little girl who feeds him.",
            "But one day, the girl doesn't show up and he learns that she has been taken to the hospital.",
            "Despite harsh conditions, Tomorrow waits for her, determined to see her again."
        ],
        "errors": [
            0,
            0,
            1
        ],
        "story-id": 26,
        "explanations": [
            "The dog is not actually named Tomorrow.",
            "He doesn't learn she has been taken to the hospital but the reader can infer that."
        ],
        "claims": [
            "1. The story features a stray dog named Tomorrow. \n2. Tomorrow lives on the streets. \n3. Tomorrow has a special bond with a little girl. \n4. The little girl feeds Tomorrow. \n5. One day, the little girl does not show up to feed Tomorrow. \n6. Tomorrow learns that the little girl has been taken to the hospital. \n7. Tomorrow waits for the little girl despite harsh conditions. \n8. Tomorrow is determined to see the little girl again."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049o5b58g": {
        "label": 0,
        "difficulty": "easy",
        "story": "The myth of Dragons have been greatly misrepresented over the years. The first falsehood being that they were in fact a myth, the second being that they were large and terrifying reptiles set on destroying mankind.\n\nA dragon's size was directly proportionate to the size of it's gold hoard, but no dragon has ever gotten more than one or two coins. There are rumors that Mr. Chinue at the top of the hill has a large dragon, protecting his large pile of gold, but personally I just think they're rumors. Shop keepers especially, are good about keeping the dragon coins away from the non-dragon coins.\n\nThat was another falsehood, Dragons don't care who owns the coin, as long as they travel with it. Most people when they go shopping, take their little coin purse complete with a dragon. The tricky part is making sure to trade the entirety of the Dragon's hoard, as not to upset the dragon. Some people have to pay for a tiny loaf of bread with a whole gold coin just to keep the dragon happy. You can't split it up, which is why most dragons only have small hoards.\n\nIt really is a pain when you're looking to buy and the shop keeper doesn't have a dragon hoard the correct size to give you proper change. Sometimes you get lucky and get a little more back, but more often than not you get shorted change. This is just an expectation now when you go shopping.\n\nTaking a dragon from it's hoard can be dangerous, it's not going to burn down a village but you might lose a finger, and the dragon will ALWAYS find it's way back to its hoard.\n\nWhich is actually my current problem right now. See, I just learned all of this about dragons today. Like 5 minutes ago in fact. Dragons aren't common in the western province where I am from, but here in the eastern province? They're everywhere!\n\nSo when I spent my gold coin earlier, I got 3 silver coins and a tiny dragon back in change. Then when I saw a jacket, I spent 2 of my silver coins. Unfortunately unaware of the consequences that would follow this action.\n\nYou see, my dragon was sleeping when I had spent his coins. It wasn't until later, when I was on my way back to the Western province, that I heard the high pitched wail from inside my coin purse.\n\nConfused by the sound of distress, I peaked in and immediately got a tiny green dragon attached to my nose.\n\nWith a startled yelp, I swiped at my face sending the dragon tumbling towards the ground. With a high pitched battle cry, the small reptile flung itself back at me and attached itself to my shoulder.\n\nOne second it was fine, sure it's claws dug a little deep into my brand new coat, but it had seemed to calm down. The next second a high pitched cry was released from it's mouth, directly into my ear.\n\nThis cry went on for 10 minutes before I tried to bribe the creature.\n\n\"Here dragon,\" I tsk'd lightly, holding up a gold coin. \"I'm sorry I gave away your silver coins but you can have this one!\"\n\nThe high pitched squeal didn't stop.\n\nEventually on the road I met a couple travelers who were all too happy to trade me 3 silver coins for my gold coin. A complete rip off if you asked me, but I was desperate.\n\nHolding the coins out to the dragon as a peace offering, the cry stopped for a moment. The dragon sniffed the coins, turned his nose up at them and went back to his crying.\n\nBy the time evening had fallen and I had set up camp, the cry had become ingrained in my head as the most irritating noise ever, and my new jacket was completely destroyed on the right shoulder.\n\nPulling the jacket over my head, I finally fell asleep with the screaming still continuing.\n\n-_-_-_-\n\nWaking up the next morning was peaceful... and surprising. The desperate cries of the dragon had finally stopped and I could finally think again.\n\nLooking around, I couldn't see the dragon anywhere. Everything else was the same, I still had all my possessions, I still had a hole in my new jacket. I was just down a dragon.\n\nGood riddance. I thought as I gathered up my stuff.\n\nFinally picking up my coin purse, I was surprised by the odd lump that occupied it.\n\nSlowly peaking in, I could see a slightly larger dragon sleeping away on what looked like 15 new silver coins!\n\nSlowly closing the bag, I wondered to myself... what would happen if I did it again?",
        "summary": [
            "The story is about the narrator's interactions with a miniature dragon in a world where dragons are common and tied to one's wealth.",
            "The narrator reveals that dragons' sizes are directly proportionate to one's gold hoard.",
            "People are careful not upset their coins/dragons, ensuring to trade the entirety of the dragon's hoard as they shop.",
            "The narrator, unaware of these rules, spends part of his dragon's hoard and ends up with an upset dragon.",
            "While trying to please his dragon with different offerings, the narrator learns that splitting the hoard angers the dragon.",
            "Eventually, after trading one of his gold coins for 15 silver ones, he wakes to find his previously tiny dragon grown bigger, sleeping on his new hoard of silver coins, and he wonders about how to deal with his growing dragon problem."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            0,
            1
        ],
        "story-id": 27,
        "explanations": [
            "He trades his gold coin for 3 silver ones."
        ],
        "claims": [
            "The story is set in a world where dragons are common.",
            "In this world, dragons are tied to one's wealth.",
            "The narrator reveals that the size of dragons is directly proportionate to the size of one's gold hoard.",
            "People in this world ensure to trade the entirety of their dragon's hoard when shopping to avoid upsetting their dragons.",
            "The narrator, unaware of the rules regarding dragons and their hoards, spends only part of his dragon's hoard.",
            "As a result of spending only part of the hoard, the narrator ends up with an upset dragon.",
            "The narrator attempts to please his dragon with different offerings after realizing it is upset.",
            "The narrator learns that splitting the dragon's hoard angers the dragon.",
            "After trading one of his gold coins for 15 silver ones, the narrator finds his dragon has grown bigger.",
            "The dragon grows bigger after sleeping on the new hoard of silver coins.",
            "The narrator wonders how to deal with his growing dragon problem."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479o5b58g": {
        "label": 1,
        "difficulty": "",
        "story": "The myth of Dragons have been greatly misrepresented over the years. The first falsehood being that they were in fact a myth, the second being that they were large and terrifying reptiles set on destroying mankind.\n\nA dragon's size was directly proportionate to the size of it's gold hoard, but no dragon has ever gotten more than one or two coins. There are rumors that Mr. Chinue at the top of the hill has a large dragon, protecting his large pile of gold, but personally I just think they're rumors. Shop keepers especially, are good about keeping the dragon coins away from the non-dragon coins.\n\nThat was another falsehood, Dragons don't care who owns the coin, as long as they travel with it. Most people when they go shopping, take their little coin purse complete with a dragon. The tricky part is making sure to trade the entirety of the Dragon's hoard, as not to upset the dragon. Some people have to pay for a tiny loaf of bread with a whole gold coin just to keep the dragon happy. You can't split it up, which is why most dragons only have small hoards.\n\nIt really is a pain when you're looking to buy and the shop keeper doesn't have a dragon hoard the correct size to give you proper change. Sometimes you get lucky and get a little more back, but more often than not you get shorted change. This is just an expectation now when you go shopping.\n\nTaking a dragon from it's hoard can be dangerous, it's not going to burn down a village but you might lose a finger, and the dragon will ALWAYS find it's way back to its hoard.\n\nWhich is actually my current problem right now. See, I just learned all of this about dragons today. Like 5 minutes ago in fact. Dragons aren't common in the western province where I am from, but here in the eastern province? They're everywhere!\n\nSo when I spent my gold coin earlier, I got 3 silver coins and a tiny dragon back in change. Then when I saw a jacket, I spent 2 of my silver coins. Unfortunately unaware of the consequences that would follow this action.\n\nYou see, my dragon was sleeping when I had spent his coins. It wasn't until later, when I was on my way back to the Western province, that I heard the high pitched wail from inside my coin purse.\n\nConfused by the sound of distress, I peaked in and immediately got a tiny green dragon attached to my nose.\n\nWith a startled yelp, I swiped at my face sending the dragon tumbling towards the ground. With a high pitched battle cry, the small reptile flung itself back at me and attached itself to my shoulder.\n\nOne second it was fine, sure it's claws dug a little deep into my brand new coat, but it had seemed to calm down. The next second a high pitched cry was released from it's mouth, directly into my ear.\n\nThis cry went on for 10 minutes before I tried to bribe the creature.\n\n\"Here dragon,\" I tsk'd lightly, holding up a gold coin. \"I'm sorry I gave away your silver coins but you can have this one!\"\n\nThe high pitched squeal didn't stop.\n\nEventually on the road I met a couple travelers who were all too happy to trade me 3 silver coins for my gold coin. A complete rip off if you asked me, but I was desperate.\n\nHolding the coins out to the dragon as a peace offering, the cry stopped for a moment. The dragon sniffed the coins, turned his nose up at them and went back to his crying.\n\nBy the time evening had fallen and I had set up camp, the cry had become ingrained in my head as the most irritating noise ever, and my new jacket was completely destroyed on the right shoulder.\n\nPulling the jacket over my head, I finally fell asleep with the screaming still continuing.\n\n-_-_-_-\n\nWaking up the next morning was peaceful... and surprising. The desperate cries of the dragon had finally stopped and I could finally think again.\n\nLooking around, I couldn't see the dragon anywhere. Everything else was the same, I still had all my possessions, I still had a hole in my new jacket. I was just down a dragon.\n\nGood riddance. I thought as I gathered up my stuff.\n\nFinally picking up my coin purse, I was surprised by the odd lump that occupied it.\n\nSlowly peaking in, I could see a slightly larger dragon sleeping away on what looked like 15 new silver coins!\n\nSlowly closing the bag, I wondered to myself... what would happen if I did it again?",
        "summary": [
            "The story is a humorous tale about a person who discovers the truth about dragons in a world where they are real but misunderstood.",
            "In this world, dragons are small creatures that are attached to their hoards of gold and silver coins.",
            "The size of a dragon is directly proportional to the size of its hoard, but most dragons only have a few coins.",
            "The protagonist, who is from the Western province where dragons are uncommon, visits the Eastern province where dragons are everywhere.",
            "They unknowingly spend some of their dragon's silver coins, causing the dragon to become distressed and cry loudly.",
            "The protagonist tries to appease the dragon by offering it a gold coin, but the dragon refuses.",
            "Eventually, the protagonist trades their gold coin for three silver coins with some travelers, but the dragon still doesn't accept them.",
            "The dragon's cries continue throughout the night, and the protagonist's new jacket is ruined.",
            "The next morning, the protagonist wakes up to find the dragon gone, but their coin purse now contains a slightly larger dragon sleeping on 15 new silver coins.",
            "The protagonist wonders what would happen if they repeated the process, hinting at the possibility of growing their dragon's hoard and size."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 27,
        "explanations": [],
        "claims": [
            "The story is set in a world where dragons are real.",
            "Dragons in the story are small creatures.",
            "Dragons are attached to their hoards of gold and silver coins.",
            "The size of a dragon is directly proportional to the size of its hoard.",
            "Most dragons in the story only have a few coins.",
            "The protagonist is from the Western province where dragons are uncommon.",
            "The protagonist visits the Eastern province where dragons are common.",
            "The protagonist spends some of their dragon's silver coins unknowingly.",
            "The spending of the silver coins causes the protagonist's dragon to become distressed.",
            "The distressed dragon cries loudly.",
            "The protagonist attempts to appease the dragon by offering it a gold coin.",
            "The dragon refuses the gold coin offered by the protagonist.",
            "The protagonist trades a gold coin for three silver coins with some travelers.",
            "The dragon does not accept the three silver coins traded by the protagonist.",
            "The dragon's cries continue throughout the night.",
            "The protagonist's new jacket is ruined by the end of the night.",
            "The protagonist wakes up to find the dragon gone the next morning.",
            "The protagonist finds a slightly larger dragon sleeping on 15 new silver coins in their coin purse.",
            "The protagonist contemplates the possibility of growing their dragon's hoard and size by repeating the process."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473o5b58g": {
        "label": 0,
        "difficulty": "hard",
        "story": "The myth of Dragons have been greatly misrepresented over the years. The first falsehood being that they were in fact a myth, the second being that they were large and terrifying reptiles set on destroying mankind.\n\nA dragon's size was directly proportionate to the size of it's gold hoard, but no dragon has ever gotten more than one or two coins. There are rumors that Mr. Chinue at the top of the hill has a large dragon, protecting his large pile of gold, but personally I just think they're rumors. Shop keepers especially, are good about keeping the dragon coins away from the non-dragon coins.\n\nThat was another falsehood, Dragons don't care who owns the coin, as long as they travel with it. Most people when they go shopping, take their little coin purse complete with a dragon. The tricky part is making sure to trade the entirety of the Dragon's hoard, as not to upset the dragon. Some people have to pay for a tiny loaf of bread with a whole gold coin just to keep the dragon happy. You can't split it up, which is why most dragons only have small hoards.\n\nIt really is a pain when you're looking to buy and the shop keeper doesn't have a dragon hoard the correct size to give you proper change. Sometimes you get lucky and get a little more back, but more often than not you get shorted change. This is just an expectation now when you go shopping.\n\nTaking a dragon from it's hoard can be dangerous, it's not going to burn down a village but you might lose a finger, and the dragon will ALWAYS find it's way back to its hoard.\n\nWhich is actually my current problem right now. See, I just learned all of this about dragons today. Like 5 minutes ago in fact. Dragons aren't common in the western province where I am from, but here in the eastern province? They're everywhere!\n\nSo when I spent my gold coin earlier, I got 3 silver coins and a tiny dragon back in change. Then when I saw a jacket, I spent 2 of my silver coins. Unfortunately unaware of the consequences that would follow this action.\n\nYou see, my dragon was sleeping when I had spent his coins. It wasn't until later, when I was on my way back to the Western province, that I heard the high pitched wail from inside my coin purse.\n\nConfused by the sound of distress, I peaked in and immediately got a tiny green dragon attached to my nose.\n\nWith a startled yelp, I swiped at my face sending the dragon tumbling towards the ground. With a high pitched battle cry, the small reptile flung itself back at me and attached itself to my shoulder.\n\nOne second it was fine, sure it's claws dug a little deep into my brand new coat, but it had seemed to calm down. The next second a high pitched cry was released from it's mouth, directly into my ear.\n\nThis cry went on for 10 minutes before I tried to bribe the creature.\n\n\"Here dragon,\" I tsk'd lightly, holding up a gold coin. \"I'm sorry I gave away your silver coins but you can have this one!\"\n\nThe high pitched squeal didn't stop.\n\nEventually on the road I met a couple travelers who were all too happy to trade me 3 silver coins for my gold coin. A complete rip off if you asked me, but I was desperate.\n\nHolding the coins out to the dragon as a peace offering, the cry stopped for a moment. The dragon sniffed the coins, turned his nose up at them and went back to his crying.\n\nBy the time evening had fallen and I had set up camp, the cry had become ingrained in my head as the most irritating noise ever, and my new jacket was completely destroyed on the right shoulder.\n\nPulling the jacket over my head, I finally fell asleep with the screaming still continuing.\n\n-_-_-_-\n\nWaking up the next morning was peaceful... and surprising. The desperate cries of the dragon had finally stopped and I could finally think again.\n\nLooking around, I couldn't see the dragon anywhere. Everything else was the same, I still had all my possessions, I still had a hole in my new jacket. I was just down a dragon.\n\nGood riddance. I thought as I gathered up my stuff.\n\nFinally picking up my coin purse, I was surprised by the odd lump that occupied it.\n\nSlowly peaking in, I could see a slightly larger dragon sleeping away on what looked like 15 new silver coins!\n\nSlowly closing the bag, I wondered to myself... what would happen if I did it again?",
        "summary": [
            "The story is about a person who learns the truth about dragons and how they are not large and terrifying creatures, but instead are small and only possess a small hoard of coins.",
            "The protagonist accidentally spends their dragon's coins and struggles to appease the angry dragon, but eventually ends up with a larger dragon and a hoard of coins as a result."
        ],
        "errors": [
            1,
            0
        ],
        "story-id": 27,
        "explanations": [
            "He doesn't accidentally spend the coins. He spends them on purpose but doesn't realize it will upset the dragon."
        ],
        "claims": [
            "1. The story features a protagonist who learns the truth about dragons.",
            "2. Dragons are not large and terrifying creatures as commonly believed.",
            "3. Dragons are actually small in size.",
            "4. Dragons possess only a small hoard of coins.",
            "5. The protagonist accidentally spends their dragon's coins.",
            "6. The protagonist struggles to appease the dragon after spending its coins.",
            "7. The protagonist ends up with a larger dragon by the end of the story.",
            "8. The protagonist acquires a hoard of coins by the end of the story."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049we8usc": {
        "label": 0,
        "difficulty": "hard",
        "story": "They had all come to the big party. Sorrow wore black, of course, with a sophisticated little lace veil. Luck could hardly be seen, her golden sequined dress sparkled and flashed in the spotlight so much that it hurt the eyes. Worries were serious again, typical, mouse-gray suits, even the ties weren't very creative, but of first, expensive quality. Joy was wrapped in yellow and had a huge sunflower pinned to her dress. Quite vulgar for Trouble's taste, but Trouble was just a little pinched, you could tell just by looking at his dark green suit. \"Green, please, only losers wear that,\" Malice whispered to her neighbor, Envy.\n\nOnce again, the two couldn't separate. All evening, they huddled together in one corner, trashing the others. \"Look at Love\", Envy hissed to Malice. \"Where the hell did she find that dress? Squeaky pink and these flounces. Sinfully expensive designer, of course, and she can't even afford it.\" \"She looks like a cake\", Malice returned, \"Fat buttercream.\"\n\nAs Sex entered the brightly lit hall, a murmur went through the crowd. His skin-tight snakeskin suit exposed his beautifully sculpted body more than it concealed it. Eroticism took a large sip of champagne at the sight of him and drew attention with her throaty laugh. Her discreet evening dress shimmered in a velvety red.\n\nIllness had retreated to a quiet table in the corner. Her white dress competed with her noble pallor, and she toasted Death with a glass of chamomile tea. As usual, Death had settled stealthily behind a pillar and pulled his black hat down over his face that most didn't even recognize him.\n\nHonor, as pretty much at every party, was walking around smoking cigarettes. \"Embarrassing,\" thought Pride, wiping the sweat from his forehead. \"Come on\", said Kindness, \"Poor Honor can't afford cigarettes after all,\" and surreptitiously slipped her a packet. Fame was almost drunk. He stood in the corner and bawled, encouraged by big Money, who stood next to him and pretty much fogged him with his Havana.\n\nPower, of course, had shown up with his entire court. Fear was constantly scurrying around them, and Diligence was fetching drinks.\n\nWork was busy as always. She constantly had to add the cold plates on the buffet, and somehow the spoons seemed to have run out. Then the host stepped to the microphone. He was dressed very colorfully and looked a bit like a harlequin. \"Oh God, now he's giving a speech too, and he can't even speak,\" Malice whispered to her best friend.\n\n\"Dear friends, dear partners\", Life began a little hesitantly, \"I'm glad you all came to celebrate me today. I'm especially pleased to have my guests of honor with me. I warmly welcome her Excellency, Happiness and the ambassador of the heart, Love, the mysterious Eroticism, the wild Sex, the almighty Money and of course, my good friend, Joy. Let's have a nice party together, and please don't go home too early.\"\n\nThunderous applause rushed through the hall. People toasted each other and when the music started, Sex and Eroticism danced a tango that even Malice was speechless.\n\nAn old Lady plucked her lace handkerchief and dabbed her eyes, then resolutely closed her purse and hurried to the exit. Wisdom, also not quite dewy, saw it and hurried to the host.\n\n\"Dear Life, you forgot to greet your most important guest,\" she muttered to Life. Life looked in the direction Wisdom was pointing.\n\n\"Oh, I'm a douche,\" Life insulted himself, \"I must've committed a great faux pas.\" Life rushed to the exit and held the old lady. \"Please, I'd like to introduce you to the other guests\", he tried to apologize.\n\n\"My son, there's no need. I know them all, believe me, but I am usually not recognized. And the only ones who will miss me are Trouble, Sorrow, Illness, and Death. But they're pretty boring, young man,\" said the old lady.\n\n\"I will miss you,\" said Life.\n\nThe old Lady handed her business card to Life and disappeared.\n\nLife plunged back into the party scene. Money and Love flirted over the rim of the glass, and Life and Joy danced a waltz. Of course, Love left the party with her old habit.\n\nWhen all the guests had finally left - Luck and Fame once again totally drunk - Life took the old woman's business card out of his pocket and read:\n\nSatisfaction\n\nDifficult to reach\n\nTry more often",
        "summary": [
            "This is an allegorical tale, presenting life events as characters at a party hosted by Life itself.",
            "At the party, Sorrow wore black, Luck sparkled in gold, Worries wore mouse-grey suits, Joy wore yellow, and so on.",
            "Malice and Envy, sat in one corner belittling others, particularly commenting on Love's pink dress and her inability to afford it.",
            "Fame was drunk and encouraged by big Money.",
            "Diligence was helping Power by fetching drinks while Work was busy replenishing the buffet.",
            "When Life gave its speech, he welcomed significant attendees such as Happiness, Love, Sex, Money, and Joy.",
            "After thunderous applause and the start of music, Sex and Eroticism danced a tango while an old lady decided to leave the party.",
            "Wisdom pointed out to Life that he had missed greeting her, an important guest.",
            "Rushing to the lady's side, Life was apologetic, but she responded that she knows all the guests but is often unrecognized.",
            "Only Trouble, Sorrow, Illness, and Death miss her, whom she finds boring.",
            "Life reluctantly agreed, and she handed him her business card before disappearing.",
            "After the party, when all the guests had left, Life read the card which was labeled \"Satisfaction - Difficult to reach - Try more often\", indicating that satisfaction in life is hard to attain and requires constant effort."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            0,
            1
        ],
        "story-id": 28,
        "explanations": [
            "Life does not agree with the old lady, and instead says that they will miss her too."
        ],
        "claims": [
            "The story is an allegorical tale.",
            "The story presents life events as characters at a party.",
            "The party is hosted by a character named Life.",
            "At the party, a character named Sorrow wore black.",
            "A character named Luck wore gold.",
            "Characters named Worries wore mouse-grey suits.",
            "A character named Joy wore yellow.",
            "Malice and Envy sat in one corner of the party.",
            "Malice and Envy belittled other characters, particularly commenting on Love's pink dress.",
            "Malice and Envy commented on Love's inability to afford her pink dress.",
            "A character named Fame was drunk at the party.",
            "Fame was encouraged by a character named big Money.",
            "A character named Diligence was helping a character named Power by fetching drinks.",
            "A character named Work was busy replenishing the buffet at the party.",
            "Life gave a speech at the party.",
            "In his speech, Life welcomed significant attendees including Happiness, Love, Sex, Money, and Joy.",
            "After Life's speech, there was thunderous applause and music started.",
            "Characters named Sex and Eroticism danced a tango at the party.",
            "An old lady decided to leave the party after the music started.",
            "A character named Wisdom pointed out to Life that he had missed greeting the old lady, an important guest.",
            "Life rushed to the old lady's side and was apologetic for not greeting her.",
            "The old lady responded to Life that she knows all the guests but is often unrecognized.",
            "The old lady mentioned that only Trouble, Sorrow, Illness, and Death miss her, whom she finds boring.",
            "Life reluctantly agreed with the old lady's statement.",
            "The old lady handed Life her business card before disappearing.",
            "After the party, when all the guests had left, Life read the old lady's business card.",
            "The business card was labeled \"Satisfaction",
            "Difficult to reach",
            "Try more often\".",
            "The business card indicates that satisfaction in life is hard to attain and requires constant effort."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479we8usc": {
        "label": 1,
        "difficulty": "",
        "story": "They had all come to the big party. Sorrow wore black, of course, with a sophisticated little lace veil. Luck could hardly be seen, her golden sequined dress sparkled and flashed in the spotlight so much that it hurt the eyes. Worries were serious again, typical, mouse-gray suits, even the ties weren't very creative, but of first, expensive quality. Joy was wrapped in yellow and had a huge sunflower pinned to her dress. Quite vulgar for Trouble's taste, but Trouble was just a little pinched, you could tell just by looking at his dark green suit. \"Green, please, only losers wear that,\" Malice whispered to her neighbor, Envy.\n\nOnce again, the two couldn't separate. All evening, they huddled together in one corner, trashing the others. \"Look at Love\", Envy hissed to Malice. \"Where the hell did she find that dress? Squeaky pink and these flounces. Sinfully expensive designer, of course, and she can't even afford it.\" \"She looks like a cake\", Malice returned, \"Fat buttercream.\"\n\nAs Sex entered the brightly lit hall, a murmur went through the crowd. His skin-tight snakeskin suit exposed his beautifully sculpted body more than it concealed it. Eroticism took a large sip of champagne at the sight of him and drew attention with her throaty laugh. Her discreet evening dress shimmered in a velvety red.\n\nIllness had retreated to a quiet table in the corner. Her white dress competed with her noble pallor, and she toasted Death with a glass of chamomile tea. As usual, Death had settled stealthily behind a pillar and pulled his black hat down over his face that most didn't even recognize him.\n\nHonor, as pretty much at every party, was walking around smoking cigarettes. \"Embarrassing,\" thought Pride, wiping the sweat from his forehead. \"Come on\", said Kindness, \"Poor Honor can't afford cigarettes after all,\" and surreptitiously slipped her a packet. Fame was almost drunk. He stood in the corner and bawled, encouraged by big Money, who stood next to him and pretty much fogged him with his Havana.\n\nPower, of course, had shown up with his entire court. Fear was constantly scurrying around them, and Diligence was fetching drinks.\n\nWork was busy as always. She constantly had to add the cold plates on the buffet, and somehow the spoons seemed to have run out. Then the host stepped to the microphone. He was dressed very colorfully and looked a bit like a harlequin. \"Oh God, now he's giving a speech too, and he can't even speak,\" Malice whispered to her best friend.\n\n\"Dear friends, dear partners\", Life began a little hesitantly, \"I'm glad you all came to celebrate me today. I'm especially pleased to have my guests of honor with me. I warmly welcome her Excellency, Happiness and the ambassador of the heart, Love, the mysterious Eroticism, the wild Sex, the almighty Money and of course, my good friend, Joy. Let's have a nice party together, and please don't go home too early.\"\n\nThunderous applause rushed through the hall. People toasted each other and when the music started, Sex and Eroticism danced a tango that even Malice was speechless.\n\nAn old Lady plucked her lace handkerchief and dabbed her eyes, then resolutely closed her purse and hurried to the exit. Wisdom, also not quite dewy, saw it and hurried to the host.\n\n\"Dear Life, you forgot to greet your most important guest,\" she muttered to Life. Life looked in the direction Wisdom was pointing.\n\n\"Oh, I'm a douche,\" Life insulted himself, \"I must've committed a great faux pas.\" Life rushed to the exit and held the old lady. \"Please, I'd like to introduce you to the other guests\", he tried to apologize.\n\n\"My son, there's no need. I know them all, believe me, but I am usually not recognized. And the only ones who will miss me are Trouble, Sorrow, Illness, and Death. But they're pretty boring, young man,\" said the old lady.\n\n\"I will miss you,\" said Life.\n\nThe old Lady handed her business card to Life and disappeared.\n\nLife plunged back into the party scene. Money and Love flirted over the rim of the glass, and Life and Joy danced a waltz. Of course, Love left the party with her old habit.\n\nWhen all the guests had finally left - Luck and Fame once again totally drunk - Life took the old woman's business card out of his pocket and read:\n\nSatisfaction\n\nDifficult to reach\n\nTry more often",
        "summary": [
            "The story revolves around a grand party attended by various personified concepts and emotions, such as Sorrow, Luck, Worries, Joy, Trouble, Malice, Envy, Love, Sex, Eroticism, Illness, Death, Honor, Pride, Kindness, Fame, Money, Power, Fear, Diligence, and Work.",
            "The host of the party is Life, who welcomes his guests of honor, including Happiness, Love, Eroticism, Sex, Money, and Joy.",
            "Throughout the party, the guests interact with one another, displaying their characteristic traits.",
            "Malice and Envy gossip about the other guests, while Sex and Eroticism captivate the crowd with their alluring presence.",
            "Illness and Death share a quiet moment, and Honor struggles to afford cigarettes.",
            "As Life begins his speech, he fails to acknowledge one important guest - an old lady.",
            "Wisdom points out this oversight, and Life rushes to apologize to the old lady, who reveals that she is usually not recognized and that only Trouble, Sorrow, Illness, and Death will miss her.",
            "She hands her business card to Life and leaves the party.",
            "The party continues with various interactions among the guests, and when it ends, Life takes out the old lady's business card, which reads \"Satisfaction - Difficult to reach - Try more often.\""
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 28,
        "explanations": [],
        "claims": [
            "The story is set at a grand party.",
            "The party is attended by personified concepts and emotions.",
            "The personified concepts and emotions attending the party include Sorrow, Luck, Worries, Joy, Trouble, Malice, Envy, Love, Sex, Eroticism, Illness, Death, Honor, Pride, Kindness, Fame, Money, Power, Fear, Diligence, and Work.",
            "Life is the host of the party.",
            "Life welcomes guests of honor to the party.",
            "The guests of honor include Happiness, Love, Eroticism, Sex, Money, and Joy.",
            "Malice and Envy gossip about the other guests at the party.",
            "Sex and Eroticism captivate the crowd with their alluring presence.",
            "Illness and Death share a quiet moment at the party.",
            "Honor struggles to afford cigarettes at the party.",
            "Life begins a speech during the party.",
            "Life fails to acknowledge an old lady during his speech.",
            "Wisdom points out Life's oversight of not acknowledging the old lady.",
            "Life rushes to apologize to the old lady after Wisdom points out the oversight.",
            "The old lady reveals that she is usually not recognized.",
            "The old lady states that only Trouble, Sorrow, Illness, and Death will miss her.",
            "The old lady hands her business card to Life before leaving the party.",
            "The party continues with various interactions among the guests after the old lady leaves.",
            "After the party ends, Life takes out the old lady's business card.",
            "The old lady's business card reads \"Satisfaction",
            "Difficult to reach",
            "Try more often.\""
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473we8usc": {
        "label": 0,
        "difficulty": "hard",
        "story": "They had all come to the big party. Sorrow wore black, of course, with a sophisticated little lace veil. Luck could hardly be seen, her golden sequined dress sparkled and flashed in the spotlight so much that it hurt the eyes. Worries were serious again, typical, mouse-gray suits, even the ties weren't very creative, but of first, expensive quality. Joy was wrapped in yellow and had a huge sunflower pinned to her dress. Quite vulgar for Trouble's taste, but Trouble was just a little pinched, you could tell just by looking at his dark green suit. \"Green, please, only losers wear that,\" Malice whispered to her neighbor, Envy.\n\nOnce again, the two couldn't separate. All evening, they huddled together in one corner, trashing the others. \"Look at Love\", Envy hissed to Malice. \"Where the hell did she find that dress? Squeaky pink and these flounces. Sinfully expensive designer, of course, and she can't even afford it.\" \"She looks like a cake\", Malice returned, \"Fat buttercream.\"\n\nAs Sex entered the brightly lit hall, a murmur went through the crowd. His skin-tight snakeskin suit exposed his beautifully sculpted body more than it concealed it. Eroticism took a large sip of champagne at the sight of him and drew attention with her throaty laugh. Her discreet evening dress shimmered in a velvety red.\n\nIllness had retreated to a quiet table in the corner. Her white dress competed with her noble pallor, and she toasted Death with a glass of chamomile tea. As usual, Death had settled stealthily behind a pillar and pulled his black hat down over his face that most didn't even recognize him.\n\nHonor, as pretty much at every party, was walking around smoking cigarettes. \"Embarrassing,\" thought Pride, wiping the sweat from his forehead. \"Come on\", said Kindness, \"Poor Honor can't afford cigarettes after all,\" and surreptitiously slipped her a packet. Fame was almost drunk. He stood in the corner and bawled, encouraged by big Money, who stood next to him and pretty much fogged him with his Havana.\n\nPower, of course, had shown up with his entire court. Fear was constantly scurrying around them, and Diligence was fetching drinks.\n\nWork was busy as always. She constantly had to add the cold plates on the buffet, and somehow the spoons seemed to have run out. Then the host stepped to the microphone. He was dressed very colorfully and looked a bit like a harlequin. \"Oh God, now he's giving a speech too, and he can't even speak,\" Malice whispered to her best friend.\n\n\"Dear friends, dear partners\", Life began a little hesitantly, \"I'm glad you all came to celebrate me today. I'm especially pleased to have my guests of honor with me. I warmly welcome her Excellency, Happiness and the ambassador of the heart, Love, the mysterious Eroticism, the wild Sex, the almighty Money and of course, my good friend, Joy. Let's have a nice party together, and please don't go home too early.\"\n\nThunderous applause rushed through the hall. People toasted each other and when the music started, Sex and Eroticism danced a tango that even Malice was speechless.\n\nAn old Lady plucked her lace handkerchief and dabbed her eyes, then resolutely closed her purse and hurried to the exit. Wisdom, also not quite dewy, saw it and hurried to the host.\n\n\"Dear Life, you forgot to greet your most important guest,\" she muttered to Life. Life looked in the direction Wisdom was pointing.\n\n\"Oh, I'm a douche,\" Life insulted himself, \"I must've committed a great faux pas.\" Life rushed to the exit and held the old lady. \"Please, I'd like to introduce you to the other guests\", he tried to apologize.\n\n\"My son, there's no need. I know them all, believe me, but I am usually not recognized. And the only ones who will miss me are Trouble, Sorrow, Illness, and Death. But they're pretty boring, young man,\" said the old lady.\n\n\"I will miss you,\" said Life.\n\nThe old Lady handed her business card to Life and disappeared.\n\nLife plunged back into the party scene. Money and Love flirted over the rim of the glass, and Life and Joy danced a waltz. Of course, Love left the party with her old habit.\n\nWhen all the guests had finally left - Luck and Fame once again totally drunk - Life took the old woman's business card out of his pocket and read:\n\nSatisfaction\n\nDifficult to reach\n\nTry more often",
        "summary": [
            "A wide range of personified emotions and characteristics gather at a fancy party thrown by Life.",
            "Some guests are well-received and popular, while others are disliked or ignored.",
            "As the night wears on, the host, Life, forgets to recognize an important guest - Satisfaction - who turns out to be the most valuable of them all.",
            "The party ends and the guests leave, each with their own motives and behaviors.",
            "However, Life is left with a lesson to remember, to strive for satisfaction in all aspects of his life."
        ],
        "errors": [
            1,
            1,
            1,
            0,
            1
        ],
        "story-id": 28,
        "explanations": [
            "The guests don't have individual motives for leaving. They leave because the party is over."
        ],
        "claims": [
            "Life throws a fancy party",
            "The party thrown by Life is attended by a wide range of personified emotions and characteristics",
            "Some guests at the party are well-received and popular",
            "Other guests at the party are disliked or ignored",
            "As the night wears on, Life forgets to recognize an important guest named Satisfaction",
            "Satisfaction is revealed to be the most valuable guest of all",
            "The party eventually ends and the guests leave",
            "Each guest leaves the party with their own motives and behaviors",
            "Life learns a lesson to strive for satisfaction in all aspects of his life."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049woglbn": {
        "label": 1,
        "difficulty": "",
        "story": "It was worth it.\n\nI repeat the mantra over and over in my head as I ascend from the cave. My breath comes in gasps. My fingernails are dirty and caked in blood. My muscles shake, my head pounds with exhaustion, and my ankle throbs. Across my back I carry a weight that drags me down like an anchor, threatening to trap me in this cave forever. \n\nIt was worth it.\n\nMy brother and I were on an archaeological excavation in the Yucat\u00e1n when we discovered an unknown temple. As we ecstatically began to explore its depths, we found a painting of an idol. An idol with glowing blue eyes and a black, sinewy form. So eerie, and yet so intriguing and beautiful it defied comprehension. We became obsessed with finding it. At first we believed it would be at the site, but it quickly became evident that this wasn't the case. After days spent scouring the ruins we abandoned our prestigious dig, including the new temple, and made for the city. \n\nIt was worth it. \n\nWe scoured the market.  We talked to gurus, shamans, con men, and se\u00f1oras selling fruit on the ground. We begged every person we talked to for any rumor, myth, or legend they knew about the idol. We spent every penny we had until we were beggars, dependent on the charity of those around us for food and shelter. \n\nIt was worth it. \n\nFinally, we got our break deep within the recesses of a souvenir shop. The owner led us past rows of cheap clothing and knick knacks to her private office, where she pulled a book from a dusty shelf. The book showed the way to an island shrouded in pink clouds, an island with a cave protecting an idol with bright blue eyes and a dark body. \n\nThe shop owner insisted we abandon our search. She spoke of the corruptive powers of the idol, and the potential harm its bearer could bring on themselves and others. We didn't listen. When it became clear we intended to take the book, the shop owner tried to grab it and run. She fell and broke her leg in the ensuing struggle. \n\nIt was worth it. \n\nIt took another month of menial labor to save the money for supplies for our expedition. We barely ate, surviving mainly on trampled, moldy scraps from the market. We sheltered in alleys at night, fending off so many rats, fleas, and stray dogs that we barely slept. \n\nIt was worth it. \n\nFinally we set off at a feverish pace toward our island. We walked, we rode in the backs of trucks, we stole bicycles, and we finally forced a frightened man at gunpoint to take us to the island in his boat. We jumped overboard as soon as it was within sight and swam the rest of the way. \n\nIt was worth it. \n\nThe cave was predictably treacherous. We fell enough times that soon we were bleeding on every limb. I sprained my ankle so badly I almost passed out, and my brother snapped both of the bones in his left forearm. But we continued on, stumbling through tunnel after tunnel. \n\nIt was worth it. \n\nThe idol rested in the center of a cavernous room, settled on a stone altar. Surrounding it was a lake of magma, the heat so intense it singed our faces. \n\nThere was no voice, no writing, nothing to indicate our next step. But we knew anyway. The idol demanded a life in return for its possession. Something snapped inside my brother. For the first time in our quest, fear and doubt filled his expression. He grabbed my arm, face pleading, \"No! It isn't worth it!\" \n\nI gazed at him for a long moment. My playmate, my lifelong companion, my best friend. And then in one motion I shoved him into the magma. He only screamed for a moment before he was enveloped. \n\nIt was worth it. \n\nThe magma vanished in an instant, and I found myself before the idol. It was small enough to fit into the palm of my hand, small enough to fit in my satchel. But power tingled through it, and through me. I took it and returned the way we'd come. \n\nI finally collapse outside the cave. My life, my career, and my beloved brother are gone. I am marooned on an island with no hope of escape. I take the idol from my satchel and lock my gaze with its blue eyes. They begin to glow more fiercely, and the power thrumming through it grows. I feel a presence shift from the idol to reside in me, whispering to me of kingdoms, power, glory, bloodshed. I stagger to my feet, a being remade. \n\nIt was worth it.",
        "summary": [
            "A man and his brother are on an archaeological dig in the Yucat\u00e1n when they discover an painting of a mysterious idol.",
            "They become obsessed with finding it, abandoning the dig and scouring the city for any rumors about it.",
            "They find a clue in a souvenir shop, and despite warnings from the shop owner about the idol's corruptive powers, they continue their search.",
            "After a month of hardship, they finally reach the idol, which is protected by a lava lake and commands a life in return for its possession.",
            "The man makes the ultimate sacrifice by pushing his brother into the lava to get the idol.",
            "Now alone on an island, the man feels the power of the idol in him, convinced that losing his life, career, and brother was worth it."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 29,
        "explanations": [],
        "claims": [
            "A man and his brother are on an archaeological dig in the Yucat\u00e1n.",
            "They discover a painting of a mysterious idol during the dig.",
            "The man and his brother become obsessed with finding the mysterious idol.",
            "They abandon the archaeological dig to search for the idol.",
            "The man and his brother scour the city for any rumors about the mysterious idol.",
            "They find a clue about the idol's location in a souvenir shop.",
            "The shop owner warns them about the idol's corruptive powers.",
            "Despite the warning, the man and his brother continue their search for the idol.",
            "After a month of hardship, the man and his brother finally reach the idol.",
            "The idol is protected by a lava lake.",
            "The idol commands a life in return for its possession.",
            "The man pushes his brother into the lava lake to get the idol.",
            "The man is now alone on an island with the idol.",
            "The man feels the power of the idol in him.",
            "The man is convinced that losing his life, career, and brother was worth it to obtain the idol."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479woglbn": {
        "label": 1,
        "difficulty": "",
        "story": "It was worth it.\n\nI repeat the mantra over and over in my head as I ascend from the cave. My breath comes in gasps. My fingernails are dirty and caked in blood. My muscles shake, my head pounds with exhaustion, and my ankle throbs. Across my back I carry a weight that drags me down like an anchor, threatening to trap me in this cave forever. \n\nIt was worth it.\n\nMy brother and I were on an archaeological excavation in the Yucat\u00e1n when we discovered an unknown temple. As we ecstatically began to explore its depths, we found a painting of an idol. An idol with glowing blue eyes and a black, sinewy form. So eerie, and yet so intriguing and beautiful it defied comprehension. We became obsessed with finding it. At first we believed it would be at the site, but it quickly became evident that this wasn't the case. After days spent scouring the ruins we abandoned our prestigious dig, including the new temple, and made for the city. \n\nIt was worth it. \n\nWe scoured the market.  We talked to gurus, shamans, con men, and se\u00f1oras selling fruit on the ground. We begged every person we talked to for any rumor, myth, or legend they knew about the idol. We spent every penny we had until we were beggars, dependent on the charity of those around us for food and shelter. \n\nIt was worth it. \n\nFinally, we got our break deep within the recesses of a souvenir shop. The owner led us past rows of cheap clothing and knick knacks to her private office, where she pulled a book from a dusty shelf. The book showed the way to an island shrouded in pink clouds, an island with a cave protecting an idol with bright blue eyes and a dark body. \n\nThe shop owner insisted we abandon our search. She spoke of the corruptive powers of the idol, and the potential harm its bearer could bring on themselves and others. We didn't listen. When it became clear we intended to take the book, the shop owner tried to grab it and run. She fell and broke her leg in the ensuing struggle. \n\nIt was worth it. \n\nIt took another month of menial labor to save the money for supplies for our expedition. We barely ate, surviving mainly on trampled, moldy scraps from the market. We sheltered in alleys at night, fending off so many rats, fleas, and stray dogs that we barely slept. \n\nIt was worth it. \n\nFinally we set off at a feverish pace toward our island. We walked, we rode in the backs of trucks, we stole bicycles, and we finally forced a frightened man at gunpoint to take us to the island in his boat. We jumped overboard as soon as it was within sight and swam the rest of the way. \n\nIt was worth it. \n\nThe cave was predictably treacherous. We fell enough times that soon we were bleeding on every limb. I sprained my ankle so badly I almost passed out, and my brother snapped both of the bones in his left forearm. But we continued on, stumbling through tunnel after tunnel. \n\nIt was worth it. \n\nThe idol rested in the center of a cavernous room, settled on a stone altar. Surrounding it was a lake of magma, the heat so intense it singed our faces. \n\nThere was no voice, no writing, nothing to indicate our next step. But we knew anyway. The idol demanded a life in return for its possession. Something snapped inside my brother. For the first time in our quest, fear and doubt filled his expression. He grabbed my arm, face pleading, \"No! It isn't worth it!\" \n\nI gazed at him for a long moment. My playmate, my lifelong companion, my best friend. And then in one motion I shoved him into the magma. He only screamed for a moment before he was enveloped. \n\nIt was worth it. \n\nThe magma vanished in an instant, and I found myself before the idol. It was small enough to fit into the palm of my hand, small enough to fit in my satchel. But power tingled through it, and through me. I took it and returned the way we'd come. \n\nI finally collapse outside the cave. My life, my career, and my beloved brother are gone. I am marooned on an island with no hope of escape. I take the idol from my satchel and lock my gaze with its blue eyes. They begin to glow more fiercely, and the power thrumming through it grows. I feel a presence shift from the idol to reside in me, whispering to me of kingdoms, power, glory, bloodshed. I stagger to my feet, a being remade. \n\nIt was worth it.",
        "summary": [
            "In this story, the narrator and their brother, both archaeologists, become obsessed with finding an idol they discovered in a painting while excavating an unknown temple in the Yucat\u00e1n.",
            "They abandon their dig and spend all their resources searching for the idol, eventually finding a book that leads them to an island with a cave housing the artifact.",
            "Despite warnings about the idol's corruptive powers, they persist in their quest, enduring physical hardships and committing unethical acts to reach the island.",
            "Inside the cave, they face treacherous conditions and severe injuries.",
            "The idol demands a life in exchange for possession, and in a moment of desperation, the narrator pushes their brother into a magma lake, sacrificing him.",
            "The magma disappears, and the narrator claims the small but powerful idol.",
            "Stranded on the island, the narrator feels the idol's presence and power transferring to them, promising kingdoms, glory, and bloodshed.",
            "The story concludes with the narrator, now a transformed being, believing that the sacrifice and hardships endured were worth it to obtain the idol.",
            "Throughout the story, the phrase \"It was worth it\" is repeated, emphasizing the narrator's unyielding determination and the lengths they are willing to go to achieve their goal, regardless of the consequences."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 29,
        "explanations": [],
        "claims": [
            "The narrator and their brother are archaeologists.",
            "The narrator and their brother become obsessed with finding an idol they saw in a painting.",
            "The painting was discovered while excavating an unknown temple in the Yucat\u00e1n.",
            "The narrator and their brother abandon their archaeological dig to search for the idol.",
            "The narrator and their brother spend all their resources searching for the idol.",
            "They eventually find a book that leads them to an island.",
            "The island has a cave that houses the artifact (idol).",
            "There are warnings about the idol's corruptive powers.",
            "The narrator and their brother persist in their quest despite the warnings.",
            "The narrator and their brother endure physical hardships during their quest.",
            "The narrator and their brother commit unethical acts to reach the island.",
            "Inside the cave, they face treacherous conditions.",
            "Inside the cave, they suffer severe injuries.",
            "The idol demands a life in exchange for possession.",
            "In a moment of desperation, the narrator pushes their brother into a magma lake.",
            "The narrator's brother is sacrificed to the idol.",
            "After the sacrifice, the magma disappears.",
            "The narrator claims the small but powerful idol.",
            "Stranded on the island, the narrator feels the idol's presence and power transferring to them.",
            "The idol promises kingdoms, glory, and bloodshed to the narrator.",
            "The narrator becomes a transformed being after claiming the idol.",
            "The narrator believes the sacrifice and hardships were worth it to obtain the idol.",
            "The phrase \"It was worth it\" is repeated throughout the story, emphasizing the narrator's determination."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473woglbn": {
        "label": 0,
        "difficulty": "hard",
        "story": "It was worth it.\n\nI repeat the mantra over and over in my head as I ascend from the cave. My breath comes in gasps. My fingernails are dirty and caked in blood. My muscles shake, my head pounds with exhaustion, and my ankle throbs. Across my back I carry a weight that drags me down like an anchor, threatening to trap me in this cave forever. \n\nIt was worth it.\n\nMy brother and I were on an archaeological excavation in the Yucat\u00e1n when we discovered an unknown temple. As we ecstatically began to explore its depths, we found a painting of an idol. An idol with glowing blue eyes and a black, sinewy form. So eerie, and yet so intriguing and beautiful it defied comprehension. We became obsessed with finding it. At first we believed it would be at the site, but it quickly became evident that this wasn't the case. After days spent scouring the ruins we abandoned our prestigious dig, including the new temple, and made for the city. \n\nIt was worth it. \n\nWe scoured the market.  We talked to gurus, shamans, con men, and se\u00f1oras selling fruit on the ground. We begged every person we talked to for any rumor, myth, or legend they knew about the idol. We spent every penny we had until we were beggars, dependent on the charity of those around us for food and shelter. \n\nIt was worth it. \n\nFinally, we got our break deep within the recesses of a souvenir shop. The owner led us past rows of cheap clothing and knick knacks to her private office, where she pulled a book from a dusty shelf. The book showed the way to an island shrouded in pink clouds, an island with a cave protecting an idol with bright blue eyes and a dark body. \n\nThe shop owner insisted we abandon our search. She spoke of the corruptive powers of the idol, and the potential harm its bearer could bring on themselves and others. We didn't listen. When it became clear we intended to take the book, the shop owner tried to grab it and run. She fell and broke her leg in the ensuing struggle. \n\nIt was worth it. \n\nIt took another month of menial labor to save the money for supplies for our expedition. We barely ate, surviving mainly on trampled, moldy scraps from the market. We sheltered in alleys at night, fending off so many rats, fleas, and stray dogs that we barely slept. \n\nIt was worth it. \n\nFinally we set off at a feverish pace toward our island. We walked, we rode in the backs of trucks, we stole bicycles, and we finally forced a frightened man at gunpoint to take us to the island in his boat. We jumped overboard as soon as it was within sight and swam the rest of the way. \n\nIt was worth it. \n\nThe cave was predictably treacherous. We fell enough times that soon we were bleeding on every limb. I sprained my ankle so badly I almost passed out, and my brother snapped both of the bones in his left forearm. But we continued on, stumbling through tunnel after tunnel. \n\nIt was worth it. \n\nThe idol rested in the center of a cavernous room, settled on a stone altar. Surrounding it was a lake of magma, the heat so intense it singed our faces. \n\nThere was no voice, no writing, nothing to indicate our next step. But we knew anyway. The idol demanded a life in return for its possession. Something snapped inside my brother. For the first time in our quest, fear and doubt filled his expression. He grabbed my arm, face pleading, \"No! It isn't worth it!\" \n\nI gazed at him for a long moment. My playmate, my lifelong companion, my best friend. And then in one motion I shoved him into the magma. He only screamed for a moment before he was enveloped. \n\nIt was worth it. \n\nThe magma vanished in an instant, and I found myself before the idol. It was small enough to fit into the palm of my hand, small enough to fit in my satchel. But power tingled through it, and through me. I took it and returned the way we'd come. \n\nI finally collapse outside the cave. My life, my career, and my beloved brother are gone. I am marooned on an island with no hope of escape. I take the idol from my satchel and lock my gaze with its blue eyes. They begin to glow more fiercely, and the power thrumming through it grows. I feel a presence shift from the idol to reside in me, whispering to me of kingdoms, power, glory, bloodshed. I stagger to my feet, a being remade. \n\nIt was worth it.",
        "summary": [
            "A man and his brother become fixated on finding an idol with glowing blue eyes.",
            "They go to great lengths, including stealing, violence, and sacrificing a life, to obtain it.",
            "The protagonist ends up alone on an island with the idol, which gives him a sense of power and control, justifying all of the sacrifices he made to obtain it."
        ],
        "errors": [
            1,
            1,
            0
        ],
        "story-id": 29,
        "explanations": [
            "The protagonist doesn't just end up alone, he sacrifices his brother's life for the idol. This is a key detail of causation."
        ],
        "claims": [
            "A man becomes fixated on finding an idol with glowing blue eyes.",
            "The man's brother also becomes fixated on finding the idol with glowing blue eyes.",
            "The man and his brother go to great lengths to find the idol.",
            "The man and his brother engage in stealing to find the idol.",
            "The man and his brother engage in violence to find the idol.",
            "The man and his brother sacrifice a life to obtain the idol.",
            "The protagonist ends up alone on an island with the idol.",
            "The idol gives the protagonist a sense of power and control.",
            "The protagonist justifies all of the sacrifices made to obtain the idol by the sense of power and control it gives him."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049y44vzl": {
        "label": 0,
        "difficulty": "hard",
        "story": "August wiped the sweat from his forehead with his handkerchief. His wide-brimmed hat mostly kept the sun out of his eyes but it still beat down on him hard. His unique wine-colored vest and chaps along with his cotton shirt and brown trousers didn't help either. On his trusty steed named Morgan, August is riding west. He lived in Nebraska for 15 years before being framed for a crime he didn't commit. Now he's heading to Utah in search of a new life. Currently, he's crossing  Wyoming to get to Utah.\n\n\"I can't believe I'm doing this,\" August said to himself as he rode through the desert. \"It feels like just yesterday that I left my home.\"\n\nHe had been living in Nebraska since he was young. It wasn't until he turned 16 that he decided to leave his parent's house and go live by himself. He found work at a ranch owned by an old man named Mr. Johnson who taught him how to ride horses. After working there for two years, August saved up enough money so he could buy his own horse. Years passed as he continued to work for Mr. Johnson. He was 26 and had finally saved enough money to buy his own land when one night he waltzed into a saloon. The next thing he knew, he woke up tied to a chair in a room full of men wearing black hats. They were all pointing guns at him. One of them walked over to August and pulled off his hat.\n\n\"You're under arrest for murder,\" the man said.\n\nAugust didn't know anything about any murders or why they would be arresting him if he hadn't done anything wrong. All he did was walk into a bar and drink some whiskey while playing poker with friends.\n\nHe was sentenced to 10 years in prison. He served 2 of those years before a huge jailbreak happened and he saw his chance to get out. He went back to his parent's house and they didn't want anything to do with him so he took his horse and left. He's 28 now and he has no idea who framed him and he has no intention of finding out. He just wants to start his new life in Utah.\n\n\"This place looks pretty nice,\" August said as he looked around.\n\nThe scenery was beautiful. There weren't many trees here but there were plenty of cacti. A few miles ahead was a small town called Fort Bridger. August wanted to stop and check it out.\n\n\"Morgan, let's head towards the fort,\" August said as he patted his horse on the neck.\n\nThey made their way closer to the town and stopped at a general store. August bought some supplies and then headed outside. He sat down against a wall and leaned his rifle across his lap. He noticed a woman walking past him and she smiled.\n\n\"Hello,\" the woman said.\n\n\"Hi,\" August replied.\n\nShe was tall and slender with long blonde hair. She wore a red dress that hugged her body perfectly. Her blue eyes sparkled as she stared at August.\n\n\"Are you going to the fort?\" the woman asked.\n\n\"Yes, I am,\" August answered.\n\n\"Well, I'll see you there,\" the woman said.\n\nAugust watched her walk away. He couldn't take his eyes off her. When he got to the fort, he saw the woman sitting on a bench talking to another woman. He approached them and introduced himself.\n\n\"I'm August,\" he said. \"You nice ladies wouldn't know if there happened to be a room to rent around here, would you?\"\n\n\"Oh yes!\" the other woman said. \"We have rooms available. We also offer meals and a bathhouse.\"\n\n\"That sounds wonderful,\" August said.\n\n\"Follow me,\" the first woman said.\n\nShe led August to a building where he paid for a room. Once he was settled in, he went downstairs to the dining hall. The food smelled delicious. He ordered a plate of beans, cornbread, and fried chicken. As soon as he finished eating, he went upstairs to his room. He opened his trunk and unpacked his belongings. That evening he lay in bed thinking about what he should do.\n\n\"What are you doing here?\" August whispered to himself. \"You don't belong here.\"\n\nAs he drifted off to sleep, he heard a knock at his door. He rolled over and reached for his gun. He slowly stood up and peeked through the peephole. He recognized the woman standing outside his door.\n\n\"Come in,\" he said.\n\nThe woman entered his room and closed the door behind her. She walked over to his bed and sat down beside him.\n\n\"Do you mind if we talk?\" she asked.\n\n\"No, not at all,\" August said.\n\n\"My name is Mary Ann,\" the woman said. \"And I'm in trouble.\"",
        "summary": [
            "The protagonist, August, is journeying westward on his horse Morgan after being accused of a crime he didn't commit.",
            "He was a hardworking Nebraska resident who was working towards buying a land but his life turned upside down when he was thrown into prison for a murder he had no knowledge of.",
            "Upon escaping prison, he finds no support from his parents and sets off west to start anew.",
            "He rides through the barren lands of Wyoming hoping to settle in Utah.",
            "He makes a stop at Fort Bridger, secures lodging and supplies and also catches the eye of a woman named Mary Ann.",
            "She approaches August one night revealing that she is \"in trouble.\""
        ],
        "errors": [
            1,
            1,
            1,
            0,
            1,
            1
        ],
        "story-id": 30,
        "explanations": [
            "The land is not barren. There are lots of cacti."
        ],
        "claims": [
            "August is journeying westward on his horse named Morgan.",
            "August was accused of a crime he didn't commit.",
            "August was a resident of Nebraska.",
            "August was working towards buying land before his life was disrupted.",
            "August was thrown into prison for a murder he had no knowledge of.",
            "August escaped from prison.",
            "After escaping prison, August found no support from his parents.",
            "August sets off west to start anew after escaping prison and finding no support from his parents.",
            "August rides through the barren lands of Wyoming with the hope of settling in Utah.",
            "August makes a stop at Fort Bridger during his journey.",
            "At Fort Bridger, August secures lodging and supplies.",
            "August catches the eye of a woman named Mary Ann at Fort Bridger.",
            "Mary Ann approaches August one night revealing that she is \"in trouble.\""
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479y44vzl": {
        "label": 0,
        "difficulty": "hard",
        "story": "August wiped the sweat from his forehead with his handkerchief. His wide-brimmed hat mostly kept the sun out of his eyes but it still beat down on him hard. His unique wine-colored vest and chaps along with his cotton shirt and brown trousers didn't help either. On his trusty steed named Morgan, August is riding west. He lived in Nebraska for 15 years before being framed for a crime he didn't commit. Now he's heading to Utah in search of a new life. Currently, he's crossing  Wyoming to get to Utah.\n\n\"I can't believe I'm doing this,\" August said to himself as he rode through the desert. \"It feels like just yesterday that I left my home.\"\n\nHe had been living in Nebraska since he was young. It wasn't until he turned 16 that he decided to leave his parent's house and go live by himself. He found work at a ranch owned by an old man named Mr. Johnson who taught him how to ride horses. After working there for two years, August saved up enough money so he could buy his own horse. Years passed as he continued to work for Mr. Johnson. He was 26 and had finally saved enough money to buy his own land when one night he waltzed into a saloon. The next thing he knew, he woke up tied to a chair in a room full of men wearing black hats. They were all pointing guns at him. One of them walked over to August and pulled off his hat.\n\n\"You're under arrest for murder,\" the man said.\n\nAugust didn't know anything about any murders or why they would be arresting him if he hadn't done anything wrong. All he did was walk into a bar and drink some whiskey while playing poker with friends.\n\nHe was sentenced to 10 years in prison. He served 2 of those years before a huge jailbreak happened and he saw his chance to get out. He went back to his parent's house and they didn't want anything to do with him so he took his horse and left. He's 28 now and he has no idea who framed him and he has no intention of finding out. He just wants to start his new life in Utah.\n\n\"This place looks pretty nice,\" August said as he looked around.\n\nThe scenery was beautiful. There weren't many trees here but there were plenty of cacti. A few miles ahead was a small town called Fort Bridger. August wanted to stop and check it out.\n\n\"Morgan, let's head towards the fort,\" August said as he patted his horse on the neck.\n\nThey made their way closer to the town and stopped at a general store. August bought some supplies and then headed outside. He sat down against a wall and leaned his rifle across his lap. He noticed a woman walking past him and she smiled.\n\n\"Hello,\" the woman said.\n\n\"Hi,\" August replied.\n\nShe was tall and slender with long blonde hair. She wore a red dress that hugged her body perfectly. Her blue eyes sparkled as she stared at August.\n\n\"Are you going to the fort?\" the woman asked.\n\n\"Yes, I am,\" August answered.\n\n\"Well, I'll see you there,\" the woman said.\n\nAugust watched her walk away. He couldn't take his eyes off her. When he got to the fort, he saw the woman sitting on a bench talking to another woman. He approached them and introduced himself.\n\n\"I'm August,\" he said. \"You nice ladies wouldn't know if there happened to be a room to rent around here, would you?\"\n\n\"Oh yes!\" the other woman said. \"We have rooms available. We also offer meals and a bathhouse.\"\n\n\"That sounds wonderful,\" August said.\n\n\"Follow me,\" the first woman said.\n\nShe led August to a building where he paid for a room. Once he was settled in, he went downstairs to the dining hall. The food smelled delicious. He ordered a plate of beans, cornbread, and fried chicken. As soon as he finished eating, he went upstairs to his room. He opened his trunk and unpacked his belongings. That evening he lay in bed thinking about what he should do.\n\n\"What are you doing here?\" August whispered to himself. \"You don't belong here.\"\n\nAs he drifted off to sleep, he heard a knock at his door. He rolled over and reached for his gun. He slowly stood up and peeked through the peephole. He recognized the woman standing outside his door.\n\n\"Come in,\" he said.\n\nThe woman entered his room and closed the door behind her. She walked over to his bed and sat down beside him.\n\n\"Do you mind if we talk?\" she asked.\n\n\"No, not at all,\" August said.\n\n\"My name is Mary Ann,\" the woman said. \"And I'm in trouble.\"",
        "summary": [
            "In this story, August is a 28-year-old man who lived in Nebraska for 15 years before being framed for a murder he didn't commit.",
            "After serving two years in prison, he escaped during a jailbreak and decided to start a new life in Utah.",
            "He left his parents' house, taking his horse named Morgan with him.",
            "As he traveled through Wyoming, he encountered a beautiful landscape with cacti and few trees.",
            "He stopped at a small town called Fort Bridger to buy supplies and rest.",
            "There, he met a tall, slender woman with long blonde hair and blue eyes wearing a red dress.",
            "The woman directed him to a place where he could rent a room and have meals.After settling in, August had dinner and returned to his room, feeling out of place.",
            "As he tried to sleep, he heard a knock on his door.",
            "It was the woman he had met earlier, who introduced herself as Mary Ann.",
            "She entered his room and told him that she was in trouble, setting the stage for the next part of August's adventure."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            0,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 30,
        "explanations": [
            "He bought supplies and met the woman before he got to the town."
        ],
        "claims": [
            "August is a 28-year-old man.",
            "August lived in Nebraska for 15 years.",
            "August was framed for a murder he didn't commit.",
            "August served two years in prison.",
            "August escaped from prison during a jailbreak.",
            "After escaping prison, August decided to start a new life in Utah.",
            "August left his parents' house with his horse named Morgan.",
            "August traveled through Wyoming on his way to Utah.",
            "During his travel through Wyoming, August encountered a landscape with cacti and few trees.",
            "August stopped at a small town called Fort Bridger to buy supplies and rest.",
            "In Fort Bridger, August met a tall, slender woman with long blonde hair and blue eyes wearing a red dress.",
            "The woman directed August to a place where he could rent a room and have meals.",
            "After settling in, August had dinner and returned to his room, feeling out of place.",
            "While trying to sleep, August heard a knock on his door.",
            "The woman who knocked on August's door was the same woman he had met earlier in Fort Bridger.",
            "The woman introduced herself to August as Mary Ann.",
            "Mary Ann entered August's room and told him that she was in trouble.",
            "Mary Ann's revelation to August set the stage for the next part of his adventure."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473y44vzl": {
        "label": 0,
        "difficulty": "hard",
        "story": "August wiped the sweat from his forehead with his handkerchief. His wide-brimmed hat mostly kept the sun out of his eyes but it still beat down on him hard. His unique wine-colored vest and chaps along with his cotton shirt and brown trousers didn't help either. On his trusty steed named Morgan, August is riding west. He lived in Nebraska for 15 years before being framed for a crime he didn't commit. Now he's heading to Utah in search of a new life. Currently, he's crossing  Wyoming to get to Utah.\n\n\"I can't believe I'm doing this,\" August said to himself as he rode through the desert. \"It feels like just yesterday that I left my home.\"\n\nHe had been living in Nebraska since he was young. It wasn't until he turned 16 that he decided to leave his parent's house and go live by himself. He found work at a ranch owned by an old man named Mr. Johnson who taught him how to ride horses. After working there for two years, August saved up enough money so he could buy his own horse. Years passed as he continued to work for Mr. Johnson. He was 26 and had finally saved enough money to buy his own land when one night he waltzed into a saloon. The next thing he knew, he woke up tied to a chair in a room full of men wearing black hats. They were all pointing guns at him. One of them walked over to August and pulled off his hat.\n\n\"You're under arrest for murder,\" the man said.\n\nAugust didn't know anything about any murders or why they would be arresting him if he hadn't done anything wrong. All he did was walk into a bar and drink some whiskey while playing poker with friends.\n\nHe was sentenced to 10 years in prison. He served 2 of those years before a huge jailbreak happened and he saw his chance to get out. He went back to his parent's house and they didn't want anything to do with him so he took his horse and left. He's 28 now and he has no idea who framed him and he has no intention of finding out. He just wants to start his new life in Utah.\n\n\"This place looks pretty nice,\" August said as he looked around.\n\nThe scenery was beautiful. There weren't many trees here but there were plenty of cacti. A few miles ahead was a small town called Fort Bridger. August wanted to stop and check it out.\n\n\"Morgan, let's head towards the fort,\" August said as he patted his horse on the neck.\n\nThey made their way closer to the town and stopped at a general store. August bought some supplies and then headed outside. He sat down against a wall and leaned his rifle across his lap. He noticed a woman walking past him and she smiled.\n\n\"Hello,\" the woman said.\n\n\"Hi,\" August replied.\n\nShe was tall and slender with long blonde hair. She wore a red dress that hugged her body perfectly. Her blue eyes sparkled as she stared at August.\n\n\"Are you going to the fort?\" the woman asked.\n\n\"Yes, I am,\" August answered.\n\n\"Well, I'll see you there,\" the woman said.\n\nAugust watched her walk away. He couldn't take his eyes off her. When he got to the fort, he saw the woman sitting on a bench talking to another woman. He approached them and introduced himself.\n\n\"I'm August,\" he said. \"You nice ladies wouldn't know if there happened to be a room to rent around here, would you?\"\n\n\"Oh yes!\" the other woman said. \"We have rooms available. We also offer meals and a bathhouse.\"\n\n\"That sounds wonderful,\" August said.\n\n\"Follow me,\" the first woman said.\n\nShe led August to a building where he paid for a room. Once he was settled in, he went downstairs to the dining hall. The food smelled delicious. He ordered a plate of beans, cornbread, and fried chicken. As soon as he finished eating, he went upstairs to his room. He opened his trunk and unpacked his belongings. That evening he lay in bed thinking about what he should do.\n\n\"What are you doing here?\" August whispered to himself. \"You don't belong here.\"\n\nAs he drifted off to sleep, he heard a knock at his door. He rolled over and reached for his gun. He slowly stood up and peeked through the peephole. He recognized the woman standing outside his door.\n\n\"Come in,\" he said.\n\nThe woman entered his room and closed the door behind her. She walked over to his bed and sat down beside him.\n\n\"Do you mind if we talk?\" she asked.\n\n\"No, not at all,\" August said.\n\n\"My name is Mary Ann,\" the woman said. \"And I'm in trouble.\"",
        "summary": [
            "August is a man who was framed for a crime and spent two years in prison.",
            "He is now travelling to Utah to start a new life when he stops at a town called Fort Bridger.",
            "He meets a woman named Mary Ann who helps him find a place to stay and they later talk about her being in trouble."
        ],
        "errors": [
            1,
            1,
            0
        ],
        "story-id": 30,
        "explanations": [
            "She mentions being in trouble but they do not discuss it further."
        ],
        "claims": [
            "August was framed for a crime.",
            "August spent two years in prison.",
            "August is travelling to Utah to start a new life.",
            "August stops at a town called Fort Bridger during his travel to Utah.",
            "August meets a woman named Mary Ann in Fort Bridger.",
            "Mary Ann helps August find a place to stay in Fort Bridger.",
            "August and Mary Ann talk about Mary Ann being in trouble."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049yg4uzo": {
        "label": 0,
        "difficulty": "hard",
        "story": "*\"And tomorrow morning, we're airing our interview with an LAPD detective to get his take on the Half Moon Killer. Does he believe that there really is a serial killer who preys on the city every half moon? Will police discover new victims by the time the sun rises tomorrow? Find out tomorrow at seven.\"*\n\n\"What a load of bullshit.\" Mike said. He saw the look on my face and said \"What, you don't believe in that nonsense, do you Karla?\"\n\n\"I don't know.\" I said.\n\nFor almost a year, there had been reports of a serial killer who killed in various parts of East Los Angeles anytime there was a half moon. Personally, I didn't know what to make of it; it was strange, but this was Los Angeles, someone somewhere in the city was getting stabbed on a given night no matter what shape the moon was.\n\nAnyway, the three of us (Mike, Danielle, and I) were driving home that night, the night of a half moon, after spending time at a friend's party. Even though I thought there was some truth to The Halfmoon Killer, I still thought we were safe going home since we were driving.\n\nAnd then, there was a man on the road.\n\nMike stopped the car to avoid hitting him. \"HEY BUDDY, CAN YOU GET OFF THE STREET?\" He asked.\n\nThen, the man stepped forward. Once he was in the light of the car's headlights, we could see that he was dressed really odd; he wore a black tracksuit, with a bright white mask.\n\nHe pulled out a gun and shot the front two tires. He then put the gun away and pulled a knife; then he charged towards us.\n\n\"FUCK!\" Mike shouted as he rolled up his window and locked the doors, but that wasn't gonna stop the killer. The Halfmoon Killer broke through the window with his hand, grabbed Mike, and pulled him in closer, where he then stabbed his heart.\n\n\"NO!\" I screamed before frantically getting out of the car. Danielle followed suit, and we began running down the street.\n\nWe were in a commercial area of the city, one that had been closed for hours. Danielle and I ran around the outside of a closed Dollar Tree, hiding amongst the dumpsters.\n\nWe heard the killer stop moving. He didn't know where we were, but was clearly still searching. At that point, Danielle got out her phone and dialed 911.\n\n\"911, what is your emergency?\" we barely heard. The volume on her phone was set to almost nothing to avoid the killer hearing it. She even covered the screen so it wouldn't get seen.\n\n\"We're on Garcia avenue.\" She whispered. \"The Halfmoon Killer, he's real, and he just killed our...\"\n\nHe then found us. The Halfmoon Killer came charging, and got to Danielle before she could even stand up. He pinned her against a wall, and stabbed her right in the heart.\n\nI took off running. I lost him by turning the corner and dashing towards a nearby convenience store (literally the only place I saw whose lights were on).\n\n\"Miss, you okay?\" The cashier asked.\n\n\"HELP ME, PLEASE!\" I shouted. \"THE HALFMOON KILLER, HE'S REAL AND HE'S...\"\n\nMoments later, a bullet flew through the window and hit the cashier in the head.\n\n\"SHIT.\" I said as I ran into the aisles to take cover.\n\nThe killer walked in and said \"The moon demands three sacrifices. All I need is to pierce your heart, and I will be finished for the night.\"\n\nI found myself next to a rack of beer packs. I carefully pulled out a bottle, stood up, and threw it at his head.\n\n\"OW!\" He shouted in pain. I then grabbed another bottle, ran up to him, and hit him on the head.\n\nHe fell and dropped the knife. I tried to run to grab it, but he grabbed me by the ankle and pulled me down with him.\n\nHe then started choking me. \"You will be my sacrifice; the moon will get what it's owed.\"\n\nJust as I was losing consciousness, I felt where he was concealing his gun. I pulled it out, and shot him in the stomach.\n\n\"AAAHHH!\" he screamed in pain. I then crawled out from underneath him, and shot him one last time, in the head.\n\n\\_\\_\\_\\_\\_\\_\\_\\_\n\n*Two months later...*\n\n*\"And at 8, be sure to tune in to our special, The Halfmoon Killer: Terror of Los Angeles, where we get an exclusive interview from Karla Santacruz, the young woman who heroically stopped killer's rampage in a convenience store.\"*\n\n*\"And tomorrow, we talk to the Los Angeles PD about the Fullmoon Killer. Is he a copycat? Is he even real? Find out tomorrow at 9.\"*",
        "summary": [
            "The story revolves around the rumored \"Half Moon Killer,\" who is said to prey in East Los Angeles on half-moon nights.",
            "Despite skepticism from her friends Mike and Danielle, Karla, the narrator, feels there might be some truth to the tale.",
            "On their way home from a party on a half-moon night, they encounter a strangely dressed man on the road.",
            "This man, who turns out to be the Half Moon Killer, kills Mike and Danielle, while Karla manages to escape to a nearby convenience store.",
            "When the killer follows her to the store, Karla manages to overpower and kill him in self-defense.",
            "Two months later, Karla is hailed a hero for ending the Half Moon Killer's reign of terror.",
            "Immediately following, there is news of a possible \"Full Moon Killer,\" creating further suspense and fear in the city."
        ],
        "errors": [
            1,
            0,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 31,
        "explanations": [
            "Danielle does not express skepticism."
        ],
        "claims": [
            "1. The story is set in East Los Angeles. \n2. There is a rumored killer known as the \"Half Moon Killer\" who preys on people during half-moon nights in East Los Angeles. \n3. Karla, the narrator of the story, believes there might be some truth to the rumors about the Half Moon Killer. \n4. Karla's friends, Mike and Danielle, are skeptical about the existence of the Half Moon Killer. \n5. On a night with a half-moon, Karla, Mike, and Danielle encounter a strangely dressed man on the road while returning home from a party. \n6. The strangely dressed man they encounter is revealed to be the Half Moon Killer. \n7. The Half Moon Killer kills Mike and Danielle. \n8. Karla manages to escape from the Half Moon Killer and runs to a nearby convenience store for safety. \n9. The Half Moon Killer follows Karla to the convenience store. \n10. Karla overpowers and kills the Half Moon Killer in self-defense inside the convenience store. \n11. Two months after the incident, Karla is celebrated as a hero for ending the Half Moon Killer's reign of terror. \n12. Following the death of the Half Moon Killer, there is news of a possible \"Full Moon Killer\" in the city, causing further suspense and fear."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479yg4uzo": {
        "label": 1,
        "difficulty": "",
        "story": "*\"And tomorrow morning, we're airing our interview with an LAPD detective to get his take on the Half Moon Killer. Does he believe that there really is a serial killer who preys on the city every half moon? Will police discover new victims by the time the sun rises tomorrow? Find out tomorrow at seven.\"*\n\n\"What a load of bullshit.\" Mike said. He saw the look on my face and said \"What, you don't believe in that nonsense, do you Karla?\"\n\n\"I don't know.\" I said.\n\nFor almost a year, there had been reports of a serial killer who killed in various parts of East Los Angeles anytime there was a half moon. Personally, I didn't know what to make of it; it was strange, but this was Los Angeles, someone somewhere in the city was getting stabbed on a given night no matter what shape the moon was.\n\nAnyway, the three of us (Mike, Danielle, and I) were driving home that night, the night of a half moon, after spending time at a friend's party. Even though I thought there was some truth to The Halfmoon Killer, I still thought we were safe going home since we were driving.\n\nAnd then, there was a man on the road.\n\nMike stopped the car to avoid hitting him. \"HEY BUDDY, CAN YOU GET OFF THE STREET?\" He asked.\n\nThen, the man stepped forward. Once he was in the light of the car's headlights, we could see that he was dressed really odd; he wore a black tracksuit, with a bright white mask.\n\nHe pulled out a gun and shot the front two tires. He then put the gun away and pulled a knife; then he charged towards us.\n\n\"FUCK!\" Mike shouted as he rolled up his window and locked the doors, but that wasn't gonna stop the killer. The Halfmoon Killer broke through the window with his hand, grabbed Mike, and pulled him in closer, where he then stabbed his heart.\n\n\"NO!\" I screamed before frantically getting out of the car. Danielle followed suit, and we began running down the street.\n\nWe were in a commercial area of the city, one that had been closed for hours. Danielle and I ran around the outside of a closed Dollar Tree, hiding amongst the dumpsters.\n\nWe heard the killer stop moving. He didn't know where we were, but was clearly still searching. At that point, Danielle got out her phone and dialed 911.\n\n\"911, what is your emergency?\" we barely heard. The volume on her phone was set to almost nothing to avoid the killer hearing it. She even covered the screen so it wouldn't get seen.\n\n\"We're on Garcia avenue.\" She whispered. \"The Halfmoon Killer, he's real, and he just killed our...\"\n\nHe then found us. The Halfmoon Killer came charging, and got to Danielle before she could even stand up. He pinned her against a wall, and stabbed her right in the heart.\n\nI took off running. I lost him by turning the corner and dashing towards a nearby convenience store (literally the only place I saw whose lights were on).\n\n\"Miss, you okay?\" The cashier asked.\n\n\"HELP ME, PLEASE!\" I shouted. \"THE HALFMOON KILLER, HE'S REAL AND HE'S...\"\n\nMoments later, a bullet flew through the window and hit the cashier in the head.\n\n\"SHIT.\" I said as I ran into the aisles to take cover.\n\nThe killer walked in and said \"The moon demands three sacrifices. All I need is to pierce your heart, and I will be finished for the night.\"\n\nI found myself next to a rack of beer packs. I carefully pulled out a bottle, stood up, and threw it at his head.\n\n\"OW!\" He shouted in pain. I then grabbed another bottle, ran up to him, and hit him on the head.\n\nHe fell and dropped the knife. I tried to run to grab it, but he grabbed me by the ankle and pulled me down with him.\n\nHe then started choking me. \"You will be my sacrifice; the moon will get what it's owed.\"\n\nJust as I was losing consciousness, I felt where he was concealing his gun. I pulled it out, and shot him in the stomach.\n\n\"AAAHHH!\" he screamed in pain. I then crawled out from underneath him, and shot him one last time, in the head.\n\n\\_\\_\\_\\_\\_\\_\\_\\_\n\n*Two months later...*\n\n*\"And at 8, be sure to tune in to our special, The Halfmoon Killer: Terror of Los Angeles, where we get an exclusive interview from Karla Santacruz, the young woman who heroically stopped killer's rampage in a convenience store.\"*\n\n*\"And tomorrow, we talk to the Los Angeles PD about the Fullmoon Killer. Is he a copycat? Is he even real? Find out tomorrow at 9.\"*",
        "summary": [
            "In the story, Karla, Mike, and Danielle are driving home from a party on the night of a half moon when they encounter a man dressed in a black tracksuit and a white mask.",
            "The man, believed to be the infamous Halfmoon Killer, shoots their car's tires and kills Mike.",
            "Karla and Danielle flee, hiding behind a Dollar Tree, but the killer finds them and kills Danielle.",
            "Karla escapes to a nearby convenience store, where the killer shoots the cashier.",
            "The killer catches Karla and begins to choke her, claiming that the moon demands three sacrifices.",
            "Karla manages to grab the killer's gun and shoots him, first in the stomach and then in the head, stopping his rampage.",
            "Two months later, a news report announces an exclusive interview with Karla about her heroic actions and mentions the emergence of a possible copycat killer, the Fullmoon Killer."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 31,
        "explanations": [],
        "claims": [
            "Karla, Mike, and Danielle are driving home from a party on the night of a half moon.",
            "They encounter a man dressed in a black tracksuit and a white mask.",
            "The man is believed to be the infamous Halfmoon Killer.",
            "The Halfmoon Killer shoots their car's tires.",
            "The Halfmoon Killer kills Mike.",
            "Karla and Danielle flee and hide behind a Dollar Tree.",
            "The killer finds Karla and Danielle behind the Dollar Tree and kills Danielle.",
            "Karla escapes to a nearby convenience store.",
            "Inside the convenience store, the killer shoots the cashier.",
            "The killer catches Karla and begins to choke her, claiming that the moon demands three sacrifices.",
            "Karla grabs the killer's gun.",
            "Karla shoots the killer first in the stomach and then in the head.",
            "Karla's actions stop the killer's rampage.",
            "Two months after the incident, a news report announces an exclusive interview with Karla about her heroic actions.",
            "The news report mentions the emergence of a possible copycat killer, the Fullmoon Killer."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473yg4uzo": {
        "label": 1,
        "difficulty": "",
        "story": "*\"And tomorrow morning, we're airing our interview with an LAPD detective to get his take on the Half Moon Killer. Does he believe that there really is a serial killer who preys on the city every half moon? Will police discover new victims by the time the sun rises tomorrow? Find out tomorrow at seven.\"*\n\n\"What a load of bullshit.\" Mike said. He saw the look on my face and said \"What, you don't believe in that nonsense, do you Karla?\"\n\n\"I don't know.\" I said.\n\nFor almost a year, there had been reports of a serial killer who killed in various parts of East Los Angeles anytime there was a half moon. Personally, I didn't know what to make of it; it was strange, but this was Los Angeles, someone somewhere in the city was getting stabbed on a given night no matter what shape the moon was.\n\nAnyway, the three of us (Mike, Danielle, and I) were driving home that night, the night of a half moon, after spending time at a friend's party. Even though I thought there was some truth to The Halfmoon Killer, I still thought we were safe going home since we were driving.\n\nAnd then, there was a man on the road.\n\nMike stopped the car to avoid hitting him. \"HEY BUDDY, CAN YOU GET OFF THE STREET?\" He asked.\n\nThen, the man stepped forward. Once he was in the light of the car's headlights, we could see that he was dressed really odd; he wore a black tracksuit, with a bright white mask.\n\nHe pulled out a gun and shot the front two tires. He then put the gun away and pulled a knife; then he charged towards us.\n\n\"FUCK!\" Mike shouted as he rolled up his window and locked the doors, but that wasn't gonna stop the killer. The Halfmoon Killer broke through the window with his hand, grabbed Mike, and pulled him in closer, where he then stabbed his heart.\n\n\"NO!\" I screamed before frantically getting out of the car. Danielle followed suit, and we began running down the street.\n\nWe were in a commercial area of the city, one that had been closed for hours. Danielle and I ran around the outside of a closed Dollar Tree, hiding amongst the dumpsters.\n\nWe heard the killer stop moving. He didn't know where we were, but was clearly still searching. At that point, Danielle got out her phone and dialed 911.\n\n\"911, what is your emergency?\" we barely heard. The volume on her phone was set to almost nothing to avoid the killer hearing it. She even covered the screen so it wouldn't get seen.\n\n\"We're on Garcia avenue.\" She whispered. \"The Halfmoon Killer, he's real, and he just killed our...\"\n\nHe then found us. The Halfmoon Killer came charging, and got to Danielle before she could even stand up. He pinned her against a wall, and stabbed her right in the heart.\n\nI took off running. I lost him by turning the corner and dashing towards a nearby convenience store (literally the only place I saw whose lights were on).\n\n\"Miss, you okay?\" The cashier asked.\n\n\"HELP ME, PLEASE!\" I shouted. \"THE HALFMOON KILLER, HE'S REAL AND HE'S...\"\n\nMoments later, a bullet flew through the window and hit the cashier in the head.\n\n\"SHIT.\" I said as I ran into the aisles to take cover.\n\nThe killer walked in and said \"The moon demands three sacrifices. All I need is to pierce your heart, and I will be finished for the night.\"\n\nI found myself next to a rack of beer packs. I carefully pulled out a bottle, stood up, and threw it at his head.\n\n\"OW!\" He shouted in pain. I then grabbed another bottle, ran up to him, and hit him on the head.\n\nHe fell and dropped the knife. I tried to run to grab it, but he grabbed me by the ankle and pulled me down with him.\n\nHe then started choking me. \"You will be my sacrifice; the moon will get what it's owed.\"\n\nJust as I was losing consciousness, I felt where he was concealing his gun. I pulled it out, and shot him in the stomach.\n\n\"AAAHHH!\" he screamed in pain. I then crawled out from underneath him, and shot him one last time, in the head.\n\n\\_\\_\\_\\_\\_\\_\\_\\_\n\n*Two months later...*\n\n*\"And at 8, be sure to tune in to our special, The Halfmoon Killer: Terror of Los Angeles, where we get an exclusive interview from Karla Santacruz, the young woman who heroically stopped killer's rampage in a convenience store.\"*\n\n*\"And tomorrow, we talk to the Los Angeles PD about the Fullmoon Killer. Is he a copycat? Is he even real? Find out tomorrow at 9.\"*",
        "summary": [
            "The story follows three friends who encounter a real-life serial killer known as the Halfmoon Killer.",
            "The friends are attacked and two of them are killed, but the third manages to bravely defend herself and stop the killer's rampage.",
            "Two months later, she shares her story in an exclusive interview.",
            "The media is also covering another potential serial killer known as the Fullmoon Killer."
        ],
        "errors": [
            1,
            1,
            1,
            1
        ],
        "story-id": 31,
        "explanations": [],
        "claims": [
            "1. The story involves three friends.",
            "2. The three friends encounter a serial killer known as the Halfmoon Killer.",
            "3. The Halfmoon Killer attacks the three friends.",
            "4. Two of the three friends are killed by the Halfmoon Killer.",
            "5. The third friend defends herself against the Halfmoon Killer.",
            "6. The third friend's actions stop the Halfmoon Killer's rampage.",
            "7. Two months after the incident, the surviving friend shares her story in an exclusive interview.",
            "8. The media is covering the story of another potential serial killer known as the Fullmoon Killer."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    },
    "7911522387646974049ypukwu": {
        "label": 0,
        "difficulty": "easy",
        "story": "Crooked fingers shakily grasped a paint brush. Atop a hill overlooking a tranquil cove, he sat. despite the tremble in his now ancient grasp, the painter delivered masterful brush strokes. Each time the bristles lapped against white cloth, a piece of himself travelled across the canvas. The steady sea breeze blew his thinning hair back, and the salt-sprayed onto his pores. Never before had he known such peace. \n\nThe violent crashing of wave against rock, the melody of seagulls soaring overhead, the slow marching onward of clouds, it was a perfect evening. The once yellow sun now burned orange as it slowly hid its face from view. The sky itself was beginning to yawn and show new colors as day transitioned into night. Slowly, as he laid paint on canvas, the scene became indistinguishable from the painting the man sat in front of. \n\nA cloud of smoke leaked from a young pair of lips.\n\n\"I thought you gave up painting Cosmo.\" A familiar voice broke through the air. The young man pulled again from the cigarette dangling out of his mouth. \n\n\"And I thought I told you that those things will kill you.\" the old man replied with a voice scarred from years of use. The young man briefly raised his shoulders in apathetic protest, and contnued to smoke. \n\n\"Yes, but it was also you that taught me that all things end. If I'm going to die one day, what does it matter?\" he replied. \n\n\"That wasn't what I hoped you'd learned from the lesson Mark.\" He replied with a voice tinged in dissapointment. His trembling hand laid one last stroke of paint on the canvas before he put the brush down. The two men sat in silence admiring the work Cosmo had done. The painting was nothing short of a masterpiece. The old man had dipped a paintbrush into his own heart and painted his very essence onto a canvas. The strokes of his brush and the strategically placed combination of colors created something more beautiful than the location itself.\n\n\"Cosmo, it's amazing.\" Mark said, awestruck, as he placed a hand on Cosmo's shoulder. \n\n\"I never thought I would be able to hold a brush again. After that first brush stroke, it was like I never stopped.\" The man smiled, and a tear rolled down his cheek. \n\n\"Without a doubt, it's your most beautiful work.\" Mark said. \n\n\"I'm glad you like it.\" Cosmo's crooked, wrinkled fingers fished a metallic rectangle from his pocket. He flicked the lighter open and held the flame to the edge of the painting. Orange flames began to creep up the edges of the painting, producing a hauntingly beautiful glow of orange.\n\n\"Hey! What are you doing? That belonged in a museum. It deserved to be studied.\" Mark said frustrated. Cosmo's wrinkled mouth cracked into a smile as he looked up at Mark then back to the burning easel. \n\n In the brief moments of pure destruction, coupled with the harmony of nature around them, a secret hidden beauty that few men ever see was revealed. The painting was destroyed. For the few seconds that it was engulfed in flames, the two men observed an image more enchanting than both the painting and the scene itself. \n\n\"It's what I was trying to teach you.\" Mark looked at him confused. \"Life is not meaningless because it is short. Quite the opposite. Life matters because it only lasts for so long. The painting was beautiful, yes, but what was even more beautiful were the moments when flames danced off the edges of the canvas. It created something else, a different form of art entirely. Now, its gone. It only lives on in our memories. The painting may have only existed for a brief moment, but it made an impact, and it was beautiful. \" Cosmo said as he gazed out towards the waters. \"In the grand scheme of time, our lives are but a blink, a tear dropped in the ocean. The brevity of life, tragic as it may be , is what makes living magical.\" Mark said nothing. He plucked the cigarette out of his mouth and flung it over the side of the cliff. The two men sat in contemplation for a moment. \n\n\"Life is made of these little moments. Nothing lasts, and that is what makes them worth while.\" Mark said wistfully. \n\n\"Now you understand.\" Cosmo said with a smile in his voice. The two men observed the crashing of the waves. Each one forming a crescendo, slamming into the side of rocks, and dissipating back into the sea, never to be seen again.",
        "summary": [
            "An elderly artist named Cosmo creates a stunning painting at a seaside as he enjoys serene surroundings.",
            "A younger man named Mark drops by, who engages in a philosophical dialogue about the inevitable end of life.",
            "Once the painting is finished, despite Mark's appreciation for the art, Cosmo sets the masterpiece on fire.",
            "He explains that life matters because it only lasts for a while.",
            "The beauty of the painting, like life, isn't diminished by its short existence but is made more impactful.",
            "He compares the life cycle to the waves crashing against the rocks; each wave has their moment of glory before settling back into the sea.",
            "Mark finally understands Cosmo's perspective, realizing that life consists of little ephemeral moments that make it worthwhile."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            0,
            1
        ],
        "story-id": 32,
        "explanations": [
            "Cosmo doesn't directly compare the life cycle to the crashing waves."
        ],
        "claims": [
            "An elderly artist named Cosmo creates a painting at a seaside.",
            "Cosmo enjoys the serene surroundings while painting.",
            "A younger man named Mark visits Cosmo at the seaside.",
            "Cosmo and Mark engage in a philosophical dialogue about the inevitable end of life.",
            "Cosmo finishes the painting.",
            "Mark appreciates the painting created by Cosmo.",
            "Cosmo sets the finished painting on fire.",
            "Cosmo explains that life matters because it is temporary.",
            "Cosmo states that the beauty of the painting, like life, isn't diminished by its short existence but is made more impactful.",
            "Cosmo compares the life cycle to waves crashing against the rocks, noting that each wave has their moment of glory before settling back into the sea.",
            "Mark understands Cosmo's perspective on life after their conversation.",
            "Mark realizes that life consists of little ephemeral moments that make it worthwhile."
        ],
        "split": "test",
        "model": "gpt-4"
    },
    "8167058533589479ypukwu": {
        "label": 1,
        "difficulty": "",
        "story": "Crooked fingers shakily grasped a paint brush. Atop a hill overlooking a tranquil cove, he sat. despite the tremble in his now ancient grasp, the painter delivered masterful brush strokes. Each time the bristles lapped against white cloth, a piece of himself travelled across the canvas. The steady sea breeze blew his thinning hair back, and the salt-sprayed onto his pores. Never before had he known such peace. \n\nThe violent crashing of wave against rock, the melody of seagulls soaring overhead, the slow marching onward of clouds, it was a perfect evening. The once yellow sun now burned orange as it slowly hid its face from view. The sky itself was beginning to yawn and show new colors as day transitioned into night. Slowly, as he laid paint on canvas, the scene became indistinguishable from the painting the man sat in front of. \n\nA cloud of smoke leaked from a young pair of lips.\n\n\"I thought you gave up painting Cosmo.\" A familiar voice broke through the air. The young man pulled again from the cigarette dangling out of his mouth. \n\n\"And I thought I told you that those things will kill you.\" the old man replied with a voice scarred from years of use. The young man briefly raised his shoulders in apathetic protest, and contnued to smoke. \n\n\"Yes, but it was also you that taught me that all things end. If I'm going to die one day, what does it matter?\" he replied. \n\n\"That wasn't what I hoped you'd learned from the lesson Mark.\" He replied with a voice tinged in dissapointment. His trembling hand laid one last stroke of paint on the canvas before he put the brush down. The two men sat in silence admiring the work Cosmo had done. The painting was nothing short of a masterpiece. The old man had dipped a paintbrush into his own heart and painted his very essence onto a canvas. The strokes of his brush and the strategically placed combination of colors created something more beautiful than the location itself.\n\n\"Cosmo, it's amazing.\" Mark said, awestruck, as he placed a hand on Cosmo's shoulder. \n\n\"I never thought I would be able to hold a brush again. After that first brush stroke, it was like I never stopped.\" The man smiled, and a tear rolled down his cheek. \n\n\"Without a doubt, it's your most beautiful work.\" Mark said. \n\n\"I'm glad you like it.\" Cosmo's crooked, wrinkled fingers fished a metallic rectangle from his pocket. He flicked the lighter open and held the flame to the edge of the painting. Orange flames began to creep up the edges of the painting, producing a hauntingly beautiful glow of orange.\n\n\"Hey! What are you doing? That belonged in a museum. It deserved to be studied.\" Mark said frustrated. Cosmo's wrinkled mouth cracked into a smile as he looked up at Mark then back to the burning easel. \n\n In the brief moments of pure destruction, coupled with the harmony of nature around them, a secret hidden beauty that few men ever see was revealed. The painting was destroyed. For the few seconds that it was engulfed in flames, the two men observed an image more enchanting than both the painting and the scene itself. \n\n\"It's what I was trying to teach you.\" Mark looked at him confused. \"Life is not meaningless because it is short. Quite the opposite. Life matters because it only lasts for so long. The painting was beautiful, yes, but what was even more beautiful were the moments when flames danced off the edges of the canvas. It created something else, a different form of art entirely. Now, its gone. It only lives on in our memories. The painting may have only existed for a brief moment, but it made an impact, and it was beautiful. \" Cosmo said as he gazed out towards the waters. \"In the grand scheme of time, our lives are but a blink, a tear dropped in the ocean. The brevity of life, tragic as it may be , is what makes living magical.\" Mark said nothing. He plucked the cigarette out of his mouth and flung it over the side of the cliff. The two men sat in contemplation for a moment. \n\n\"Life is made of these little moments. Nothing lasts, and that is what makes them worth while.\" Mark said wistfully. \n\n\"Now you understand.\" Cosmo said with a smile in his voice. The two men observed the crashing of the waves. Each one forming a crescendo, slamming into the side of rocks, and dissipating back into the sea, never to be seen again.",
        "summary": [
            "In this story, an elderly painter named Cosmo sits atop a hill overlooking a tranquil cove, painting a masterpiece that captures the essence of the beautiful scene before him.",
            "A young man named Mark, who is smoking a cigarette, approaches Cosmo and expresses surprise that he has returned to painting.As they admire the completed painting, Cosmo unexpectedly sets it on fire.",
            "Mark is initially frustrated, believing that the painting deserved to be preserved and studied.",
            "However, Cosmo explains that the brief moment of the painting's destruction reveals a hidden beauty that few people ever witness.Cosmo uses this moment to teach Mark a valuable lesson about the meaning of life.",
            "He emphasizes that life is precious because it is short, and that the brevity of existence is what makes living magical.",
            "He compares life to the burning painting, suggesting that the fleeting nature of beautiful moments is what makes them impactful and worthwhile.",
            "Inspired by Cosmo's words, Mark discards his cigarette and comes to understand that life is made up of these transient moments.",
            "The two men sit together, contemplating the crashing waves and the ephemeral nature of existence."
        ],
        "errors": [
            1,
            1,
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "story-id": 32,
        "explanations": [],
        "claims": [
            "An elderly painter named Cosmo is sitting atop a hill overlooking a tranquil cove.",
            "Cosmo is painting a masterpiece that captures the essence of the beautiful scene before him.",
            "A young man named Mark, who is smoking a cigarette, approaches Cosmo.",
            "Mark expresses surprise that Cosmo has returned to painting.",
            "Cosmo and Mark admire the completed painting together.",
            "Cosmo unexpectedly sets the painting on fire.",
            "Mark initially feels frustrated because he believes the painting deserved to be preserved and studied.",
            "Cosmo explains that the painting's destruction reveals a hidden beauty that few people ever witness.",
            "Cosmo teaches Mark a valuable lesson about the meaning of life.",
            "Cosmo emphasizes that life is precious because it is short.",
            "Cosmo suggests that the brevity of existence is what makes living magical.",
            "Cosmo compares life to the burning painting, suggesting that the fleeting nature of beautiful moments is what makes them impactful and worthwhile.",
            "Inspired by Cosmo's words, Mark discards his cigarette.",
            "Mark comes to understand that life is made up of transient moments.",
            "Cosmo and Mark sit together, contemplating the crashing waves and the ephemeral nature of existence."
        ],
        "split": "test",
        "model": "claude"
    },
    "7340915067632839473ypukwu": {
        "label": 1,
        "difficulty": "",
        "story": "Crooked fingers shakily grasped a paint brush. Atop a hill overlooking a tranquil cove, he sat. despite the tremble in his now ancient grasp, the painter delivered masterful brush strokes. Each time the bristles lapped against white cloth, a piece of himself travelled across the canvas. The steady sea breeze blew his thinning hair back, and the salt-sprayed onto his pores. Never before had he known such peace. \n\nThe violent crashing of wave against rock, the melody of seagulls soaring overhead, the slow marching onward of clouds, it was a perfect evening. The once yellow sun now burned orange as it slowly hid its face from view. The sky itself was beginning to yawn and show new colors as day transitioned into night. Slowly, as he laid paint on canvas, the scene became indistinguishable from the painting the man sat in front of. \n\nA cloud of smoke leaked from a young pair of lips.\n\n\"I thought you gave up painting Cosmo.\" A familiar voice broke through the air. The young man pulled again from the cigarette dangling out of his mouth. \n\n\"And I thought I told you that those things will kill you.\" the old man replied with a voice scarred from years of use. The young man briefly raised his shoulders in apathetic protest, and contnued to smoke. \n\n\"Yes, but it was also you that taught me that all things end. If I'm going to die one day, what does it matter?\" he replied. \n\n\"That wasn't what I hoped you'd learned from the lesson Mark.\" He replied with a voice tinged in dissapointment. His trembling hand laid one last stroke of paint on the canvas before he put the brush down. The two men sat in silence admiring the work Cosmo had done. The painting was nothing short of a masterpiece. The old man had dipped a paintbrush into his own heart and painted his very essence onto a canvas. The strokes of his brush and the strategically placed combination of colors created something more beautiful than the location itself.\n\n\"Cosmo, it's amazing.\" Mark said, awestruck, as he placed a hand on Cosmo's shoulder. \n\n\"I never thought I would be able to hold a brush again. After that first brush stroke, it was like I never stopped.\" The man smiled, and a tear rolled down his cheek. \n\n\"Without a doubt, it's your most beautiful work.\" Mark said. \n\n\"I'm glad you like it.\" Cosmo's crooked, wrinkled fingers fished a metallic rectangle from his pocket. He flicked the lighter open and held the flame to the edge of the painting. Orange flames began to creep up the edges of the painting, producing a hauntingly beautiful glow of orange.\n\n\"Hey! What are you doing? That belonged in a museum. It deserved to be studied.\" Mark said frustrated. Cosmo's wrinkled mouth cracked into a smile as he looked up at Mark then back to the burning easel. \n\n In the brief moments of pure destruction, coupled with the harmony of nature around them, a secret hidden beauty that few men ever see was revealed. The painting was destroyed. For the few seconds that it was engulfed in flames, the two men observed an image more enchanting than both the painting and the scene itself. \n\n\"It's what I was trying to teach you.\" Mark looked at him confused. \"Life is not meaningless because it is short. Quite the opposite. Life matters because it only lasts for so long. The painting was beautiful, yes, but what was even more beautiful were the moments when flames danced off the edges of the canvas. It created something else, a different form of art entirely. Now, its gone. It only lives on in our memories. The painting may have only existed for a brief moment, but it made an impact, and it was beautiful. \" Cosmo said as he gazed out towards the waters. \"In the grand scheme of time, our lives are but a blink, a tear dropped in the ocean. The brevity of life, tragic as it may be , is what makes living magical.\" Mark said nothing. He plucked the cigarette out of his mouth and flung it over the side of the cliff. The two men sat in contemplation for a moment. \n\n\"Life is made of these little moments. Nothing lasts, and that is what makes them worth while.\" Mark said wistfully. \n\n\"Now you understand.\" Cosmo said with a smile in his voice. The two men observed the crashing of the waves. Each one forming a crescendo, slamming into the side of rocks, and dissipating back into the sea, never to be seen again.",
        "summary": [
            "An old painter teaches a young man about the beauty of life and the importance of living in the moment.",
            "The painter creates a masterpiece and then burns it, showing the young man that the brevity of life is what makes it beautiful.",
            "The two men sit in contemplation and observe the fleeting moments of nature, coming to a deeper understanding of the meaning of life."
        ],
        "errors": [
            1,
            1,
            1
        ],
        "story-id": 32,
        "explanations": [],
        "claims": [
            "An old painter teaches a young man about the beauty of life.",
            "The old painter teaches the young man the importance of living in the moment.",
            "The painter creates a masterpiece.",
            "The painter then burns the masterpiece he created.",
            "By burning the masterpiece, the painter shows the young man that the brevity of life is what makes it beautiful.",
            "The two men, the old painter and the young man, sit in contemplation together.",
            "While sitting in contemplation, the two men observe the fleeting moments of nature.",
            "Through observing the fleeting moments of nature, the two men come to a deeper understanding of the meaning of life."
        ],
        "split": "test",
        "model": "gpt-3.5-turbo-instruct"
    }
}