Show HN: Built a "Story Chatbot Arena" to Crowdsource AI Story Preferences

github.com

2 points by doc-editor a day ago

Hi HN,

I’m a university student interested in Gen AI, and over the holidays, I built a project in public: Who Rates the Rater? – a crowdsourced dataset for benchmarking AI-generated storytelling.

The Idea Inspired by Chatbot Arena, this lets users compare AI-generated stories and provide feedback. The goal is to refine LLMs for creative writing using real human preferences.

How It Works

- Live Demo: https://storycrowdsourcepreference.streamlit.app

- Tech Stack: Built with Streamlit + Supabase

- Open Source: https://github.com/clchinkc/story_crowdsource_preference

Get Involved

- Try it & star the repo if you find it interesting

- Bug reports & feature requests welcome on Twitter

- Follow me for future AI & storytelling projects

Would love to hear your thoughts!

andrewfromx a day ago

nice I tried it with:

The Hero's Journey Steps

The Departure (or Separation)

    The Ordinary World - The hero exists in their normal world before the adventure begins
    The Call to Adventure - The hero is presented with a challenge or quest
    Refusal of the Call - Initially, the hero is reluctant to follow the call
    Meeting the Mentor - The hero encounters a guide who provides advice and tools
    Crossing the First Threshold - The hero commits to the adventure and enters the special world
The Initiation

    Tests, Allies, and Enemies - The hero faces trials, makes friends, and confronts foes
    Approach to the Innermost Cave - The hero prepares for the major challenge ahead
    The Ordeal - The hero faces their greatest fear or challenge, experiencing "death" and "rebirth"
    Reward (Seizing the Sword) - The hero achieves the goal and gains new power or knowledge
The Return

    The Road Back - The hero begins the journey back to the ordinary world
    Resurrection - The hero faces a final test where everything is at stake
    Return with the Elixir - The hero returns with something to improve the ordinary world
  • doc-editor a day ago

    Hi! Did you get good results? Is this dataset worth collecting?

    • andrewfromx a day ago

      no, i think the prompt was too long. It said "running..." but never showed any results. I think an AI that could spit out a compelling movie that follows the hero's journey like star wars, or the matrix, or The Wizard of Oz, etc. would be really compelling. Like click a button a get a new original 2 hour movie script you could sell to hollywood? Amazing.