Skip to content

🥈2nd place winner - Notetaking powered by AI, speech to text, image to text, text to audio

Notifications You must be signed in to change notification settings

Duo-Keyboard-Koalition/ctrl-hack-del-2024-magic.quill

Repository files navigation

Welcome to magic.quill 🪄📖

Your AI-Powered Note-Wizard for Effortless Academic Mastery

The Challenge 🧩

Drowning in Information, Missing the Mark: In the academic hustle, students face an impossible task: capturing information in lectures, balancing attention between equations, intricate diagrams, and fast-paced speech. The multitasking required can lead to incomplete, fragmented notes that miss crucial details.

The Magic of Our Solution 🌠

Enter magic.quill—not just a notetaker, but your all-in-one academic ally. magic.quill transcribes lectures in real-time, converting spoken words, slides, diagrams, and complex equations into organized, human-readable notes. Focus on learning—magic.quill captures every bit of knowledge, rendered beautifully in markdown and PDF, ready for easy review.


How magic.quill Works 🧙‍♂️

Magic.quill brings the magic with six key spells:

  1. 🗣️ Spell of Speech-to-Text: Accurate real-time transcription of lecture audio, so you’re always fully present.
  2. 📸 Spell of Visual Capture: Snap lecture slides, and magic.quill transcribes visual content into text.
  3. 🧮 Spell of Equation Rendering: Transform complex equations from images into LaTeX, preserving clarity for later study.
  4. 📊 Spell of Diagram Generation: Generate clear, structured diagrams from text to help visualize dense material.
  5. 🔤 Spell of Text-to-Speech: Has built-in narration functionality for those with vision impairments/disabilities.
  6. 📄 Export Spell: Summon your notes into markdown or PDF format, ready to go, anytime, anywhere.

Key Features 🪄

  • Real-Time, Hands-Free Notetaking: Set it, forget it, and focus on the lecture—magic.quill captures everything.
  • Markdown-Formatted Organization: Clean, readable notes structured in markdown for easy navigation.
  • Precision with STEM Content: Captures complex equations and diagrams effortlessly.
  • Flexible Exporting: Transform notes into markdown or PDF for review on any device.

Our Secret Spellbook 🔮

magic.quill’s tech stack:

  • Next.js: Fast, responsive UI with server-side rendering.
  • Tailwind CSS: Customizable, sleek styling for a user-friendly interface.
  • React Speech Recognition: Real-time, accurate lecture transcription.
  • OCR & LaTeX Renderer: Using Simpletex API to convert slides and equations into readable text and LaTeX.
  • Mermaid.js: Auto-generates diagrams and flowcharts.
  • Google Gemini: Using an LLM to semantically combine both image and audio transcripts into a cohesive note.

Next Steps on Our Journey ✨

  • magic.quill’s Evolution: We’re adding personalized features like tagging, highlighting, and generating summaries. Upcoming: multi-language support and advanced diagram options for more disciplines.
  • Get Involved: Try magic.quill, give feedback, and join us in redefining the future of academic engagement.

Why Choose magic.quill? 📚✨

magic.quill is not just another note app—it’s your dedicated study sidekick. Designed to take the burden off your shoulders, it gives you everything you need to thrive academically without ever having to worry about missing details or deciphering hastily scribbled notes.

📖 Experience Effortless Learning: Focus on the content while magic.quill takes care of the details.
🚀 Transform Your Study Sessions: Comprehensive, organized notes at your fingertips.
🌍 Join the Note Revolution: Together, let’s create a world where students focus on learning, leaving the documentation to their intelligent companion.

How to Run Next JS

This is a Next.js project bootstrapped with create-next-app.

Getting Started

First, run the development server:

npm run dev
# or
yarn dev
# or
pnpm dev
# or
bun dev

Open http://localhost:3000 with your browser to see the result.

You can start editing the page by modifying pages/index.js. The page auto-updates as you edit the file.

API routes can be accessed on http://localhost:3000/api/hello. This endpoint can be edited in pages/api/hello.js.

The pages/api directory is mapped to /api/*. Files in this directory are treated as API routes instead of React pages.

This project uses next/font to automatically optimize and load Geist, a new font family for Vercel.

Learn More

To learn more about Next.js, take a look at the following resources:

You can check out the Next.js GitHub repository - your feedback and contributions are welcome!

Deploy on Vercel

The easiest way to deploy your Next.js app is to use the Vercel Platform from the creators of Next.js.

Check out our Next.js deployment documentation for more details.

About

🥈2nd place winner - Notetaking powered by AI, speech to text, image to text, text to audio

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •