Skip to content

Releases: thiswillbeyourgithub/wdoc

Release 3.2.5

17 May 18:35
@thiswillbeyourgithub thiswillbeyourgithub
3.2.5
6740ea2
Compare
Choose a tag to compare
Release 3.2.5 Latest
Latest

What's new

This release brings several improvements to command-line argument handling and filetype detection, along with key bug fixes and build process enhancements.

✨ Features

  • CLI & Filetype Detection:
    • Enhanced handling of multiple implicit CLI arguments by utilizing a filetype detector to infer appropriate actions ([ab76610]).
    • Introduced a specific exception for clearer error reporting when filetypes cannot be inferred, including a new error for an undetectable filetype ([520f4ce], [39af223]).
  • Build Process:
    • Integrated sphinx-apidoc into the ReadTheDocs build process via a pre-build job in .readthedocs.yaml ([cc86c7b]).

🐛 Fixes

  • Corrected an issue with sys.argv handling that led to duplicated arguments ([e7cf185]).
  • Updated litellm dependency to resolve crashes experienced on Windows environments ([cfff0ac]), see #20.

🛠️ Improvements & Refactoring

  • Filetype Detection Internals:
    • Refactored filetype detection logic into a dedicated function for better modularity ([b453748]).
    • Added debug logging to the filetype detector to aid in troubleshooting ([05966c6]).
  • Code Quality:
    • Improved documentation by adding docstrings to custom exception classes ([8e6ca1a]).

Chores

  • Version bumped to 3.2.5 ([82b7f81]).

Commits details since the last release

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

wdoc/main.py

setup.py

.readthedocs.yaml

wdoc/main.py

wdoc/utils/batch_file_loader.py

wdoc/utils/batch_file_loader.py

wdoc/utils/errors.py

wdoc/utils/errors.py

wdoc/utils/batch_file_loader.py

Contributors

thiswillbeyourgithub
Assets 2
Loading

Release 3.2.4

15 May 14:55
@thiswillbeyourgithub thiswillbeyourgithub
3.2.4
ed7a9c7
Compare
Choose a tag to compare
Release 3.2.4

What's new

This release primarily focuses on significant documentation enhancements, crucial bug fixes for stability and build processes, and introduces updated dependencies and tokenization.

✨ New Features

  • Upgraded default token estimation to use gpt-4o-mini tokenizer, replacing gpt-3.5-turbo ([6d41817]).
  • Integrated the latest yt-dlp for YouTube downloads ([ab207b4]).
  • Environment variable documentation is now automatically added to the EnvDataclass class __doc__ ([ed9dd38]).

🐛 Bug Fixes

  • Resolved a crash on ReadTheDocs caused by missing yt-dlp dependency ([f5068a3]).
  • Fixed an issue where accessing env.__class__ on ReadTheDocs could cause a crash ([4e180f0]).
  • Corrected relative import paths in wdoc that were preventing Sphinx API documentation builds ([ade5930]).
  • Fixed issues with the Sphinx API command in the FAQ section of the README ([38008aa], [ff093a2]).
  • Ensured collapsible bars in documentation function correctly ([3cef833]).

📚 Documentation & Refinements

  • Extensive updates and fixes to Sphinx documentation generation and content:
    • Addressed outdated Sphinx documentation files ([90bde99]).
    • Improved API autodoc parameters for clearer documentation ([243de66]).
    • Excluded private and special members from documentation ([7abedd4]).
    • Added Sphinx command to FAQ in README ([1e6602e]) and removed private members from it ([11ae11b]).
    • Updated copyright year to 2025 ([bd7e3c5]).
  • Streamlined documentation structure and configuration:
    • Removed unused make files (Makefile, make.bat) for documentation ([07b0a7d]).
    • Removed unused argument for theme flyout display ([17bc5e6]).
    • Removed unused templates path ([6bffa20]) and CSS ([712df08]).
    • Removed duplicate README from the documentation source ([2b93162]).
    • Added a documentation table to the main index ([1dfe2b3]).

⚙️ Build & Chores

  • Bumped version to 3.2.4 ([ed7a9c7]).

Commits details since the last release

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

setup.py

docs/source/conf.py

wdoc/utils/env.py

docs/source/conf.py

wdoc/docs/help.md
wdoc/utils/env.py

docs/Makefile
docs/make.bat

docs/source/conf.py

README.md

README.md

docs/source/wdoc.rst
docs/source/wdoc.utils.batch_file_loader.rst
docs/source/wdoc.utils.customs.compressed_embeddings_cache.rst
docs/source/wdoc.utils.customs.fix_llm_caching.rst
docs/source/wdoc.utils.customs.rst
docs/source/wdoc.utils.embeddings.rst
docs/source/wdoc.utils.env.rst
docs/source/wdoc.utils.errors.rst
docs/source/wdoc.utils.flags.rst
docs/source/wdoc.utils.import_tricks.rst
docs/source/wdoc.utils.interact.rst
docs/source/wdoc.utils.llm.rst
docs/source/wdoc.utils.loaders.rst
docs/source/wdoc.utils.logger.rst
docs/source/wdoc.utils.misc.rst
docs/source/wdoc.utils.prompts.rst
docs/source/wdoc.utils.retrievers.rst
docs/source/wdoc.utils.rst
docs/source/wdoc.utils.tasks.query.rst
docs/source/wdoc.utils.tasks.rst
docs/source/wdoc.utils.tasks.summarize.rst
docs/source/wdoc.utils.typechecker.rst
docs/source/wdoc.wdoc.rst

README.md

wdoc/init.py
wdoc/main.py
wdoc/utils/init.py
wdoc/utils/batch_file_loader.py
wdoc/utils/customs/init.py
wdoc/utils/embeddings.py
wdoc/utils/env.py
wdoc/utils/import_tricks.py
wdoc/utils/interact.py
wdoc/utils/llm.py
wdoc/utils/loaders.py
wdoc/utils/logger.py
wdoc/utils/misc.py
wdoc/utils/prompts.py
wdoc/utils/retrievers.py
wdoc/utils/tasks/init.py
wdoc/utils/tasks/query.py
wdoc/utils/tasks/summarize.py
wdoc/utils/typechecker.py
wdoc/wdoc.py

README.md

docs/source/conf.py

docs/source/conf.py

docs/source/index.rst

docs/source/conf.py

docs/source/_static/custom.css
docs/source/conf.py

docs/source/index.rst

  • [6d41817] by @thiswillbeyourgithub, 25 hours ago:
    new: use gpt-4o-mini tokenizer by default to estimate tokens
    previously we used the ageing gpt-3.5-turbo

Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/docs/help.md
wdoc/utils/misc.py

setup.py

Contributors

thiswillbeyourgithub
Loading

Release 3.2.3

13 May 16:35
@thiswillbeyourgithub thiswillbeyourgithub
3.2.3
f62a232
Compare
Choose a tag to compare
Release 3.2.3

What's new

This release primarily focuses on enhancing context management for embedding models, improving debugging utilities, and updating documentation for better clarity. It also includes several important bug fixes and feature additions.

✨ Features

  • Introduced a new environment variable WDOC_MAX_EMBED_CONTEXT to allow capping the context size for embedding models ([d9e200f8])
    • Documentation for this new variable has been added ([a2408fd0])
  • Enhanced debugging by ensuring debug prints are always active when md_printer is used. This helps in retrieving LLM answers from logs if they weren't saved to a file ([69db1916])
  • Added the current date to summary metadata and headers to help reduce potential LLM hallucinations ([64ca4665])

🐛 Fixes

  • Text Splitting & Context Handling:
    • Addressed an issue where large language models have more context than embedding models by setting a max_tokens limit for the text splitter ([dac6802d])
    • Fixed an edge case where the wdoc max chunk setting could be ignored ([196b3a00])
    • Corrected an old variable name within the text splitting logic ([767bc754])
  • Updated the default model to gemini 2.5 preview to reflect its renaming on OpenRouter ([22978609])
  • Improved the mechanism for ignoring initial "breathing" or placeholder lines in summaries ([4dbcf158])

📚 Documentation

  • Clarity and Enhancements:
    • Clarified the usage of save and load functionalities ([9d9642d4]) and specifically advised against using them simultaneously ([5270c350])
    • Made multiple clarifications to the README for better understanding ([9284ff54], [cb4cb519], [f677e5a2], [39e0da55])
    • Updated Ollama examples to recommend snowflake-arctic-embed2 instead of bge-m3 ([d045702b])
    • Added documentation for the WDOC_MAX_EMBED_CONTEXT environment variable ([a2408fd0])
  • Removed a documentation file (summary_rag.md) that was not yet ready for release ([6d20c220])

⚙️ Chore & Maintenance

  • Version bumped to 3.2.3 (following an earlier bump to 3.2.2 [[71ac503c]]) ([f62a2322])
  • README Updates:
    • Updated TODO items ([8f2cbfd7], [5d090421])
    • Added a PyPI badge for better project visibility ([60ef4112])

Commits details since the last release

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

summary_rag.md

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

README.md

  • [69db191] by @thiswillbeyourgithub, 40 minutes ago:
    new: now debug print is used anyway when md_printer is used
    this is to make you able to go to the logs to fetch and answer form the
    LLM if you have forgotten to store it to a file

Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/utils/logger.py
wdoc/wdoc.py

wdoc/docs/help.md

wdoc/utils/env.py
wdoc/utils/misc.py

wdoc/utils/misc.py

wdoc/utils/misc.py

wdoc/utils/misc.py

  • [2297860] by @thiswillbeyourgithub, 86 minutes ago:
    fix: set default model to gemini 2.5 preview without date timestamp
    openrouter renamed that model apparently

Signed-off-by: thiswillbeyourgithub [email protected]

README.md
wdoc/utils/env.py

wdoc/docs/help.md

wdoc/docs/help.md

wdoc/docs/examples.md

README.md

README.md

README.md

README.md

README.md

README.md

wdoc/wdoc.py

wdoc/utils/tasks/summarize.py

Contributors

thiswillbeyourgithub
Loading

Release 3.2.1

03 May 17:08
@thiswillbeyourgithub thiswillbeyourgithub
3.2.1
03aeab2
Compare
Choose a tag to compare
Release 3.2.1

What's new

This small patch release primarily focuses on integrating OpenRouter for model pricing/metadata and refining cost calculations.

✨ Features

  • Set default models to use OpenRouter ([915699c]).
  • Fetch model prices and metadata automatically from OpenRouter, improving reliability ([7f840b7]).

🐛 Fixes & Enhancements

  • Much improved price calculation and handling:
    • Reworked computation to account for internal thinking costs ([c0b90d8]).
    • Enhanced method for retrieving model prices, supported parameters and maximum context size ([a17b41c]).
    • Clearer error message when model prices are missing ([2b29a9d]).
  • Updated litellm dependency ([179b589]).

🧪 Tests

  • API integration tests now fail faster if an underlying API call fails ([9a0c856]).

Commits details since the last release

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

README.md
wdoc/utils/env.py

wdoc/utils/llm.py
wdoc/utils/misc.py
wdoc/utils/tasks/summarize.py
wdoc/wdoc.py

wdoc/utils/misc.py
wdoc/wdoc.py

tests/run_all_tests.sh

wdoc/utils/misc.py
wdoc/wdoc.py

wdoc/utils/misc.py

setup.py

Contributors

thiswillbeyourgithub
Loading

Release 3.2.0

03 May 14:05
@thiswillbeyourgithub thiswillbeyourgithub
3.2.0
7d69d79
Compare
Choose a tag to compare
Release 3.2.0

What's new

This release focuses on improving the command-line interface (especially handling piped input/output), enhancing language model interactions (switching defaults, better caching, Ollama support), and increasing overall stability through numerous bug fixes and testing improvements.

✨ Features

  • Added arguments to set specific keyword arguments (kwargs) for language models (--model_kwargs, --query_eval_model_kwargs) ([1392553]).
  • Introduced WDOC_LLM_REQUEST_TIMEOUT environment variable for LLM request timeouts (default 600s), useful for Ollama ([ec3c0c5]).
  • Switched default models from Claude Sonnet/Haiku to Gemini 1.5 Pro/Flash ([82ef10d]).
  • Unified LLM handling to primarily use ChatLiteLLM, removing direct ChatOpenAI usage ([30a0f0c]).
  • Enabled cost tracking for queries, storing the cost in the output ([e7753af]).
  • Added automatic download of nltk punkt tokenizer during post-installation ([44f5bf8]).
  • Overhauled Command Line Interface (CLI) argument parsing for wdoc and wdoc parse using fire ([7c51ed2], [2f4748d]).
  • Removed the --pipe argument, relying on automatic stdin/stdout detection ([b03e79a], [2e6c1dd], [838f164]).
  • Removed the separate wdoc_parse_file entry point; use wdoc parse instead ([2e878d2]).
  • Added a new script media_url_finder.py ([beaf8fa]).

🐛 Fixes

  • LLM PLACEHOLDER Caching:
    • Resolved issues with LLM caching, including invalidation when kwargs change and LangChain's SQLite cache ([cb785da], [3e3e753]).
    • Fixed edge cases in thinking block parsing for models like Gemini and updated tags (<thinking> -> <think>) ([e111bdb], [d0ae21a], [ca9245b], [99ed332]).
    • Corrected underflow errors in cost calculation due to low LLM prices ([3f18f5d], [95a1984]).
    • Addressed issues specific to Ollama: API key requirement relaxation, price assumption (zero), litellm naming (ollama_chat -> ollama), and context window estimation ([d2f92a3], [5784b25], [43c6340], [c3c15e1]).
    • Fixed handling of testing/testing models and associated parameters ([b995197], [91b5e67], [7cf840c], [9a7b95b]).
    • Fixed query_retrievers parsing ([02d7412]).
    • Pinned litellm version for stability ([1b17c78]).
  • CLI PLACEHOLDER Piping:
    • Improved detection and handling of piped input/output ([2e6c1dd], [509626a], [db2fa0f]).
    • Fixed crashes and hangs when using pipes, especially with long inputs or specific test commands ([f59f34b], [414de8d], [b95b125], [826e7aa], [b6f7fd7], [177be6b]).
    • Corrected argument parsing issues affecting the --help command ([c909337]).
    • Ensured logs are not colorized and Markdown rendering is disabled when outputting to a pipe ([f1d63cd], [fe2665c]).
    • Fixed issues where debug prints or warnings were incorrectly suppressed or handled ([64fcd60], [a7724ff]).
  • General:

🧪 Testing

  • Improved test setup for caching, using separate directories and disabling cache where necessary ([9104f86], [89f4859], [085a87e], [6935fe7]).
  • Added tests for OpenRouter/default models, piping functionality, summary/query tasks with testing models, and environment variable handling ([06e35b0], [bbb8371], [caae34c], [cb9d237], [eaafafd], [1f835eb]).
  • Refactored pipe tests to use subprocess explicitly and fixed related issues (stderr redirection, pytest capture, shell usage) ([38a3571], [7f3249a], [573acf9]). (Note: Some pipe tests were later commented out ([45cf419])).

⚡ Enhancements

  • Reworked logic for detecting and modifying model parameters based on the task ([564c4f9]).
  • Improved load_media function to handle online media more robustly by finding and clicking appropriate buttons ([049c9cb], [67772f8], [c5828d3]).
  • Added checks to prevent exceeding total token limits during summarization ([9bdcabc]).
  • Refined logging levels and Markdown printing logic ([edfec82], [4ca394c], [895a60f]).

📚 Documentation

⚙️ Build PLACEHOLDER Chore

Commits details since the last release

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

  • [30a0f0c] by @thiswillbeyourgithub, 24 minutes ago:
    new: stop using both ChatOpenAI and ChatLiteLLM
    ChatLiteLLM seems to now work reliably

Signed-off-by: thiswillbeyourgithub [email protected]

tests/test_wdoc.py
wdoc/docs/help.md
wdoc/utils/llm.py
wdoc/utils/retrievers.py
wdoc/utils/tasks/query.py

tests/conftest.py

wdoc/utils/misc.py

.gitignore

tests/test_wdoc.py
wdoc/utils/misc.py

wdoc/utils/tasks/summarize.py
wdoc/wdoc.py

wdoc/wdoc.py

wdoc/utils/llm.py

wdoc/wdoc.py

wdoc/wdoc.py

tests/test_wdoc.py

wdoc/utils/customs/fix_llm_caching.py

wdoc/docs/help.md
wdoc/utils/llm.py

wdoc/docs/help.md

tests/test_wdoc.py

wdoc/wdoc.py

  • [d0ae21a] by @thiswillbeyourgithub, 2 hours ago:
    fix: reworked and improved how thinking_answer_parser works
    some weak models could fail despite usable results

Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/utils/misc.py

Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/utils/misc.py

wdoc/utils/misc.py
wdoc/utils/prompts.py
wdoc/utils/tasks/query.py

tests/test_wdoc.py
...

Read more

Contributors

thiswillbeyourgithub
Loading

Release 3.1.0

18 Apr 13:19
@thiswillbeyourgithub thiswillbeyourgithub
3.1.0
e93dcad
Compare
Choose a tag to compare
Release 3.1.0

What's new

This release primarily focuses on enhancing logging capabilities and fixing issues related to piping behavior.

Version bump to 3.1.0 ([e93dcad6]).

✨ New Features

  • Logging:
    • Always display the default log location ([2fe2c431]).
    • Set log level to debug for log files and critical when used in a pipe ([130058a1]).

🚀 Enhancements

  • Logging:
    • Improved log format ([61465aff], [dc06ccfd]).
    • Increased probability of early logger initialization ([01f01ac7]).
    • Clearer error messages from python-magic ([c846dafa]).

🐛 Fixes

  • Piping:
    • Resolved confusion between input and output during piping ([e175b7d5]).
    • Corrected initialization of is_piped variable ([e4532d30]).
  • Logging & Environment:
    • Fixed default handler issue in logger ([43c859dd]).
    • Prevented potential crash related to environment variable handling ([d3b1e2bc]).

🧹 Minor Changes

  • Removed unused imports ([f3c05962]).
  • Adjusted test imports structure ([69738119]).
  • Removed commented code ([86b51102]).
  • Removed unused disable_md_printing argument ([b3af430e]).

✅ Testing

  • Added test for exception handling ([dfbfad54]).
  • Added environment variable tests ([0fba8a13]).

Commits details since the last release

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

wdoc/utils/batch_file_loader.py
wdoc/utils/env.py
wdoc/utils/loaders.py
wdoc/utils/logger.py
wdoc/utils/misc.py
wdoc/wdoc.py

wdoc/docs/help.md
wdoc/wdoc.py

wdoc/utils/logger.py

wdoc/utils/logger.py

wdoc/utils/logger.py

wdoc/utils/env.py
wdoc/utils/misc.py

wdoc/init.py
wdoc/main.py

wdoc/utils/logger.py

wdoc/utils/logger.py

wdoc/utils/logger.py

wdoc/utils/logger.py

wdoc/utils/env.py
wdoc/utils/logger.py

tests/test_wdoc.py

tests/test_wdoc.py

tests/test_wdoc.py

wdoc/utils/env.py

wdoc/utils/loaders.py

Contributors

thiswillbeyourgithub
Loading

Release 3.0.2

18 Apr 10:13
@thiswillbeyourgithub thiswillbeyourgithub
3.0.2
504b5c9
Compare
Choose a tag to compare
Release 3.0.2

What's new

Fixes

  • Error Message Stability
    • Fixed a crash caused by error messages in batch file loader
      • Files affected:
        • wdoc/utils/batch_file_loader.py
        • wdoc/utils/loaders.py
    • Commit hash: [4af7dc6]
    • Author: @thiswillbeyourgithub

Version Bump

  • Version Update
    • Updated version from 3.0.1 to 3.0.2 for better stability and minor enhancements
      • Files affected for version bump:
        • bumpver.toml
        • docs/source/conf.py
        • setup.py
        • wdoc/wdoc.py
    • Commit hash: [504b5c9]
    • Author: @thiswillbeyourgithub

Note

These updates aim to enhance overall functionality and prevent errors from causing interrupts, ensuring a smoother user experience. The version bump signifies an incremental improvement with significant internal fixes.

Commits details since the last release

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

wdoc/utils/batch_file_loader.py
wdoc/utils/loaders.py

Contributors

thiswillbeyourgithub
Loading

Release 3.0.1

18 Apr 10:07
@thiswillbeyourgithub thiswillbeyourgithub
3.0.1
3341823
Compare
Choose a tag to compare
Release 3.0.1

What's new

Version 3.0.1 - April 18, 2025

Chores Housekeeping

Bug Fixes

  • Error Message Fix:

Documentation

  • Companion Tool Mention:

Testing

  • Test Script Modification:

Commits details since the last release

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

wdoc/utils/loaders.py

README.md

tests/run_all_tests.sh

Contributors

thiswillbeyourgithub
Loading

Release 3.0.0

16 Apr 16:56
@thiswillbeyourgithub thiswillbeyourgithub
3.0.0
9a57251
Compare
Choose a tag to compare
Release 3.0.0

What's new

  • Version Update 3.0.0
  • Environment Variable Handling
    • Completely revamped the approach to handling environment variables.
  • Logging Improvements
    • Integrated loguru for more comprehensive logging.
    • Altered default log level based on debug status.

Enhancements

  • Documentation and Scripts
    • Updated README and other documentation to reflect recent changes.
    • Improved test scripts for more efficient testing.
  • Code Optimization
    • Streamlined environment variable checking for redundancy optimization.
    • Various small optimizations across multiple files led to better semantic batch handling.

Commits details since the last release

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

tests/run_all_tests.sh

README.md

wdoc/utils/env.py
wdoc/wdoc.py

wdoc/main.py

wdoc/utils/env.py

wdoc/utils/env.py

wdoc/utils/logger.py

wdoc/main.py

wdoc/docs/help.md
wdoc/utils/init.py
wdoc/utils/batch_file_loader.py
wdoc/utils/embeddings.py
wdoc/utils/env.py
wdoc/utils/flags.py
wdoc/utils/llm.py
wdoc/utils/loaders.py
wdoc/utils/misc.py
wdoc/utils/tasks/query.py
wdoc/wdoc.py

wdoc/utils/env.py

wdoc/docs/help.md

wdoc/wdoc.py

wdoc/utils/logger.py
wdoc/utils/misc.py
wdoc/wdoc.py

wdoc/utils/logger.py

wdoc/main.py
wdoc/utils/batch_file_loader.py
wdoc/utils/embeddings.py
wdoc/utils/interact.py
wdoc/utils/llm.py
wdoc/utils/loaders.py
wdoc/utils/logger.py
wdoc/utils/misc.py
wdoc/utils/prompts.py
wdoc/utils/tasks/query.py
wdoc/utils/tasks/summarize.py
wdoc/wdoc.py

wdoc/utils/batch_file_loader.py

tests/test_wdoc.py

wdoc/utils/batch_file_loader.py
wdoc/utils/loaders.py
wdoc/utils/misc.py

wdoc/utils/tasks/summarize.py

tests/run_all_tests.sh

tests/test_wdoc.py

tests/test_wdoc.py

wdoc/utils/env.py

README.md

scripts/AnkiFiltered/AnkiFilteredDeckCreator.py

wdoc/utils/embeddings.py

wdoc/utils/env.py
wdoc/utils/misc.py

wdoc/utils/misc.py

wdoc/utils/batch_file_loader.py
wdoc/utils/import_tricks.py
wdoc/utils/llm.py
wdoc/utils/loaders.py
wdoc/utils/misc.py
wdoc/utils/tasks/query.py
wdoc/utils/typechecker.py
wdoc/wdoc.py

wdoc/utils/interact.py
wdoc/utils/logger.py

wdoc/utils/flags.py

wdoc/init.py

wdoc/utils/env.py
wdoc/utils/errors.py

README.md
wdoc/docs/help.md
wdoc/wdoc.py

wdoc/docs/help.md

README.md

README.md

Read more

Contributors

thiswillbeyourgithub
Loading

Release 2.9.0

17 Mar 19:25
@thiswillbeyourgithub thiswillbeyourgithub
2.9.0
dd06e9c
Compare
Choose a tag to compare
Release 2.9.0

What's new

New Features

  • Shell Command Testing
    • Added shell command test for NYTimes parsing with content validation. [d3832f2]

Fixes

  • Intermediate Merging
    • Fixed error during batch merging, ensuring intermediate answers are handled properly when too large. [d06cbb3]
    • Improved logic for retry attempts during batch merging. [573e15f]
  • Parsing Reliability
    • Prevent return of intermediately parsed output on parsing failure. [78c9364]
    • Adapted handling to retry when encountering unparseable output or finish_reason=length. [763e9b4]
  • Backend and Output
    • Resolved backend errors and edge case issues breaking summary generation. [bf00ced, 89c01de]
    • Corrected handling of test outputs to avoid crashing in specific import modes. [ee416ec]
  • Testing Corrections
    • Corrected various test functions and ensured expected outcomes align with API changes. [bfcba71, 89c01de, 292ce90]

Documentation

  • General Updates
    • Enhanced walkthrough formatting for improved readability in documentation. [2ec7fad]
    • Provided context about the origins of wdoc in README. [31e6c5d]
  • Example and Help Docs
    • Updated examples documentation to remove confusing import_mode arguments. [cef5cdf]
    • Improved query and summary help documentation to reflect recent changes. [a289759, f1a6294]

Improvements

  • Configuration and Setup Adjustments
    • Simplified the post-install script to handle dependencies via uv if present. [7a55143, 4ed0a35]
  • Performance and Debugging Enhancements
    • Bumped max_tokens for intermediate answers to accommodate larger outputs during processing. [df059b6]
    • Stored original strings before parsing for effective debugging. [6ec3957]
    • Addressed deprecation warnings to keep up with latest standards. [15e4793]

Minor Changes

  • Code and Debug Tune-ups
    • Streamlined testing arguments and outputs for precise validation. [7e5e4ce, b7f1a1f, d79b4c5]
    • Fine-tuned post-install scripts and functional debug outputs for better clarity. [d620f87]
  • Enhanced wdoc Docs Via SVG Files (WIP)
    • Create SVG diagram and documentation for summary algorithm. [b5f49a9]
    • Added SVG visualization and improved design and intuitive flow representation for better understanding. [9489a8a, 703dde0]

Commits details since the last release

  • [d06cbb3] by @thiswillbeyourgithub, 34 minutes ago:
    fix: error when merging batch when intermediate answers got so large the model can't merge them anymore
    We just concatennate them using semantic order and that will be good
    enough, the alternative is too expensive

Signed-off-by: thiswillbeyourgithub [email protected]

wdoc/wdoc.py

wdoc/wdoc.py

wdoc/utils/misc.py

wdoc/wdoc.py

wdoc/utils/misc.py

wdoc/utils/misc.py

wdoc/wdoc.py

tests/test_wdoc.py

wdoc/docs/examples.md

tests/test_wdoc.py

wdoc/wdoc.py

tests/test_wdoc.py

README.md
scripts/AnkiFiltered/AnkiFilteredDeckCreator.py
scripts/TheFiche/TheFiche.py
tests/test_wdoc.py
wdoc/main.py
wdoc/docs/help.md
wdoc/wdoc.py

wdoc/wdoc.py

wdoc/utils/tasks/query.py

tests/test_wdoc.py

tests/test_wdoc.py

tests/test_wdoc.py

tests/test_wdoc.py

tests/test_wdoc.py

tests/test_wdoc.py

tests/test_wdoc.py

tests/test_wdoc.py

tests/test_wdoc.py

tests/test_wdoc.py

tests/test_wdoc.py

wdoc/wdoc.py

wdoc/wdoc.py

wdoc/docs/help.md
wdoc/wdoc.py

wdoc/wdoc.py

wdoc/wdoc.py

README.md

wdoc/docs/examples.md

README.md

README.md

Read more

Contributors

thiswillbeyourgithub
Loading