Code

Document parsing module#3

Code

Draft

du-phan wants to merge 24 commits intomaindu-phan/sequestrae-engine:mainfrom feat/document-parsingdu-phan/sequestrae-engine:feat/document-parsingCopy head branch name to clipboard

+4,521-340

Commits

Commits on Jan 22, 2025

• add module to parse pdf to markdown

  du-phan

  committed
  44f0134

  Copy full SHA for 44f0134

• add cli command for the pdf parsing

  du-phan

  committed
  be2e189

  Copy full SHA for be2e189

• update dependencies

  du-phan

  committed
  0465148

  Copy full SHA for 0465148

• add parsed documents

  du-phan

  committed
  e6f3f92

  Copy full SHA for e6f3f92

Commits on Jan 23, 2025

• add extractor using mistral

  du-phan

  committed
  b18a956

  Copy full SHA for b18a956

• update github action

  du-phan

  committed
  3a9f98c

  Copy full SHA for 3a9f98c

• add cli for extractor

  du-phan

  committed
  7453bd4

  Copy full SHA for 7453bd4

Commits on Jan 24, 2025

• add tool to populate supabase

  du-phan

  committed
  65e07d8

  Copy full SHA for 65e07d8

Commits on Jan 25, 2025

• add functions to evaluate feedstock sustainability

  du-phan

  committed
  0297b05

  Copy full SHA for 0297b05

• cleaner logging

  du-phan

  committed
  857aba1

  Copy full SHA for 857aba1

• check if file exists first before doing anything

  du-phan

  committed
  f8efebf

  Copy full SHA for f8efebf

Commits on Jan 26, 2025

• add cli command to populate supabase with feedstock evaluation

  du-phan

  committed
  4e8a474

  Copy full SHA for 4e8a474

• updated data

  du-phan

  committed
  1c320c9

  Copy full SHA for 1c320c9

Commits on Feb 3, 2025

• add function to parse the whole folder at once

  du-phan

  committed
  7702e58

  Copy full SHA for 7702e58

• add sequestrae due diligence criteria

  du-phan

  committed
  a2470e4

  Copy full SHA for a2470e4

Commits on Feb 4, 2025

• add cli command for due diligence analyzer

  du-phan

  committed
  69a9ba5

  Copy full SHA for 69a9ba5

Commits on Feb 7, 2025

• move from llama to gemini

  du-phan

  committed
  b3d8884

  Copy full SHA for b3d8884

• Removed project_data directory from repository tracking

  du-phan

  committed
  9c96df4

  Copy full SHA for 9c96df4

Commits on Feb 10, 2025

• add hallucination detection promp

  du-phan

  committed
  cdbd2d1

  Copy full SHA for cdbd2d1

• add function to validate and fix the json array

  du-phan

  committed
  c96ba5a

  Copy full SHA for c96ba5a

• fix an error in the fix_hallucination_recursive function that leads to json format issue

  du-phan

  committed
  9014f9b

  Copy full SHA for 9014f9b

• update .gitignore

  du-phan

  committed
  a97343b

  Copy full SHA for a97343b

• fix minor error with the value to return in fix_hallucination_recursive

  du-phan

  committed
  77795c1

  Copy full SHA for 77795c1

Commits on Feb 11, 2025

• add retry on error decorator

  du-phan

  committed
  f18c6cc

  Copy full SHA for f18c6cc