Using VLLM (like GPT-4o) to parse PDF into markdown.
Our approach is very simple (only 293 lines of code), but can almost perfectly parse typography, math formulas, tables, pictures, charts, etc.
Average price per page: $0.013
This package use GeneralAgent lib to interact with OpenAI API.
- 使用 PyMuPDF 库,对 PDF 进行解析出所有非文本区域,并做好标记,比如:
- 使用视觉大模型(如 GPT-4o)进行解析,得到 markdown 文件。
See examples/attention_is_all_you_need/output.md for PDF examples/attention_is_all_you_need.pdf.
pip install gptpdf
from gptpdf import parse_pdf
api_key = 'Your OpenAI API Key'
content, image_paths = parse_pdf(pdf_path, api_key=api_key)
print(content)
See more in test/test.py
parse_pdf(pdf_path, output_dir='./', api_key=None, base_url=None, model='gpt-4o', verbose=False)
parse pdf file to markdown file, and return markdown content and all image paths.
-
pdf_path: pdf file path
-
output_dir: output directory. store all images and markdown file
-
api_key: OpenAI API Key (optional). If not provided, Use OPENAI_API_KEY environment variable.
-
base_url: OpenAI Base URL. (optional). If not provided, Use OPENAI_BASE_URL environment variable.
-
model: OpenAI Vison LLM Model, default is 'gpt-4o'. You also can use qwen-vl-max
-
verbose: verbose mode