Python2/PyMuPDF: src/table.py annotate

annotate src/table.py @ 46:7ee69f120f19 default tip

>>>>> tag v1.26.5+1 for changeset b74429b0f5c4

author	Franz Glasner <fzglas.hg@dom66.de>
date	Sat, 11 Oct 2025 17:17:30 +0200
parents	1d09e1dec1d9
children

rev	line source
1 1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2 Copyright (C) 2023 Artifex Software, Inc.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	3
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	4 This file is part of PyMuPDF.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	5
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	6 PyMuPDF is free software: you can redistribute it and/or modify it under the
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	7 terms of the GNU Affero General Public License as published by the Free
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	8 Software Foundation, either version 3 of the License, or (at your option)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	9 any later version.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	10
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	11 PyMuPDF is distributed in the hope that it will be useful, but WITHOUT ANY
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	12 WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	13 FOR A PARTICULAR PURPOSE. See the GNU Affero General Public License for more
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	14 details.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	15
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	16 You should have received a copy of the GNU Affero General Public License
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	17 along with MuPDF. If not, see <https://www.gnu.org/licenses/agpl-3.0.en.html>
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	18
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	19 Alternative licensing terms are available from the licensor.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	20 For commercial licensing, see <https://www.artifex.com/> or contact
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	21 Artifex Software, Inc., 39 Mesa Street, Suite 108A, San Francisco,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	22 CA 94129, USA, for further information.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	23
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	24 ---------------------------------------------------------------------
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	25 Portions of this code have been ported from pdfplumber, see
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	26 https://pypi.org/project/pdfplumber/.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	27
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	28 The ported code is under the following MIT license:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	29
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	30 ---------------------------------------------------------------------
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	31 The MIT License (MIT)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	32
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	33 Copyright (c) 2015, Jeremy Singer-Vine
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	34
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	35 Permission is hereby granted, free of charge, to any person obtaining a copy
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	36 of this software and associated documentation files (the "Software"), to deal
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	37 in the Software without restriction, including without limitation the rights
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	38 to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	39 copies of the Software, and to permit persons to whom the Software is
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	40 furnished to do so, subject to the following conditions:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	41
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	42 The above copyright notice and this permission notice shall be included in all
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	43 copies or substantial portions of the Software.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	44
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	45 THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	46 IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	47 FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	48 AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	49 LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	50 OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	51 SOFTWARE.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	52 ---------------------------------------------------------------------
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	53 Also see here: https://github.com/jsvine/pdfplumber/blob/stable/LICENSE.txt
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	54 ---------------------------------------------------------------------
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	55
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	56 The porting mainly pertains to files "table.py" and relevant parts of
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	57 "utils/text.py" within pdfplumber's repository on Github.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	58 With respect to "text.py", we have removed functions or features that are not
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	59 used by table processing. Examples are:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	60
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	61 * the text search function
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	62 * simple text extraction
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	63 * text extraction by lines
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	64
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	65 Original pdfplumber code does neither detect, nor identify table headers.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	66 This PyMuPDF port adds respective code to the 'Table' class as method '_get_header'.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	67 This is implemented as new class TableHeader with the properties:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	68 * bbox: A tuple for the header's bbox
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	69 * cells: A tuple for each bbox of a column header
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	70 * names: A list of strings with column header text
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	71 * external: A bool indicating whether the header is outside the table cells.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	72
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	73 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	74
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	75 import inspect
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	76 import itertools
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	77 import string
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	78 import html
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	79 from collections.abc import Sequence
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	80 from dataclasses import dataclass
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	81 from operator import itemgetter
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	82 import weakref
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	83
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	84 # -------------------------------------------------------------------
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	85 # Start of PyMuPDF interface code
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	86 # -------------------------------------------------------------------
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	87 from . import (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	88 Rect,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	89 Matrix,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	90 TEXTFLAGS_TEXT,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	91 TEXT_FONT_BOLD,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	92 TEXT_FONT_ITALIC,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	93 TEXT_FONT_MONOSPACED,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	94 TEXT_FONT_SUPERSCRIPT,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	95 TEXT_COLLECT_STYLES,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	96 TOOLS,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	97 EMPTY_RECT,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	98 sRGB_to_pdf,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	99 Point,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	100 message,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	101 mupdf,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	102 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	103
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	104 EDGES = [] # vector graphics from PyMuPDF
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	105 CHARS = [] # text characters from PyMuPDF
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	106 TEXTPAGE = None
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	107 TEXT_BOLD = mupdf.FZ_STEXT_BOLD
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	108 TEXT_STRIKEOUT = mupdf.FZ_STEXT_STRIKEOUT
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	109 FLAGS = TEXTFLAGS_TEXT \| TEXT_COLLECT_STYLES
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	110
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	111 white_spaces = set(string.whitespace) # for checking white space only cells
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	112
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	113
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	114 def extract_cells(textpage, cell, markdown=False):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	115 """Extract text from a rect-like 'cell' as plain or MD style text.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	116
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	117 This function should ultimately be used to extract text from a table cell.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	118 Markdown output will only work correctly if extraction flag bit
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	119 TEXT_COLLECT_STYLES is set.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	120
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	121 Args:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	122 textpage: A PyMuPDF TextPage object. Must have been created with
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	123 TEXTFLAGS_TEXT \| TEXT_COLLECT_STYLES.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	124 cell: A tuple (x0, y0, x1, y1) defining the cell's bbox.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	125 markdown: If True, return text formatted for Markdown.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	126
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	127 Returns:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	128 A string with the text extracted from the cell.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	129 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	130 text = ""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	131 for block in textpage.extractRAWDICT()["blocks"]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	132 if block["type"] != 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	133 continue
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	134 block_bbox = block["bbox"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	135 if (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	136 0
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	137 or block_bbox[0] > cell[2]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	138 or block_bbox[2] < cell[0]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	139 or block_bbox[1] > cell[3]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	140 or block_bbox[3] < cell[1]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	141 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	142 continue # skip block outside cell
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	143 for line in block["lines"]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	144 lbbox = line["bbox"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	145 if (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	146 0
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	147 or lbbox[0] > cell[2]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	148 or lbbox[2] < cell[0]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	149 or lbbox[1] > cell[3]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	150 or lbbox[3] < cell[1]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	151 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	152 continue # skip line outside cell
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	153
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	154 if text: # must be a new line in the cell
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	155 text += "<br>" if markdown else "\n"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	156
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	157 # strikeout detection only works with horizontal text
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	158 horizontal = line["dir"] == (0, 1) or line["dir"] == (1, 0)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	159
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	160 for span in line["spans"]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	161 sbbox = span["bbox"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	162 if (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	163 0
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	164 or sbbox[0] > cell[2]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	165 or sbbox[2] < cell[0]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	166 or sbbox[1] > cell[3]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	167 or sbbox[3] < cell[1]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	168 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	169 continue # skip spans outside cell
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	170
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	171 # only include chars with more than 50% bbox overlap
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	172 span_text = ""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	173 for char in span["chars"]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	174 bbox = Rect(char["bbox"])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	175 if abs(bbox & cell) > 0.5 * abs(bbox):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	176 span_text += char["c"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	177
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	178 if not span_text:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	179 continue # skip empty span
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	180
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	181 if not markdown: # no MD styling
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	182 text += span_text
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	183 continue
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	184
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	185 prefix = ""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	186 suffix = ""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	187 if horizontal and span["char_flags"] & TEXT_STRIKEOUT:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	188 prefix += "~~"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	189 suffix = "~~" + suffix
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	190 if span["char_flags"] & TEXT_BOLD:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	191 prefix += "**"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	192 suffix = "**" + suffix
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	193 if span["flags"] & TEXT_FONT_ITALIC:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	194 prefix += "_"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	195 suffix = "_" + suffix
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	196 if span["flags"] & TEXT_FONT_MONOSPACED:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	197 prefix += "`"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	198 suffix = "`" + suffix
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	199
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	200 if len(span["chars"]) > 2:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	201 span_text = span_text.rstrip()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	202
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	203 # if span continues previous styling: extend cell text
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	204 if (ls := len(suffix)) and text.endswith(suffix):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	205 text = text[:-ls] + span_text + suffix
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	206 else: # append the span with new styling
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	207 if not span_text.strip():
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	208 text += " "
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	209 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	210 text += prefix + span_text + suffix
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	211
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	212 return text.strip()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	213
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	214
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	215 # -------------------------------------------------------------------
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	216 # End of PyMuPDF interface code
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	217 # -------------------------------------------------------------------
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	218
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	219
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	220 class UnsetFloat(float):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	221 pass
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	222
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	223
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	224 NON_NEGATIVE_SETTINGS = [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	225 "snap_tolerance",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	226 "snap_x_tolerance",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	227 "snap_y_tolerance",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	228 "join_tolerance",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	229 "join_x_tolerance",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	230 "join_y_tolerance",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	231 "edge_min_length",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	232 "min_words_vertical",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	233 "min_words_horizontal",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	234 "intersection_tolerance",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	235 "intersection_x_tolerance",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	236 "intersection_y_tolerance",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	237 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	238
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	239
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	240 TABLE_STRATEGIES = ["lines", "lines_strict", "text", "explicit"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	241 UNSET = UnsetFloat(0)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	242 DEFAULT_SNAP_TOLERANCE = 3
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	243 DEFAULT_JOIN_TOLERANCE = 3
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	244 DEFAULT_MIN_WORDS_VERTICAL = 3
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	245 DEFAULT_MIN_WORDS_HORIZONTAL = 1
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	246 DEFAULT_X_TOLERANCE = 3
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	247 DEFAULT_Y_TOLERANCE = 3
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	248 DEFAULT_X_DENSITY = 7.25
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	249 DEFAULT_Y_DENSITY = 13
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	250 bbox_getter = itemgetter("x0", "top", "x1", "bottom")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	251
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	252
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	253 LIGATURES = {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	254 "ﬀ": "ff",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	255 "ﬃ": "ffi",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	256 "ﬄ": "ffl",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	257 "ﬁ": "fi",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	258 "ﬂ": "fl",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	259 "ﬆ": "st",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	260 "ﬅ": "st",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	261 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	262
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	263
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	264 def to_list(collection) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	265 if isinstance(collection, list):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	266 return collection
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	267 elif isinstance(collection, Sequence):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	268 return list(collection)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	269 elif hasattr(collection, "to_dict"):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	270 res = collection.to_dict("records") # pragma: nocover
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	271 return res
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	272 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	273 return list(collection)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	274
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	275
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	276 class TextMap:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	277 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	278 A TextMap maps each unicode character in the text to an individual `char`
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	279 object (or, in the case of layout-implied whitespace, `None`).
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	280 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	281
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	282 def __init__(self, tuples=None) -> None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	283 self.tuples = tuples
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	284 self.as_string = "".join(map(itemgetter(0), tuples))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	285
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	286 def match_to_dict(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	287 self,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	288 m,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	289 main_group: int = 0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	290 return_groups: bool = True,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	291 return_chars: bool = True,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	292 ) -> dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	293 subset = self.tuples[m.start(main_group) : m.end(main_group)]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	294 chars = [c for (text, c) in subset if c is not None]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	295 x0, top, x1, bottom = objects_to_bbox(chars)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	296
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	297 result = {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	298 "text": m.group(main_group),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	299 "x0": x0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	300 "top": top,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	301 "x1": x1,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	302 "bottom": bottom,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	303 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	304
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	305 if return_groups:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	306 result["groups"] = m.groups()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	307
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	308 if return_chars:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	309 result["chars"] = chars
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	310
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	311 return result
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	312
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	313
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	314 class WordMap:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	315 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	316 A WordMap maps words->chars.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	317 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	318
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	319 def __init__(self, tuples) -> None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	320 self.tuples = tuples
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	321
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	322 def to_textmap(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	323 self,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	324 layout: bool = False,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	325 layout_width=0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	326 layout_height=0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	327 layout_width_chars: int = 0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	328 layout_height_chars: int = 0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	329 x_density=DEFAULT_X_DENSITY,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	330 y_density=DEFAULT_Y_DENSITY,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	331 x_shift=0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	332 y_shift=0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	333 y_tolerance=DEFAULT_Y_TOLERANCE,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	334 use_text_flow: bool = False,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	335 presorted: bool = False,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	336 expand_ligatures: bool = True,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	337 ) -> TextMap:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	338 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	339 Given a list of (word, chars) tuples (i.e., a WordMap), return a list of
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	340 (char-text, char) tuples (i.e., a TextMap) that can be used to mimic the
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	341 structural layout of the text on the page(s), using the following approach:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	342
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	343 - Sort the words by (doctop, x0) if not already sorted.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	344
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	345 - Calculate the initial doctop for the starting page.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	346
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	347 - Cluster the words by doctop (taking `y_tolerance` into account), and
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	348 iterate through them.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	349
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	350 - For each cluster, calculate the distance between that doctop and the
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	351 initial doctop, in points, minus `y_shift`. Divide that distance by
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	352 `y_density` to calculate the minimum number of newlines that should come
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	353 before this cluster. Append that number of newlines minus the number of
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	354 newlines already appended, with a minimum of one.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	355
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	356 - Then for each cluster, iterate through each word in it. Divide each
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	357 word's x0, minus `x_shift`, by `x_density` to calculate the minimum
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	358 number of characters that should come before this cluster. Append that
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	359 number of spaces minus the number of characters and spaces already
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	360 appended, with a minimum of one. Then append the word's text.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	361
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	362 - At the termination of each line, add more spaces if necessary to
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	363 mimic `layout_width`.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	364
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	365 - Finally, add newlines to the end if necessary to mimic to
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	366 `layout_height`.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	367
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	368 Note: This approach currently works best for horizontal, left-to-right
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	369 text, but will display all words regardless of orientation. There is room
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	370 for improvement in better supporting right-to-left text, as well as
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	371 vertical text.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	372 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	373 _textmap = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	374
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	375 if not len(self.tuples):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	376 return TextMap(_textmap)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	377
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	378 expansions = LIGATURES if expand_ligatures else {}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	379
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	380 if layout:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	381 if layout_width_chars:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	382 if layout_width:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	383 raise ValueError(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	384 "`layout_width` and `layout_width_chars` cannot both be set."
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	385 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	386 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	387 layout_width_chars = int(round(layout_width / x_density))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	388
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	389 if layout_height_chars:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	390 if layout_height:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	391 raise ValueError(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	392 "`layout_height` and `layout_height_chars` cannot both be set."
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	393 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	394 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	395 layout_height_chars = int(round(layout_height / y_density))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	396
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	397 blank_line = [(" ", None)] * layout_width_chars
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	398 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	399 blank_line = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	400
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	401 num_newlines = 0
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	402
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	403 words_sorted_doctop = (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	404 self.tuples
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	405 if presorted or use_text_flow
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	406 else sorted(self.tuples, key=lambda x: float(x[0]["doctop"]))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	407 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	408
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	409 first_word = words_sorted_doctop[0][0]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	410 doctop_start = first_word["doctop"] - first_word["top"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	411
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	412 for i, ws in enumerate(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	413 cluster_objects(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	414 words_sorted_doctop, lambda x: float(x[0]["doctop"]), y_tolerance
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	415 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	416 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	417 y_dist = (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	418 (ws[0][0]["doctop"] - (doctop_start + y_shift)) / y_density
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	419 if layout
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	420 else 0
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	421 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	422 num_newlines_prepend = max(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	423 # At least one newline, unless this iis the first line
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	424 int(i > 0),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	425 # ... or as many as needed to get the imputed "distance" from the top
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	426 round(y_dist) - num_newlines,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	427 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	428
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	429 for i in range(num_newlines_prepend):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	430 if not len(_textmap) or _textmap[-1][0] == "\n":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	431 _textmap += blank_line
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	432 _textmap.append(("\n", None))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	433
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	434 num_newlines += num_newlines_prepend
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	435
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	436 line_len = 0
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	437
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	438 line_words_sorted_x0 = (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	439 ws
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	440 if presorted or use_text_flow
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	441 else sorted(ws, key=lambda x: float(x[0]["x0"]))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	442 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	443
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	444 for word, chars in line_words_sorted_x0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	445 x_dist = (word["x0"] - x_shift) / x_density if layout else 0
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	446 num_spaces_prepend = max(min(1, line_len), round(x_dist) - line_len)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	447 _textmap += [(" ", None)] * num_spaces_prepend
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	448 line_len += num_spaces_prepend
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	449
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	450 for c in chars:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	451 letters = expansions.get(c["text"], c["text"])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	452 for letter in letters:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	453 _textmap.append((letter, c))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	454 line_len += 1
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	455
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	456 # Append spaces at end of line
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	457 if layout:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	458 _textmap += [(" ", None)] * (layout_width_chars - line_len)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	459
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	460 # Append blank lines at end of text
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	461 if layout:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	462 num_newlines_append = layout_height_chars - (num_newlines + 1)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	463 for i in range(num_newlines_append):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	464 if i > 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	465 _textmap += blank_line
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	466 _textmap.append(("\n", None))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	467
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	468 # Remove terminal newline
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	469 if _textmap[-1] == ("\n", None):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	470 _textmap = _textmap[:-1]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	471
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	472 return TextMap(_textmap)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	473
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	474
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	475 class WordExtractor:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	476 def __init__(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	477 self,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	478 x_tolerance=DEFAULT_X_TOLERANCE,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	479 y_tolerance=DEFAULT_Y_TOLERANCE,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	480 keep_blank_chars: bool = False,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	481 use_text_flow=False,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	482 horizontal_ltr=True, # Should words be read left-to-right?
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	483 vertical_ttb=False, # Should vertical words be read top-to-bottom?
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	484 extra_attrs=None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	485 split_at_punctuation=False,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	486 expand_ligatures=True,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	487 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	488 self.x_tolerance = x_tolerance
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	489 self.y_tolerance = y_tolerance
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	490 self.keep_blank_chars = keep_blank_chars
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	491 self.use_text_flow = use_text_flow
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	492 self.horizontal_ltr = horizontal_ltr
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	493 self.vertical_ttb = vertical_ttb
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	494 self.extra_attrs = [] if extra_attrs is None else extra_attrs
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	495
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	496 # Note: string.punctuation = '!"#$%&\'()*+,-./:;<=>?@[\\]^_`{\|}~'
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	497 self.split_at_punctuation = (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	498 string.punctuation
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	499 if split_at_punctuation is True
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	500 else (split_at_punctuation or "")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	501 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	502
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	503 self.expansions = LIGATURES if expand_ligatures else {}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	504
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	505 def merge_chars(self, ordered_chars: list):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	506 x0, top, x1, bottom = objects_to_bbox(ordered_chars)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	507 doctop_adj = ordered_chars[0]["doctop"] - ordered_chars[0]["top"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	508 upright = ordered_chars[0]["upright"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	509 direction = 1 if (self.horizontal_ltr if upright else self.vertical_ttb) else -1
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	510
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	511 matrix = ordered_chars[0]["matrix"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	512
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	513 rotation = 0
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	514 if not upright and matrix[1] < 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	515 ordered_chars = reversed(ordered_chars)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	516 rotation = 270
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	517
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	518 if matrix[0] < 0 and matrix[3] < 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	519 rotation = 180
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	520 elif matrix[1] > 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	521 rotation = 90
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	522
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	523 word = {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	524 "text": "".join(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	525 self.expansions.get(c["text"], c["text"]) for c in ordered_chars
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	526 ),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	527 "x0": x0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	528 "x1": x1,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	529 "top": top,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	530 "doctop": top + doctop_adj,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	531 "bottom": bottom,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	532 "upright": upright,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	533 "direction": direction,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	534 "rotation": rotation,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	535 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	536
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	537 for key in self.extra_attrs:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	538 word[key] = ordered_chars[0][key]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	539
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	540 return word
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	541
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	542 def char_begins_new_word(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	543 self,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	544 prev_char,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	545 curr_char,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	546 ) -> bool:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	547 """This method takes several factors into account to determine if
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	548 `curr_char` represents the beginning of a new word:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	549
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	550 - Whether the text is "upright" (i.e., non-rotated)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	551 - Whether the user has specified that horizontal text runs
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	552 left-to-right (default) or right-to-left, as represented by
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	553 self.horizontal_ltr
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	554 - Whether the user has specified that vertical text the text runs
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	555 top-to-bottom (default) or bottom-to-top, as represented by
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	556 self.vertical_ttb
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	557 - The x0, top, x1, and bottom attributes of prev_char and
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	558 curr_char
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	559 - The self.x_tolerance and self.y_tolerance settings. Note: In
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	560 this case, x/y refer to those directions for non-rotated text.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	561 For vertical text, they are flipped. A more accurate terminology
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	562 might be "intraline character distance tolerance" and
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	563 "interline character distance tolerance"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	564
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	565 An important note: The intraline distance is measured from the
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	566 end of the previous character to the beginning of the current
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	567 character, while the interline distance is measured from the
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	568 top of the previous character to the top of the next
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	569 character. The reasons for this are partly repository-historical,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	570 and partly logical, as successive text lines' bounding boxes often
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	571 overlap slightly (and we don't want that overlap to be interpreted
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	572 as the two lines being the same line).
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	573
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	574 The upright-ness of the character determines the attributes to
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	575 compare, while horizontal_ltr/vertical_ttb determine the direction
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	576 of the comparison.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	577 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	578
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	579 # Note: Due to the grouping step earlier in the process,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	580 # curr_char["upright"] will always equal prev_char["upright"].
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	581 if curr_char["upright"]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	582 x = self.x_tolerance
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	583 y = self.y_tolerance
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	584 ay = prev_char["top"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	585 cy = curr_char["top"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	586 if self.horizontal_ltr:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	587 ax = prev_char["x0"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	588 bx = prev_char["x1"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	589 cx = curr_char["x0"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	590 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	591 ax = -prev_char["x1"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	592 bx = -prev_char["x0"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	593 cx = -curr_char["x1"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	594
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	595 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	596 x = self.y_tolerance
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	597 y = self.x_tolerance
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	598 ay = prev_char["x0"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	599 cy = curr_char["x0"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	600 if self.vertical_ttb:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	601 ax = prev_char["top"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	602 bx = prev_char["bottom"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	603 cx = curr_char["top"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	604 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	605 ax = -prev_char["bottom"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	606 bx = -prev_char["top"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	607 cx = -curr_char["bottom"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	608
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	609 return bool(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	610 # Intraline test
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	611 (cx < ax)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	612 or (cx > bx + x)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	613 # Interline test
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	614 or (cy > ay + y)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	615 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	616
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	617 def iter_chars_to_words(self, ordered_chars):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	618 current_word: list = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	619
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	620 def start_next_word(new_char=None):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	621 nonlocal current_word
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	622
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	623 if current_word:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	624 yield current_word
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	625
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	626 current_word = [] if new_char is None else [new_char]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	627
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	628 for char in ordered_chars:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	629 text = char["text"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	630
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	631 if not self.keep_blank_chars and text.isspace():
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	632 yield from start_next_word(None)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	633
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	634 elif text in self.split_at_punctuation:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	635 yield from start_next_word(char)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	636 yield from start_next_word(None)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	637
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	638 elif current_word and self.char_begins_new_word(current_word[-1], char):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	639 yield from start_next_word(char)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	640
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	641 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	642 current_word.append(char)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	643
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	644 # Finally, after all chars processed
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	645 if current_word:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	646 yield current_word
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	647
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	648 def iter_sort_chars(self, chars):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	649 def upright_key(x) -> int:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	650 return -int(x["upright"])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	651
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	652 for upright_cluster in cluster_objects(list(chars), upright_key, 0):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	653 upright = upright_cluster[0]["upright"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	654 cluster_key = "doctop" if upright else "x0"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	655
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	656 # Cluster by line
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	657 subclusters = cluster_objects(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	658 upright_cluster, itemgetter(cluster_key), self.y_tolerance
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	659 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	660
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	661 for sc in subclusters:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	662 # Sort within line
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	663 sort_key = "x0" if upright else "doctop"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	664 to_yield = sorted(sc, key=itemgetter(sort_key))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	665
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	666 # Reverse order if necessary
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	667 if not (self.horizontal_ltr if upright else self.vertical_ttb):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	668 yield from reversed(to_yield)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	669 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	670 yield from to_yield
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	671
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	672 def iter_extract_tuples(self, chars):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	673 ordered_chars = chars if self.use_text_flow else self.iter_sort_chars(chars)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	674
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	675 grouping_key = itemgetter("upright", *self.extra_attrs)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	676 grouped_chars = itertools.groupby(ordered_chars, grouping_key)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	677
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	678 for keyvals, char_group in grouped_chars:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	679 for word_chars in self.iter_chars_to_words(char_group):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	680 yield (self.merge_chars(word_chars), word_chars)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	681
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	682 def extract_wordmap(self, chars) -> WordMap:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	683 return WordMap(list(self.iter_extract_tuples(chars)))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	684
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	685 def extract_words(self, chars: list) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	686 words = list(word for word, word_chars in self.iter_extract_tuples(chars))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	687 return words
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	688
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	689
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	690 def extract_words(chars: list, **kwargs) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	691 return WordExtractor(**kwargs).extract_words(chars)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	692
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	693
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	694 TEXTMAP_KWARGS = inspect.signature(WordMap.to_textmap).parameters.keys()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	695 WORD_EXTRACTOR_KWARGS = inspect.signature(WordExtractor).parameters.keys()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	696
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	697
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	698 def chars_to_textmap(chars: list, **kwargs) -> TextMap:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	699 kwargs.update({"presorted": True})
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	700
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	701 extractor = WordExtractor(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	702 **{k: kwargs[k] for k in WORD_EXTRACTOR_KWARGS if k in kwargs}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	703 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	704 wordmap = extractor.extract_wordmap(chars)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	705 textmap = wordmap.to_textmap(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	706 **{k: kwargs[k] for k in TEXTMAP_KWARGS if k in kwargs}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	707 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	708
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	709 return textmap
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	710
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	711
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	712 def extract_text(chars: list, **kwargs) -> str:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	713 chars = to_list(chars)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	714 if len(chars) == 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	715 return ""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	716
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	717 if kwargs.get("layout"):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	718 return chars_to_textmap(chars, **kwargs).as_string
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	719 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	720 y_tolerance = kwargs.get("y_tolerance", DEFAULT_Y_TOLERANCE)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	721 extractor = WordExtractor(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	722 **{k: kwargs[k] for k in WORD_EXTRACTOR_KWARGS if k in kwargs}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	723 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	724 words = extractor.extract_words(chars)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	725 if words:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	726 rotation = words[0]["rotation"] # rotation cannot change within a cell
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	727 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	728 rotation = 0
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	729
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	730 if rotation == 90:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	731 words.sort(key=lambda w: (w["x1"], -w["top"]))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	732 lines = " ".join([w["text"] for w in words])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	733 elif rotation == 270:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	734 words.sort(key=lambda w: (-w["x1"], w["top"]))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	735 lines = " ".join([w["text"] for w in words])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	736 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	737 lines = cluster_objects(words, itemgetter("doctop"), y_tolerance)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	738 lines = "\n".join(" ".join(word["text"] for word in line) for line in lines)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	739 if rotation == 180: # needs extra treatment
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	740 lines = "".join([(c if c != "\n" else " ") for c in reversed(lines)])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	741
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	742 return lines
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	743
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	744
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	745 def collate_line(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	746 line_chars: list,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	747 tolerance=DEFAULT_X_TOLERANCE,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	748 ) -> str:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	749 coll = ""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	750 last_x1 = None
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	751 for char in sorted(line_chars, key=itemgetter("x0")):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	752 if (last_x1 is not None) and (char["x0"] > (last_x1 + tolerance)):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	753 coll += " "
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	754 last_x1 = char["x1"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	755 coll += char["text"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	756 return coll
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	757
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	758
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	759 def dedupe_chars(chars: list, tolerance=1) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	760 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	761 Removes duplicate chars — those sharing the same text, fontname, size,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	762 and positioning (within `tolerance`) as other characters in the set.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	763 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	764 key = itemgetter("fontname", "size", "upright", "text")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	765 pos_key = itemgetter("doctop", "x0")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	766
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	767 def yield_unique_chars(chars: list):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	768 sorted_chars = sorted(chars, key=key)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	769 for grp, grp_chars in itertools.groupby(sorted_chars, key=key):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	770 for y_cluster in cluster_objects(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	771 list(grp_chars), itemgetter("doctop"), tolerance
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	772 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	773 for x_cluster in cluster_objects(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	774 y_cluster, itemgetter("x0"), tolerance
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	775 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	776 yield sorted(x_cluster, key=pos_key)[0]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	777
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	778 deduped = yield_unique_chars(chars)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	779 return sorted(deduped, key=chars.index)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	780
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	781
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	782 def line_to_edge(line):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	783 edge = dict(line)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	784 edge["orientation"] = "h" if (line["top"] == line["bottom"]) else "v"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	785 return edge
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	786
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	787
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	788 def rect_to_edges(rect) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	789 top, bottom, left, right = [dict(rect) for x in range(4)]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	790 top.update(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	791 {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	792 "object_type": "rect_edge",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	793 "height": 0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	794 "y0": rect["y1"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	795 "bottom": rect["top"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	796 "orientation": "h",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	797 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	798 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	799 bottom.update(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	800 {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	801 "object_type": "rect_edge",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	802 "height": 0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	803 "y1": rect["y0"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	804 "top": rect["top"] + rect["height"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	805 "doctop": rect["doctop"] + rect["height"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	806 "orientation": "h",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	807 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	808 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	809 left.update(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	810 {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	811 "object_type": "rect_edge",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	812 "width": 0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	813 "x1": rect["x0"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	814 "orientation": "v",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	815 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	816 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	817 right.update(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	818 {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	819 "object_type": "rect_edge",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	820 "width": 0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	821 "x0": rect["x1"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	822 "orientation": "v",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	823 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	824 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	825 return [top, bottom, left, right]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	826
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	827
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	828 def curve_to_edges(curve) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	829 point_pairs = zip(curve["pts"], curve["pts"][1:])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	830 return [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	831 {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	832 "object_type": "curve_edge",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	833 "x0": min(p0[0], p1[0]),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	834 "x1": max(p0[0], p1[0]),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	835 "top": min(p0[1], p1[1]),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	836 "doctop": min(p0[1], p1[1]) + (curve["doctop"] - curve["top"]),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	837 "bottom": max(p0[1], p1[1]),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	838 "width": abs(p0[0] - p1[0]),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	839 "height": abs(p0[1] - p1[1]),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	840 "orientation": "v" if p0[0] == p1[0] else ("h" if p0[1] == p1[1] else None),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	841 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	842 for p0, p1 in point_pairs
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	843 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	844
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	845
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	846 def obj_to_edges(obj) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	847 t = obj["object_type"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	848 if "_edge" in t:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	849 return [obj]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	850 elif t == "line":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	851 return [line_to_edge(obj)]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	852 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	853 return {"rect": rect_to_edges, "curve": curve_to_edges}[t](obj)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	854
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	855
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	856 def filter_edges(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	857 edges,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	858 orientation=None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	859 edge_type=None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	860 min_length=1,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	861 ) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	862 if orientation not in ("v", "h", None):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	863 raise ValueError("Orientation must be 'v' or 'h'")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	864
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	865 def test(e) -> bool:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	866 dim = "height" if e["orientation"] == "v" else "width"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	867 et_correct = e["object_type"] == edge_type if edge_type is not None else True
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	868 orient_correct = orientation is None or e["orientation"] == orientation
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	869 return bool(et_correct and orient_correct and (e[dim] >= min_length))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	870
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	871 return list(filter(test, edges))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	872
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	873
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	874 def cluster_list(xs, tolerance=0) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	875 if tolerance == 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	876 return [[x] for x in sorted(xs)]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	877 if len(xs) < 2:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	878 return [[x] for x in sorted(xs)]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	879 groups = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	880 xs = list(sorted(xs))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	881 current_group = [xs[0]]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	882 last = xs[0]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	883 for x in xs[1:]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	884 if x <= (last + tolerance):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	885 current_group.append(x)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	886 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	887 groups.append(current_group)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	888 current_group = [x]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	889 last = x
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	890 groups.append(current_group)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	891 return groups
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	892
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	893
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	894 def make_cluster_dict(values, tolerance) -> dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	895 clusters = cluster_list(list(set(values)), tolerance)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	896
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	897 nested_tuples = [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	898 [(val, i) for val in value_cluster] for i, value_cluster in enumerate(clusters)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	899 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	900
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	901 return dict(itertools.chain(*nested_tuples))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	902
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	903
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	904 def cluster_objects(xs, key_fn, tolerance) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	905 if not callable(key_fn):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	906 key_fn = itemgetter(key_fn)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	907
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	908 values = map(key_fn, xs)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	909 cluster_dict = make_cluster_dict(values, tolerance)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	910
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	911 get_0, get_1 = itemgetter(0), itemgetter(1)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	912
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	913 cluster_tuples = sorted(((x, cluster_dict.get(key_fn(x))) for x in xs), key=get_1)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	914
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	915 grouped = itertools.groupby(cluster_tuples, key=get_1)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	916
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	917 return [list(map(get_0, v)) for k, v in grouped]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	918
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	919
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	920 def move_object(obj, axis: str, value):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	921 assert axis in ("h", "v")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	922 if axis == "h":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	923 new_items = [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	924 ("x0", obj["x0"] + value),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	925 ("x1", obj["x1"] + value),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	926 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	927 if axis == "v":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	928 new_items = [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	929 ("top", obj["top"] + value),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	930 ("bottom", obj["bottom"] + value),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	931 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	932 if "doctop" in obj:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	933 new_items += [("doctop", obj["doctop"] + value)]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	934 if "y0" in obj:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	935 new_items += [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	936 ("y0", obj["y0"] - value),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	937 ("y1", obj["y1"] - value),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	938 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	939 return obj.__class__(tuple(obj.items()) + tuple(new_items))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	940
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	941
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	942 def snap_objects(objs, attr: str, tolerance) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	943 axis = {"x0": "h", "x1": "h", "top": "v", "bottom": "v"}[attr]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	944 list_objs = list(objs)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	945 clusters = cluster_objects(list_objs, itemgetter(attr), tolerance)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	946 avgs = [sum(map(itemgetter(attr), cluster)) / len(cluster) for cluster in clusters]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	947 snapped_clusters = [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	948 [move_object(obj, axis, avg - obj[attr]) for obj in cluster]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	949 for cluster, avg in zip(clusters, avgs)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	950 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	951 return list(itertools.chain(*snapped_clusters))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	952
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	953
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	954 def snap_edges(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	955 edges,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	956 x_tolerance=DEFAULT_SNAP_TOLERANCE,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	957 y_tolerance=DEFAULT_SNAP_TOLERANCE,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	958 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	959 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	960 Given a list of edges, snap any within `tolerance` pixels of one another
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	961 to their positional average.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	962 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	963 by_orientation = {"v": [], "h": []}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	964 for e in edges:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	965 by_orientation[e["orientation"]].append(e)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	966
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	967 snapped_v = snap_objects(by_orientation["v"], "x0", x_tolerance)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	968 snapped_h = snap_objects(by_orientation["h"], "top", y_tolerance)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	969 return snapped_v + snapped_h
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	970
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	971
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	972 def resize_object(obj, key: str, value):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	973 assert key in ("x0", "x1", "top", "bottom")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	974 old_value = obj[key]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	975 diff = value - old_value
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	976 new_items = [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	977 (key, value),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	978 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	979 if key == "x0":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	980 assert value <= obj["x1"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	981 new_items.append(("width", obj["x1"] - value))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	982 elif key == "x1":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	983 assert value >= obj["x0"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	984 new_items.append(("width", value - obj["x0"]))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	985 elif key == "top":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	986 assert value <= obj["bottom"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	987 new_items.append(("doctop", obj["doctop"] + diff))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	988 new_items.append(("height", obj["height"] - diff))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	989 if "y1" in obj:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	990 new_items.append(("y1", obj["y1"] - diff))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	991 elif key == "bottom":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	992 assert value >= obj["top"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	993 new_items.append(("height", obj["height"] + diff))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	994 if "y0" in obj:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	995 new_items.append(("y0", obj["y0"] - diff))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	996 return obj.__class__(tuple(obj.items()) + tuple(new_items))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	997
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	998
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	999 def join_edge_group(edges, orientation: str, tolerance=DEFAULT_JOIN_TOLERANCE):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1000 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1001 Given a list of edges along the same infinite line, join those that
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1002 are within `tolerance` pixels of one another.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1003 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1004 if orientation == "h":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1005 min_prop, max_prop = "x0", "x1"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1006 elif orientation == "v":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1007 min_prop, max_prop = "top", "bottom"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1008 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1009 raise ValueError("Orientation must be 'v' or 'h'")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1010
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1011 sorted_edges = list(sorted(edges, key=itemgetter(min_prop)))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1012 joined = [sorted_edges[0]]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1013 for e in sorted_edges[1:]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1014 last = joined[-1]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1015 if e[min_prop] <= (last[max_prop] + tolerance):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1016 if e[max_prop] > last[max_prop]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1017 # Extend current edge to new extremity
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1018 joined[-1] = resize_object(last, max_prop, e[max_prop])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1019 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1020 # Edge is separate from previous edges
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1021 joined.append(e)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1022
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1023 return joined
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1024
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1025
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1026 def merge_edges(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1027 edges,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1028 snap_x_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1029 snap_y_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1030 join_x_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1031 join_y_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1032 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1033 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1034 Using the `snap_edges` and `join_edge_group` methods above,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1035 merge a list of edges into a more "seamless" list.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1036 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1037
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1038 def get_group(edge):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1039 if edge["orientation"] == "h":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1040 return ("h", edge["top"])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1041 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1042 return ("v", edge["x0"])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1043
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1044 if snap_x_tolerance > 0 or snap_y_tolerance > 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1045 edges = snap_edges(edges, snap_x_tolerance, snap_y_tolerance)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1046
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1047 _sorted = sorted(edges, key=get_group)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1048 edge_groups = itertools.groupby(_sorted, key=get_group)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1049 edge_gen = (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1050 join_edge_group(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1051 items, k[0], (join_x_tolerance if k[0] == "h" else join_y_tolerance)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1052 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1053 for k, items in edge_groups
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1054 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1055 edges = list(itertools.chain(*edge_gen))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1056 return edges
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1057
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1058
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1059 def bbox_to_rect(bbox) -> dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1060 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1061 Return the rectangle (i.e a dict with keys "x0", "top", "x1",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1062 "bottom") for an object.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1063 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1064 return {"x0": bbox[0], "top": bbox[1], "x1": bbox[2], "bottom": bbox[3]}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1065
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1066
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1067 def objects_to_rect(objects) -> dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1068 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1069 Given an iterable of objects, return the smallest rectangle (i.e. a
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1070 dict with "x0", "top", "x1", and "bottom" keys) that contains them
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1071 all.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1072 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1073 return bbox_to_rect(objects_to_bbox(objects))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1074
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1075
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1076 def merge_bboxes(bboxes):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1077 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1078 Given an iterable of bounding boxes, return the smallest bounding box
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1079 that contains them all.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1080 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1081 x0, top, x1, bottom = zip(*bboxes)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1082 return (min(x0), min(top), max(x1), max(bottom))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1083
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1084
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1085 def objects_to_bbox(objects):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1086 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1087 Given an iterable of objects, return the smallest bounding box that
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1088 contains them all.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1089 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1090 return merge_bboxes(map(bbox_getter, objects))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1091
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1092
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1093 def words_to_edges_h(words, word_threshold: int = DEFAULT_MIN_WORDS_HORIZONTAL):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1094 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1095 Find (imaginary) horizontal lines that connect the tops
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1096 of at least `word_threshold` words.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1097 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1098 by_top = cluster_objects(words, itemgetter("top"), 1)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1099 large_clusters = filter(lambda x: len(x) >= word_threshold, by_top)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1100 rects = list(map(objects_to_rect, large_clusters))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1101 if len(rects) == 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1102 return []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1103 min_x0 = min(map(itemgetter("x0"), rects))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1104 max_x1 = max(map(itemgetter("x1"), rects))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1105
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1106 edges = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1107 for r in rects:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1108 edges += [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1109 # Top of text
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1110 {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1111 "x0": min_x0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1112 "x1": max_x1,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1113 "top": r["top"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1114 "bottom": r["top"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1115 "width": max_x1 - min_x0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1116 "orientation": "h",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1117 },
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1118 # For each detected row, we also add the 'bottom' line. This will
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1119 # generate extra edges, (some will be redundant with the next row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1120 # 'top' line), but this catches the last row of every table.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1121 {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1122 "x0": min_x0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1123 "x1": max_x1,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1124 "top": r["bottom"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1125 "bottom": r["bottom"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1126 "width": max_x1 - min_x0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1127 "orientation": "h",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1128 },
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1129 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1130
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1131 return edges
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1132
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1133
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1134 def get_bbox_overlap(a, b):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1135 a_left, a_top, a_right, a_bottom = a
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1136 b_left, b_top, b_right, b_bottom = b
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1137 o_left = max(a_left, b_left)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1138 o_right = min(a_right, b_right)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1139 o_bottom = min(a_bottom, b_bottom)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1140 o_top = max(a_top, b_top)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1141 o_width = o_right - o_left
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1142 o_height = o_bottom - o_top
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1143 if o_height >= 0 and o_width >= 0 and o_height + o_width > 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1144 return (o_left, o_top, o_right, o_bottom)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1145 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1146 return None
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1147
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1148
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1149 def words_to_edges_v(words, word_threshold: int = DEFAULT_MIN_WORDS_VERTICAL):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1150 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1151 Find (imaginary) vertical lines that connect the left, right, or
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1152 center of at least `word_threshold` words.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1153 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1154 # Find words that share the same left, right, or centerpoints
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1155 by_x0 = cluster_objects(words, itemgetter("x0"), 1)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1156 by_x1 = cluster_objects(words, itemgetter("x1"), 1)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1157
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1158 def get_center(word):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1159 return float(word["x0"] + word["x1"]) / 2
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1160
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1161 by_center = cluster_objects(words, get_center, 1)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1162 clusters = by_x0 + by_x1 + by_center
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1163
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1164 # Find the points that align with the most words
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1165 sorted_clusters = sorted(clusters, key=lambda x: -len(x))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1166 large_clusters = filter(lambda x: len(x) >= word_threshold, sorted_clusters)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1167
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1168 # For each of those points, find the bboxes fitting all matching words
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1169 bboxes = list(map(objects_to_bbox, large_clusters))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1170
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1171 # Iterate through those bboxes, condensing overlapping bboxes
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1172 condensed_bboxes = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1173 for bbox in bboxes:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1174 overlap = any(get_bbox_overlap(bbox, c) for c in condensed_bboxes)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1175 if not overlap:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1176 condensed_bboxes.append(bbox)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1177
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1178 if not condensed_bboxes:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1179 return []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1180
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1181 condensed_rects = map(bbox_to_rect, condensed_bboxes)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1182 sorted_rects = list(sorted(condensed_rects, key=itemgetter("x0")))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1183
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1184 max_x1 = max(map(itemgetter("x1"), sorted_rects))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1185 min_top = min(map(itemgetter("top"), sorted_rects))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1186 max_bottom = max(map(itemgetter("bottom"), sorted_rects))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1187
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1188 return [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1189 {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1190 "x0": b["x0"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1191 "x1": b["x0"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1192 "top": min_top,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1193 "bottom": max_bottom,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1194 "height": max_bottom - min_top,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1195 "orientation": "v",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1196 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1197 for b in sorted_rects
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1198 ] + [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1199 {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1200 "x0": max_x1,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1201 "x1": max_x1,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1202 "top": min_top,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1203 "bottom": max_bottom,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1204 "height": max_bottom - min_top,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1205 "orientation": "v",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1206 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1207 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1208
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1209
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1210 def edges_to_intersections(edges, x_tolerance=1, y_tolerance=1) -> dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1211 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1212 Given a list of edges, return the points at which they intersect
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1213 within `tolerance` pixels.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1214 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1215 intersections = {}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1216 v_edges, h_edges = [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1217 list(filter(lambda x: x["orientation"] == o, edges)) for o in ("v", "h")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1218 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1219 for v in sorted(v_edges, key=itemgetter("x0", "top")):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1220 for h in sorted(h_edges, key=itemgetter("top", "x0")):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1221 if (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1222 (v["top"] <= (h["top"] + y_tolerance))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1223 and (v["bottom"] >= (h["top"] - y_tolerance))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1224 and (v["x0"] >= (h["x0"] - x_tolerance))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1225 and (v["x0"] <= (h["x1"] + x_tolerance))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1226 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1227 vertex = (v["x0"], h["top"])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1228 if vertex not in intersections:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1229 intersections[vertex] = {"v": [], "h": []}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1230 intersections[vertex]["v"].append(v)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1231 intersections[vertex]["h"].append(h)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1232 return intersections
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1233
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1234
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1235 def obj_to_bbox(obj):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1236 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1237 Return the bounding box for an object.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1238 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1239 return bbox_getter(obj)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1240
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1241
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1242 def intersections_to_cells(intersections):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1243 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1244 Given a list of points (`intersections`), return all rectangular "cells"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1245 that those points describe.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1246
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1247 `intersections` should be a dictionary with (x0, top) tuples as keys,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1248 and a list of edge objects as values. The edge objects should correspond
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1249 to the edges that touch the intersection.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1250 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1251
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1252 def edge_connects(p1, p2) -> bool:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1253 def edges_to_set(edges):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1254 return set(map(obj_to_bbox, edges))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1255
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1256 if p1[0] == p2[0]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1257 common = edges_to_set(intersections[p1]["v"]).intersection(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1258 edges_to_set(intersections[p2]["v"])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1259 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1260 if len(common):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1261 return True
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1262
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1263 if p1[1] == p2[1]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1264 common = edges_to_set(intersections[p1]["h"]).intersection(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1265 edges_to_set(intersections[p2]["h"])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1266 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1267 if len(common):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1268 return True
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1269 return False
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1270
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1271 points = list(sorted(intersections.keys()))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1272 n_points = len(points)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1273
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1274 def find_smallest_cell(points, i: int):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1275 if i == n_points - 1:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1276 return None
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1277 pt = points[i]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1278 rest = points[i + 1 :]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1279 # Get all the points directly below and directly right
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1280 below = [x for x in rest if x[0] == pt[0]]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1281 right = [x for x in rest if x[1] == pt[1]]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1282 for below_pt in below:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1283 if not edge_connects(pt, below_pt):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1284 continue
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1285
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1286 for right_pt in right:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1287 if not edge_connects(pt, right_pt):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1288 continue
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1289
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1290 bottom_right = (right_pt[0], below_pt[1])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1291
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1292 if (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1293 (bottom_right in intersections)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1294 and edge_connects(bottom_right, right_pt)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1295 and edge_connects(bottom_right, below_pt)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1296 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1297 return (pt[0], pt[1], bottom_right[0], bottom_right[1])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1298 return None
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1299
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1300 cell_gen = (find_smallest_cell(points, i) for i in range(len(points)))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1301 return list(filter(None, cell_gen))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1302
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1303
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1304 def cells_to_tables(page, cells) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1305 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1306 Given a list of bounding boxes (`cells`), return a list of tables that
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1307 hold those cells most simply (and contiguously).
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1308 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1309
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1310 def bbox_to_corners(bbox) -> tuple:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1311 x0, top, x1, bottom = bbox
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1312 return ((x0, top), (x0, bottom), (x1, top), (x1, bottom))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1313
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1314 remaining_cells = list(cells)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1315
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1316 # Iterate through the cells found above, and assign them
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1317 # to contiguous tables
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1318
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1319 current_corners = set()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1320 current_cells = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1321
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1322 tables = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1323 while len(remaining_cells):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1324 initial_cell_count = len(current_cells)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1325 for cell in list(remaining_cells):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1326 cell_corners = bbox_to_corners(cell)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1327 # If we're just starting a table ...
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1328 if len(current_cells) == 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1329 # ... immediately assign it to the empty group
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1330 current_corners \|= set(cell_corners)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1331 current_cells.append(cell)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1332 remaining_cells.remove(cell)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1333 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1334 # How many corners does this table share with the current group?
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1335 corner_count = sum(c in current_corners for c in cell_corners)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1336
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1337 # If touching on at least one corner...
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1338 if corner_count > 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1339 # ... assign it to the current group
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1340 current_corners \|= set(cell_corners)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1341 current_cells.append(cell)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1342 remaining_cells.remove(cell)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1343
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1344 # If this iteration did not find any more cells to append...
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1345 if len(current_cells) == initial_cell_count:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1346 # ... start a new cell group
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1347 tables.append(list(current_cells))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1348 current_corners.clear()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1349 current_cells.clear()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1350
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1351 # Once we have exhausting the list of cells ...
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1352
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1353 # ... and we have a cell group that has not been stored
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1354 if len(current_cells):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1355 # ... store it.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1356 tables.append(list(current_cells))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1357
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1358 # PyMuPDF modification:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1359 # Remove tables without text or having only 1 column
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1360 for i in range(len(tables) - 1, -1, -1):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1361 r = EMPTY_RECT()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1362 x1_vals = set()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1363 x0_vals = set()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1364 for c in tables[i]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1365 r \|= c
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1366 x1_vals.add(c[2])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1367 x0_vals.add(c[0])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1368 if (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1369 len(x1_vals) < 2
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1370 or len(x0_vals) < 2
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1371 or white_spaces.issuperset(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1372 page.get_textbox(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1373 r,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1374 textpage=TEXTPAGE,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1375 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1376 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1377 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1378 del tables[i]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1379
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1380 # Sort the tables top-to-bottom-left-to-right based on the value of the
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1381 # topmost-and-then-leftmost coordinate of a table.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1382 _sorted = sorted(tables, key=lambda t: min((c[1], c[0]) for c in t))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1383 return _sorted
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1384
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1385
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1386 class CellGroup:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1387 def __init__(self, cells):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1388 self.cells = cells
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1389 self.bbox = (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1390 min(map(itemgetter(0), filter(None, cells))),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1391 min(map(itemgetter(1), filter(None, cells))),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1392 max(map(itemgetter(2), filter(None, cells))),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1393 max(map(itemgetter(3), filter(None, cells))),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1394 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1395
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1396
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1397 class TableRow(CellGroup):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1398 pass
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1399
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1400
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1401 class TableHeader:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1402 """PyMuPDF extension containing the identified table header."""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1403
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1404 def __init__(self, bbox, cells, names, above):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1405 self.bbox = bbox
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1406 self.cells = cells
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1407 self.names = names
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1408 self.external = above
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1409
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1410
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1411 class Table:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1412 def __init__(self, page, cells):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1413 self.page = page
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1414 self.cells = cells
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1415 self.header = self._get_header() # PyMuPDF extension
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1416
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1417 @property
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1418 def bbox(self):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1419 c = self.cells
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1420 return (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1421 min(map(itemgetter(0), c)),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1422 min(map(itemgetter(1), c)),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1423 max(map(itemgetter(2), c)),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1424 max(map(itemgetter(3), c)),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1425 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1426
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1427 @property
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1428 def rows(self) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1429 _sorted = sorted(self.cells, key=itemgetter(1, 0))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1430 xs = list(sorted(set(map(itemgetter(0), self.cells))))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1431 rows = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1432 for y, row_cells in itertools.groupby(_sorted, itemgetter(1)):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1433 xdict = {cell[0]: cell for cell in row_cells}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1434 row = TableRow([xdict.get(x) for x in xs])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1435 rows.append(row)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1436 return rows
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1437
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1438 @property
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1439 def row_count(self) -> int: # PyMuPDF extension
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1440 return len(self.rows)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1441
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1442 @property
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1443 def col_count(self) -> int: # PyMuPDF extension
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1444 return max([len(r.cells) for r in self.rows])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1445
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1446 def extract(self, **kwargs) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1447 chars = CHARS
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1448 table_arr = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1449
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1450 def char_in_bbox(char, bbox) -> bool:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1451 v_mid = (char["top"] + char["bottom"]) / 2
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1452 h_mid = (char["x0"] + char["x1"]) / 2
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1453 x0, top, x1, bottom = bbox
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1454 return bool(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1455 (h_mid >= x0) and (h_mid < x1) and (v_mid >= top) and (v_mid < bottom)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1456 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1457
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1458 for row in self.rows:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1459 arr = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1460 row_chars = [char for char in chars if char_in_bbox(char, row.bbox)]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1461
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1462 for cell in row.cells:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1463 if cell is None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1464 cell_text = None
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1465 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1466 cell_chars = [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1467 char for char in row_chars if char_in_bbox(char, cell)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1468 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1469
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1470 if len(cell_chars):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1471 kwargs["x_shift"] = cell[0]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1472 kwargs["y_shift"] = cell[1]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1473 if "layout" in kwargs:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1474 kwargs["layout_width"] = cell[2] - cell[0]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1475 kwargs["layout_height"] = cell[3] - cell[1]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1476 cell_text = extract_text(cell_chars, **kwargs)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1477 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1478 cell_text = ""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1479 arr.append(cell_text)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1480 table_arr.append(arr)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1481
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1482 return table_arr
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1483
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1484 def to_markdown(self, clean=False, fill_empty=True):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1485 """Output table content as a string in Github-markdown format.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1486
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1487 If "clean" then markdown syntax is removed from cell content.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1488 If "fill_empty" then cell content None is replaced by the values
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1489 above (columns) or left (rows) in an effort to approximate row and
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1490 columns spans.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1491
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1492 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1493 output = "\|"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1494 rows = self.row_count
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1495 cols = self.col_count
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1496
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1497 # cell coordinates
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1498 cell_boxes = [[c for c in r.cells] for r in self.rows]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1499
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1500 # cell text strings
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1501 cells = [[None for i in range(cols)] for j in range(rows)]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1502 for i, row in enumerate(cell_boxes):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1503 for j, cell in enumerate(row):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1504 if cell is not None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1505 cells[i][j] = extract_cells(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1506 TEXTPAGE, cell_boxes[i][j], markdown=True
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1507 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1508
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1509 if fill_empty: # fill "None" cells where possible
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1510
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1511 # for rows, copy content from left to right
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1512 for j in range(rows):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1513 for i in range(cols - 1):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1514 if cells[j][i + 1] is None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1515 cells[j][i + 1] = cells[j][i]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1516
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1517 # for columns, copy top to bottom
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1518 for i in range(cols):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1519 for j in range(rows - 1):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1520 if cells[j + 1][i] is None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1521 cells[j + 1][i] = cells[j][i]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1522
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1523 # generate header string and MD separator
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1524 for i, name in enumerate(self.header.names):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1525 if not name: # generate a name if empty
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1526 name = f"Col{i+1}"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1527 name = name.replace("\n", "<br>") # use HTML line breaks
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1528 if clean: # remove sensitive syntax
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1529 name = html.escape(name.replace("-", "-"))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1530 output += name + "\|"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1531
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1532 output += "\n"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1533 # insert GitHub header line separator
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1534 output += "\|" + "\|".join("---" for i in range(self.col_count)) + "\|\n"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1535
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1536 # skip first row in details if header is part of the table
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1537 j = 0 if self.header.external else 1
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1538
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1539 # iterate over detail rows
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1540 for row in cells[j:]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1541 line = "\|"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1542 for i, cell in enumerate(row):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1543 # replace None cells with empty string
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1544 # use HTML line break tag
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1545 if cell is None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1546 cell = ""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1547 if clean: # remove sensitive syntax
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1548 cell = html.escape(cell.replace("-", "-"))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1549 line += cell + "\|"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1550 line += "\n"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1551 output += line
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1552 return output + "\n"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1553
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1554 def to_pandas(self, **kwargs):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1555 """Return a pandas DataFrame version of the table."""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1556 try:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1557 import pandas as pd
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1558 except ModuleNotFoundError:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1559 message("Package 'pandas' is not installed")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1560 raise
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1561
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1562 pd_dict = {}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1563 extract = self.extract()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1564 hdr = self.header
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1565 names = self.header.names
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1566 hdr_len = len(names)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1567 # ensure uniqueness of column names
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1568 for i in range(hdr_len):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1569 name = names[i]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1570 if not name:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1571 names[i] = f"Col{i}"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1572 if hdr_len != len(set(names)):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1573 for i in range(hdr_len):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1574 name = names[i]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1575 if name != f"Col{i}":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1576 names[i] = f"{i}-{name}"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1577
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1578 if not hdr.external: # header is part of 'extract'
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1579 extract = extract[1:]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1580
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1581 for i in range(hdr_len):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1582 key = names[i]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1583 value = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1584 for j in range(len(extract)):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1585 value.append(extract[j][i])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1586 pd_dict[key] = value
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1587
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1588 return pd.DataFrame(pd_dict)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1589
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1590 def _get_header(self, y_tolerance=3):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1591 """Identify the table header.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1592
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1593 * PyMuPDF extension. *
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1594
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1595 Starting from the first line above the table upwards, check if it
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1596 qualifies to be part of the table header.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1597
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1598 Criteria include:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1599 * A one-line table never has an extra header.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1600 * Column borders must not intersect any word. If this happens, all
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1601 text of this line and above of it is ignored.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1602 * No excess inter-line distance: If a line further up has a distance
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1603 of more than 1.5 times of its font size, it will be ignored and
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1604 all lines above of it.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1605 * Must have same text properties.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1606 * Starting with the top table line, a bold text property cannot change
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1607 back to non-bold.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1608
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1609 If not all criteria are met (or there is no text above the table),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1610 the first table row is assumed to be the header.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1611 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1612 page = self.page
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1613 y_delta = y_tolerance
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1614
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1615 def top_row_bg_color(self):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1616 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1617 Compare top row background color with color of same-sized bbox
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1618 above. If different, return True indicating that the original
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1619 table top row is already the header.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1620 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1621 bbox0 = Rect(self.rows[0].bbox)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1622 bboxt = bbox0 + (0, -bbox0.height, 0, -bbox0.height) # area above
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1623 top_color0 = page.get_pixmap(clip=bbox0).color_topusage()[1]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1624 top_colort = page.get_pixmap(clip=bboxt).color_topusage()[1]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1625 if top_color0 != top_colort:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1626 return True # top row is header
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1627 return False
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1628
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1629 def row_has_bold(bbox):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1630 """Check if a row contains some bold text.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1631
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1632 If e.g. true for the top row, then it will be used as (internal)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1633 column header row if any of the following is true:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1634 * the previous (above) text line has no bold span
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1635 * the second table row text has no bold span
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1636
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1637 Returns True if any spans are bold else False.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1638 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1639 blocks = page.get_text("dict", flags=TEXTFLAGS_TEXT, clip=bbox)["blocks"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1640 spans = [s for b in blocks for l in b["lines"] for s in l["spans"]]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1641
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1642 return any(s["flags"] & TEXT_FONT_BOLD for s in spans)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1643
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1644 try:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1645 row = self.rows[0]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1646 cells = row.cells
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1647 bbox = Rect(row.bbox)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1648 except IndexError: # this table has no rows
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1649 return None
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1650
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1651 # return this if we determine that the top row is the header
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1652 header_top_row = TableHeader(bbox, cells, self.extract()[0], False)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1653
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1654 # 1-line tables have no extra header
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1655 if len(self.rows) < 2:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1656 return header_top_row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1657
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1658 # 1-column tables have no extra header
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1659 if len(cells) < 2:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1660 return header_top_row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1661
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1662 # assume top row is the header if second row is empty
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1663 row2 = self.rows[1] # second row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1664 if all(c is None for c in row2.cells): # no valid cell bboxes in row2
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1665 return header_top_row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1666
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1667 # Special check: is top row bold?
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1668 top_row_bold = row_has_bold(bbox)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1669
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1670 # assume top row is header if it is bold and any cell
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1671 # of 2nd row is non-bold
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1672 if top_row_bold and not row_has_bold(row2.bbox):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1673 return header_top_row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1674
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1675 if top_row_bg_color(self):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1676 # if area above top row has a different background color,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1677 # then top row is already the header
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1678 return header_top_row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1679
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1680 # column coordinates (x1 values) in top row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1681 col_x = [c[2] if c is not None else None for c in cells[:-1]]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1682
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1683 # clip = page area above the table
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1684 # We will inspect this area for text qualifying as column header.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1685 clip = +bbox # take row 0 bbox
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1686 clip.y0 = 0 # start at top of page
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1687 clip.y1 = bbox.y0 # end at top of table
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1688
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1689 blocks = page.get_text("dict", clip=clip, flags=TEXTFLAGS_TEXT)["blocks"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1690 # non-empty, non-superscript spans above table, sorted descending by y1
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1691 spans = sorted(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1692 [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1693 s
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1694 for b in blocks
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1695 for l in b["lines"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1696 for s in l["spans"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1697 if not (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1698 white_spaces.issuperset(s["text"])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1699 or s["flags"] & TEXT_FONT_SUPERSCRIPT
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1700 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1701 ],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1702 key=lambda s: s["bbox"][3],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1703 reverse=True,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1704 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1705
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1706 select = [] # y1 coordinates above, sorted descending
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1707 line_heights = [] # line heights above, sorted descending
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1708 line_bolds = [] # bold indicator per line above, same sorting
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1709
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1710 # walk through the spans and fill above 3 lists
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1711 for i in range(len(spans)):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1712 s = spans[i]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1713 y1 = s["bbox"][3] # span bottom
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1714 h = y1 - s["bbox"][1] # span bbox height
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1715 bold = s["flags"] & TEXT_FONT_BOLD
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1716
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1717 # use first item to start the lists
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1718 if i == 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1719 select.append(y1)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1720 line_heights.append(h)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1721 line_bolds.append(bold)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1722 continue
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1723
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1724 # get previous items from the 3 lists
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1725 y0 = select[-1]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1726 h0 = line_heights[-1]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1727 bold0 = line_bolds[-1]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1728
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1729 if bold0 and not bold:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1730 break # stop if switching from bold to non-bold
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1731
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1732 # if fitting in height of previous span, modify bbox
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1733 if y0 - y1 <= y_delta or abs((y0 - h0) - s["bbox"][1]) <= y_delta:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1734 s["bbox"] = (s["bbox"][0], y0 - h0, s["bbox"][2], y0)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1735 spans[i] = s
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1736 if bold:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1737 line_bolds[-1] = bold
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1738 continue
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1739 elif y0 - y1 > 1.5 * h0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1740 break # stop if distance to previous line too large
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1741 select.append(y1)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1742 line_heights.append(h)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1743 line_bolds.append(bold)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1744
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1745 if select == []: # nothing above the table?
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1746 return header_top_row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1747
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1748 select = select[:5] # accept up to 5 lines for an external header
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1749
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1750 # assume top row as header if text above is too far away
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1751 if bbox.y0 - select[0] >= line_heights[0]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1752 return header_top_row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1753
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1754 # accept top row as header if bold, but line above is not
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1755 if top_row_bold and not line_bolds[0]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1756 return header_top_row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1757
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1758 if spans == []: # nothing left above the table, return top row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1759 return header_top_row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1760
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1761 # re-compute clip above table
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1762 nclip = EMPTY_RECT()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1763 for s in [s for s in spans if s["bbox"][3] >= select[-1]]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1764 nclip \|= s["bbox"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1765 if not nclip.is_empty:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1766 clip = nclip
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1767
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1768 clip.y1 = bbox.y0 # make sure we still include every word above
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1769
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1770 # Confirm that no word in clip is intersecting a column separator
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1771 word_rects = [Rect(w[:4]) for w in page.get_text("words", clip=clip)]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1772 word_tops = sorted(list(set([r[1] for r in word_rects])), reverse=True)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1773
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1774 select = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1775
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1776 # exclude lines with words that intersect a column border
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1777 for top in word_tops:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1778 intersecting = [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1779 (x, r)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1780 for x in col_x
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1781 if x is not None
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1782 for r in word_rects
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1783 if r[1] == top and r[0] < x and r[2] > x
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1784 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1785 if intersecting == []:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1786 select.append(top)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1787 else: # detected a word crossing a column border
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1788 break
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1789
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1790 if select == []: # nothing left over: return first row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1791 return header_top_row
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1792
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1793 hdr_bbox = +clip # compute the header cells
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1794 hdr_bbox.y0 = select[-1] # hdr_bbox top is smallest top coord of words
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1795 hdr_cells = [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1796 (c[0], hdr_bbox.y0, c[2], hdr_bbox.y1) if c is not None else None
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1797 for c in cells
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1798 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1799
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1800 # adjust left/right of header bbox
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1801 hdr_bbox.x0 = self.bbox[0]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1802 hdr_bbox.x1 = self.bbox[2]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1803
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1804 # column names: no line breaks, no excess spaces
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1805 hdr_names = [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1806 (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1807 page.get_textbox(c).replace("\n", " ").replace(" ", " ").strip()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1808 if c is not None
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1809 else ""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1810 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1811 for c in hdr_cells
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1812 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1813 return TableHeader(tuple(hdr_bbox), hdr_cells, hdr_names, True)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1814
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1815
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1816 @dataclass
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1817 class TableSettings:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1818 vertical_strategy: str = "lines"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1819 horizontal_strategy: str = "lines"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1820 explicit_vertical_lines: list = None
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1821 explicit_horizontal_lines: list = None
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1822 snap_tolerance: float = DEFAULT_SNAP_TOLERANCE
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1823 snap_x_tolerance: float = UNSET
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1824 snap_y_tolerance: float = UNSET
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1825 join_tolerance: float = DEFAULT_JOIN_TOLERANCE
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1826 join_x_tolerance: float = UNSET
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1827 join_y_tolerance: float = UNSET
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1828 edge_min_length: float = 3
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1829 min_words_vertical: float = DEFAULT_MIN_WORDS_VERTICAL
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1830 min_words_horizontal: float = DEFAULT_MIN_WORDS_HORIZONTAL
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1831 intersection_tolerance: float = 3
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1832 intersection_x_tolerance: float = UNSET
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1833 intersection_y_tolerance: float = UNSET
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1834 text_settings: dict = None
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1835
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1836 def __post_init__(self) -> "TableSettings":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1837 """Clean up user-provided table settings.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1838
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1839 Validates that the table settings provided consists of acceptable values and
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1840 returns a cleaned up version. The cleaned up version fills out the missing
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1841 values with the default values in the provided settings.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1842
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1843 TODO: Can be further used to validate that the values are of the correct
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1844 type. For example, raising a value error when a non-boolean input is
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1845 provided for the key ``keep_blank_chars``.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1846
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1847 :param table_settings: User-provided table settings.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1848 :returns: A cleaned up version of the user-provided table settings.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1849 :raises ValueError: When an unrecognised key is provided.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1850 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1851
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1852 for setting in NON_NEGATIVE_SETTINGS:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1853 if (getattr(self, setting) or 0) < 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1854 raise ValueError(f"Table setting '{setting}' cannot be negative")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1855
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1856 for orientation in ["horizontal", "vertical"]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1857 strategy = getattr(self, orientation + "_strategy")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1858 if strategy not in TABLE_STRATEGIES:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1859 raise ValueError(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1860 f"{orientation}_strategy must be one of"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1861 f'{{{",".join(TABLE_STRATEGIES)}}}'
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1862 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1863
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1864 if self.text_settings is None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1865 self.text_settings = {}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1866
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1867 # This next section is for backwards compatibility
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1868 for attr in ["x_tolerance", "y_tolerance"]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1869 if attr not in self.text_settings:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1870 self.text_settings[attr] = self.text_settings.get("tolerance", 3)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1871
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1872 if "tolerance" in self.text_settings:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1873 del self.text_settings["tolerance"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1874 # End of that section
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1875
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1876 for attr, fallback in [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1877 ("snap_x_tolerance", "snap_tolerance"),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1878 ("snap_y_tolerance", "snap_tolerance"),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1879 ("join_x_tolerance", "join_tolerance"),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1880 ("join_y_tolerance", "join_tolerance"),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1881 ("intersection_x_tolerance", "intersection_tolerance"),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1882 ("intersection_y_tolerance", "intersection_tolerance"),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1883 ]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1884 if getattr(self, attr) is UNSET:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1885 setattr(self, attr, getattr(self, fallback))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1886
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1887 return self
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1888
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1889 @classmethod
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1890 def resolve(cls, settings=None):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1891 if settings is None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1892 return cls()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1893 elif isinstance(settings, cls):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1894 return settings
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1895 elif isinstance(settings, dict):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1896 core_settings = {}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1897 text_settings = {}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1898 for k, v in settings.items():
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1899 if k[:5] == "text_":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1900 text_settings[k[5:]] = v
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1901 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1902 core_settings[k] = v
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1903 core_settings["text_settings"] = text_settings
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1904 return cls(**core_settings)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1905 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1906 raise ValueError(f"Cannot resolve settings: {settings}")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1907
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1908
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1909 class TableFinder:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1910 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1911 Given a PDF page, find plausible table structures.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1912
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1913 Largely borrowed from Anssi Nurminen's master's thesis:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1914 http://dspace.cc.tut.fi/dpub/bitstream/handle/123456789/21520/Nurminen.pdf?sequence=3
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1915
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1916 ... and inspired by Tabula:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1917 https://github.com/tabulapdf/tabula-extractor/issues/16
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1918 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1919
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1920 def __init__(self, page, settings=None):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1921 self.page = weakref.proxy(page)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1922 self.settings = TableSettings.resolve(settings)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1923 self.edges = self.get_edges()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1924 self.intersections = edges_to_intersections(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1925 self.edges,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1926 self.settings.intersection_x_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1927 self.settings.intersection_y_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1928 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1929 self.cells = intersections_to_cells(self.intersections)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1930 self.tables = [
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1931 Table(self.page, cell_group)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1932 for cell_group in cells_to_tables(self.page, self.cells)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1933 ]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1934
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1935 def get_edges(self) -> list:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1936 settings = self.settings
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1937
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1938 for orientation in ["vertical", "horizontal"]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1939 strategy = getattr(settings, orientation + "_strategy")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1940 if strategy == "explicit":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1941 lines = getattr(settings, "explicit_" + orientation + "_lines")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1942 if len(lines) < 2:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1943 raise ValueError(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1944 f"If {orientation}_strategy == 'explicit', "
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1945 f"explicit_{orientation}_lines "
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1946 f"must be specified as a list/tuple of two or more "
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1947 f"floats/ints."
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1948 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1949
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1950 v_strat = settings.vertical_strategy
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1951 h_strat = settings.horizontal_strategy
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1952
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1953 if v_strat == "text" or h_strat == "text":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1954 words = extract_words(CHARS, **(settings.text_settings or {}))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1955 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1956 words = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1957
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1958 v_explicit = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1959 for desc in settings.explicit_vertical_lines or []:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1960 if isinstance(desc, dict):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1961 for e in obj_to_edges(desc):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1962 if e["orientation"] == "v":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1963 v_explicit.append(e)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1964 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1965 v_explicit.append(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1966 {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1967 "x0": desc,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1968 "x1": desc,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1969 "top": self.page.rect[1],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1970 "bottom": self.page.rect[3],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1971 "height": self.page.rect[3] - self.page.rect[1],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1972 "orientation": "v",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1973 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1974 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1975
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1976 if v_strat == "lines":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1977 v_base = filter_edges(EDGES, "v")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1978 elif v_strat == "lines_strict":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1979 v_base = filter_edges(EDGES, "v", edge_type="line")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1980 elif v_strat == "text":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1981 v_base = words_to_edges_v(words, word_threshold=settings.min_words_vertical)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1982 elif v_strat == "explicit":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1983 v_base = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1984 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1985 v_base = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1986
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1987 v = v_base + v_explicit
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1988
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1989 h_explicit = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1990 for desc in settings.explicit_horizontal_lines or []:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1991 if isinstance(desc, dict):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1992 for e in obj_to_edges(desc):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1993 if e["orientation"] == "h":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1994 h_explicit.append(e)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1995 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1996 h_explicit.append(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1997 {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1998 "x0": self.page.rect[0],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	1999 "x1": self.page.rect[2],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2000 "width": self.page.rect[2] - self.page.rect[0],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2001 "top": desc,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2002 "bottom": desc,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2003 "orientation": "h",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2004 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2005 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2006
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2007 if h_strat == "lines":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2008 h_base = filter_edges(EDGES, "h")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2009 elif h_strat == "lines_strict":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2010 h_base = filter_edges(EDGES, "h", edge_type="line")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2011 elif h_strat == "text":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2012 h_base = words_to_edges_h(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2013 words, word_threshold=settings.min_words_horizontal
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2014 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2015 elif h_strat == "explicit":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2016 h_base = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2017 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2018 h_base = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2019
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2020 h = h_base + h_explicit
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2021
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2022 edges = list(v) + list(h)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2023
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2024 edges = merge_edges(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2025 edges,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2026 snap_x_tolerance=settings.snap_x_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2027 snap_y_tolerance=settings.snap_y_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2028 join_x_tolerance=settings.join_x_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2029 join_y_tolerance=settings.join_y_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2030 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2031
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2032 return filter_edges(edges, min_length=settings.edge_min_length)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2033
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2034 def __getitem__(self, i):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2035 tcount = len(self.tables)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2036 if i >= tcount:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2037 raise IndexError("table not on page")
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2038 while i < 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2039 i += tcount
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2040 return self.tables[i]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2041
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2042
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2043 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2044 Start of PyMuPDF interface code.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2045 The following functions are executed when "page.find_tables()" is called.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2046
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2047 * make_chars: Fills the CHARS list with text character information extracted
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2048 via "rawdict" text extraction. Items in CHARS are formatted
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2049 as expected by the table code.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2050 * make_edges: Fills the EDGES list with vector graphic information extracted
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2051 via "get_drawings". Items in EDGES are formatted as expected
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2052 by the table code.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2053
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2054 The lists CHARS and EDGES are used to replace respective document access
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2055 of pdfplumber or, respectively pdfminer.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2056 The table code has been modified to use these lists instead of accessing
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2057 page information themselves.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2058 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2059
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2060
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2061 # -----------------------------------------------------------------------------
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2062 # Extract all page characters to fill the CHARS list
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2063 # -----------------------------------------------------------------------------
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2064 def make_chars(page, clip=None):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2065 """Extract text as "rawdict" to fill CHARS."""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2066 global TEXTPAGE
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2067 page_number = page.number + 1
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2068 page_height = page.rect.height
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2069 ctm = page.transformation_matrix
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2070 TEXTPAGE = page.get_textpage(clip=clip, flags=FLAGS)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2071 blocks = page.get_text("rawdict", textpage=TEXTPAGE)["blocks"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2072 doctop_base = page_height * page.number
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2073 for block in blocks:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2074 for line in block["lines"]:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2075 ldir = line["dir"] # = (cosine, sine) of angle
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2076 ldir = (round(ldir[0], 4), round(ldir[1], 4))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2077 matrix = Matrix(ldir[0], -ldir[1], ldir[1], ldir[0], 0, 0)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2078 if ldir[1] == 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2079 upright = True
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2080 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2081 upright = False
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2082 for span in sorted(line["spans"], key=lambda s: s["bbox"][0]):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2083 fontname = span["font"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2084 fontsize = span["size"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2085 color = sRGB_to_pdf(span["color"])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2086 for char in sorted(span["chars"], key=lambda c: c["bbox"][0]):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2087 bbox = Rect(char["bbox"])
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2088 bbox_ctm = bbox * ctm
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2089 origin = Point(char["origin"]) * ctm
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2090 matrix.e = origin.x
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2091 matrix.f = origin.y
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2092 text = char["c"]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2093 char_dict = {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2094 "adv": bbox.x1 - bbox.x0 if upright else bbox.y1 - bbox.y0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2095 "bottom": bbox.y1,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2096 "doctop": bbox.y0 + doctop_base,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2097 "fontname": fontname,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2098 "height": bbox.y1 - bbox.y0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2099 "matrix": tuple(matrix),
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2100 "ncs": "DeviceRGB",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2101 "non_stroking_color": color,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2102 "non_stroking_pattern": None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2103 "object_type": "char",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2104 "page_number": page_number,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2105 "size": fontsize if upright else bbox.y1 - bbox.y0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2106 "stroking_color": color,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2107 "stroking_pattern": None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2108 "text": text,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2109 "top": bbox.y0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2110 "upright": upright,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2111 "width": bbox.x1 - bbox.x0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2112 "x0": bbox.x0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2113 "x1": bbox.x1,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2114 "y0": bbox_ctm.y0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2115 "y1": bbox_ctm.y1,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2116 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2117 CHARS.append(char_dict)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2118
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2119
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2120 # ------------------------------------------------------------------------
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2121 # Extract all page vector graphics to fill the EDGES list.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2122 # We are ignoring Bézier curves completely and are converting everything
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2123 # else to lines.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2124 # ------------------------------------------------------------------------
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2125 def make_edges(page, clip=None, tset=None, paths=None, add_lines=None, add_boxes=None):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2126 snap_x = tset.snap_x_tolerance
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2127 snap_y = tset.snap_y_tolerance
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2128 min_length = tset.edge_min_length
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2129 lines_strict = (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2130 tset.vertical_strategy == "lines_strict"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2131 or tset.horizontal_strategy == "lines_strict"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2132 )
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2133 page_height = page.rect.height
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2134 doctop_basis = page.number * page_height
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2135 page_number = page.number + 1
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2136 prect = page.rect
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2137 if page.rotation in (90, 270):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2138 w, h = prect.br
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2139 prect = Rect(0, 0, h, w)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2140 if clip is not None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2141 clip = Rect(clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2142 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2143 clip = prect
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2144
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2145 def are_neighbors(r1, r2):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2146 """Detect whether r1, r2 are neighbors.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2147
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2148 Defined as:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2149 The minimum distance between points of r1 and points of r2 is not
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2150 larger than some delta.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2151
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2152 This check supports empty rect-likes and thus also lines.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2153
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2154 Note:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2155 This type of check is MUCH faster than native Rect containment checks.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2156 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2157 if ( # check if x-coordinates of r1 are within those of r2
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2158 r2.x0 - snap_x <= r1.x0 <= r2.x1 + snap_x
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2159 or r2.x0 - snap_x <= r1.x1 <= r2.x1 + snap_x
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2160 ) and ( # ... same for y-coordinates
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2161 r2.y0 - snap_y <= r1.y0 <= r2.y1 + snap_y
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2162 or r2.y0 - snap_y <= r1.y1 <= r2.y1 + snap_y
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2163 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2164 return True
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2165
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2166 # same check with r1 / r2 exchanging their roles (this is necessary!)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2167 if (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2168 r1.x0 - snap_x <= r2.x0 <= r1.x1 + snap_x
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2169 or r1.x0 - snap_x <= r2.x1 <= r1.x1 + snap_x
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2170 ) and (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2171 r1.y0 - snap_y <= r2.y0 <= r1.y1 + snap_y
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2172 or r1.y0 - snap_y <= r2.y1 <= r1.y1 + snap_y
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2173 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2174 return True
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2175 return False
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2176
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2177 def clean_graphics(npaths=None):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2178 """Detect and join rectangles of "connected" vector graphics."""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2179 if npaths is None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2180 allpaths = page.get_drawings()
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2181 else: # accept passed-in vector graphics
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2182 allpaths = npaths[:] # paths relevant for table detection
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2183 paths = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2184 for p in allpaths:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2185 # If only looking at lines, we ignore fill-only paths,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2186 # except simulated lines (i.e. small width or height).
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2187 if (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2188 lines_strict
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2189 and p["type"] == "f"
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2190 and p["rect"].width > snap_x
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2191 and p["rect"].height > snap_y
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2192 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2193 continue
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2194 paths.append(p)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2195
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2196 # start with all vector graphics rectangles
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2197 prects = sorted(set([p["rect"] for p in paths]), key=lambda r: (r.y1, r.x0))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2198 new_rects = [] # the final list of joined rectangles
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2199 # ----------------------------------------------------------------
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2200 # Strategy: Join rectangles that "almost touch" each other.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2201 # Extend first rectangle with any other that is a "neighbor".
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2202 # Then move it to the final list and continue with the rest.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2203 # ----------------------------------------------------------------
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2204 while prects: # the algorithm will empty this list
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2205 prect0 = prects[0] # copy of first rectangle (performance reasons!)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2206 repeat = True
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2207 while repeat: # this loop extends first rect in list
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2208 repeat = False # set to true again if some other rect touches
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2209 for i in range(len(prects) - 1, 0, -1): # run backwards
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2210 if are_neighbors(prect0, prects[i]): # close enough to rect 0?
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2211 prect0 \|= prects[i].tl # extend rect 0
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2212 prect0 \|= prects[i].br # extend rect 0
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2213 del prects[i] # delete this rect
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2214 repeat = True # keep checking the rest
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2215
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2216 # move rect 0 over to result list if there is some text in it
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2217 if not white_spaces.issuperset(page.get_textbox(prect0, textpage=TEXTPAGE)):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2218 # contains text, so accept it as a table bbox candidate
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2219 new_rects.append(prect0)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2220 del prects[0] # remove from rect list
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2221
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2222 return new_rects, paths
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2223
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2224 bboxes, paths = clean_graphics(npaths=paths)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2225
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2226 def is_parallel(p1, p2):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2227 """Check if line is roughly axis-parallel."""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2228 if abs(p1.x - p2.x) <= snap_x or abs(p1.y - p2.y) <= snap_y:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2229 return True
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2230 return False
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2231
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2232 def make_line(p, p1, p2, clip):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2233 """Given 2 points, make a line dictionary for table detection."""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2234 if not is_parallel(p1, p2): # only accepting axis-parallel lines
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2235 return {}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2236 # compute the extremal values
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2237 x0 = min(p1.x, p2.x)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2238 x1 = max(p1.x, p2.x)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2239 y0 = min(p1.y, p2.y)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2240 y1 = max(p1.y, p2.y)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2241
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2242 # check for outside clip
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2243 if x0 > clip.x1 or x1 < clip.x0 or y0 > clip.y1 or y1 < clip.y0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2244 return {}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2245
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2246 if x0 < clip.x0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2247 x0 = clip.x0 # adjust to clip boundary
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2248
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2249 if x1 > clip.x1:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2250 x1 = clip.x1 # adjust to clip boundary
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2251
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2252 if y0 < clip.y0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2253 y0 = clip.y0 # adjust to clip boundary
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2254
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2255 if y1 > clip.y1:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2256 y1 = clip.y1 # adjust to clip boundary
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2257
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2258 width = x1 - x0 # from adjusted values
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2259 height = y1 - y0 # from adjusted values
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2260 if width == height == 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2261 return {} # nothing left to deal with
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2262 line_dict = {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2263 "x0": x0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2264 "y0": page_height - y0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2265 "x1": x1,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2266 "y1": page_height - y1,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2267 "width": width,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2268 "height": height,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2269 "pts": [(x0, y0), (x1, y1)],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2270 "linewidth": p["width"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2271 "stroke": True,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2272 "fill": False,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2273 "evenodd": False,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2274 "stroking_color": p["color"] if p["color"] else p["fill"],
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2275 "non_stroking_color": None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2276 "object_type": "line",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2277 "page_number": page_number,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2278 "stroking_pattern": None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2279 "non_stroking_pattern": None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2280 "top": y0,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2281 "bottom": y1,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2282 "doctop": y0 + doctop_basis,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2283 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2284 return line_dict
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2285
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2286 for p in paths:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2287 items = p["items"] # items in this path
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2288
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2289 # if 'closePath', add a line from last to first point
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2290 if p["closePath"] and items[0][0] == "l" and items[-1][0] == "l":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2291 items.append(("l", items[-1][2], items[0][1]))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2292
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2293 for i in items:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2294 if i[0] not in ("l", "re", "qu"):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2295 continue # ignore anything else
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2296
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2297 if i[0] == "l": # a line
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2298 p1, p2 = i[1:]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2299 line_dict = make_line(p, p1, p2, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2300 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2301 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2302
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2303 elif i[0] == "re":
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2304 # A rectangle: decompose into 4 lines, but filter out
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2305 # the ones that simulate a line
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2306 rect = i[1].normalize() # normalize the rectangle
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2307
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2308 if (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2309 rect.width <= min_length and rect.width < rect.height
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2310 ): # simulates a vertical line
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2311 x = abs(rect.x1 + rect.x0) / 2 # take middle value for x
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2312 p1 = Point(x, rect.y0)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2313 p2 = Point(x, rect.y1)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2314 line_dict = make_line(p, p1, p2, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2315 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2316 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2317 continue
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2318
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2319 if (
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2320 rect.height <= min_length and rect.height < rect.width
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2321 ): # simulates a horizontal line
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2322 y = abs(rect.y1 + rect.y0) / 2 # take middle value for y
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2323 p1 = Point(rect.x0, y)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2324 p2 = Point(rect.x1, y)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2325 line_dict = make_line(p, p1, p2, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2326 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2327 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2328 continue
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2329
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2330 line_dict = make_line(p, rect.tl, rect.bl, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2331 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2332 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2333
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2334 line_dict = make_line(p, rect.bl, rect.br, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2335 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2336 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2337
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2338 line_dict = make_line(p, rect.br, rect.tr, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2339 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2340 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2341
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2342 line_dict = make_line(p, rect.tr, rect.tl, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2343 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2344 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2345
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2346 else: # must be a quad
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2347 # we convert it into (up to) 4 lines
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2348 ul, ur, ll, lr = i[1]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2349
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2350 line_dict = make_line(p, ul, ll, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2351 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2352 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2353
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2354 line_dict = make_line(p, ll, lr, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2355 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2356 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2357
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2358 line_dict = make_line(p, lr, ur, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2359 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2360 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2361
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2362 line_dict = make_line(p, ur, ul, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2363 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2364 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2365
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2366 path = {"color": (0, 0, 0), "fill": None, "width": 1}
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2367 for bbox in bboxes: # add the border lines for all enveloping bboxes
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2368 line_dict = make_line(path, bbox.tl, bbox.tr, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2369 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2370 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2371
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2372 line_dict = make_line(path, bbox.bl, bbox.br, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2373 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2374 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2375
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2376 line_dict = make_line(path, bbox.tl, bbox.bl, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2377 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2378 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2379
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2380 line_dict = make_line(path, bbox.tr, bbox.br, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2381 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2382 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2383
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2384 if add_lines is not None: # add user-specified lines
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2385 assert isinstance(add_lines, (tuple, list))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2386 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2387 add_lines = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2388 for p1, p2 in add_lines:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2389 p1 = Point(p1)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2390 p2 = Point(p2)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2391 line_dict = make_line(path, p1, p2, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2392 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2393 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2394
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2395 if add_boxes is not None: # add user-specified rectangles
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2396 assert isinstance(add_boxes, (tuple, list))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2397 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2398 add_boxes = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2399 for box in add_boxes:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2400 r = Rect(box)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2401 line_dict = make_line(path, r.tl, r.bl, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2402 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2403 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2404 line_dict = make_line(path, r.bl, r.br, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2405 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2406 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2407 line_dict = make_line(path, r.br, r.tr, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2408 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2409 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2410 line_dict = make_line(path, r.tr, r.tl, clip)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2411 if line_dict:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2412 EDGES.append(line_to_edge(line_dict))
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2413
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2414
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2415 def page_rotation_set0(page):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2416 """Nullify page rotation.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2417
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2418 To correctly detect tables, page rotation must be zero.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2419 This function performs the necessary adjustments and returns information
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2420 for reverting this changes.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2421 """
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2422 mediabox = page.mediabox
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2423 rot = page.rotation # contains normalized rotation value
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2424 # need to derotate the page's content
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2425 mb = page.mediabox # current mediabox
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2426
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2427 if rot == 90:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2428 # before derotation, shift content horizontally
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2429 mat0 = Matrix(1, 0, 0, 1, mb.y1 - mb.x1 - mb.x0 - mb.y0, 0)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2430 elif rot == 270:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2431 # before derotation, shift content vertically
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2432 mat0 = Matrix(1, 0, 0, 1, 0, mb.x1 - mb.y1 - mb.y0 - mb.x0)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2433 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2434 mat0 = Matrix(1, 0, 0, 1, -2 * mb.x0, -2 * mb.y0)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2435
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2436 # prefix with derotation matrix
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2437 mat = mat0 * page.derotation_matrix
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2438 cmd = b"%g %g %g %g %g %g cm " % tuple(mat)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2439 xref = TOOLS._insert_contents(page, cmd, 0)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2440
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2441 # swap x- and y-coordinates
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2442 if rot in (90, 270):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2443 x0, y0, x1, y1 = mb
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2444 mb.x0 = y0
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2445 mb.y0 = x0
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2446 mb.x1 = y1
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2447 mb.y1 = x1
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2448 page.set_mediabox(mb)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2449
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2450 page.set_rotation(0)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2451
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2452 # refresh the page to apply these changes
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2453 doc = page.parent
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2454 pno = page.number
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2455 page = doc[pno]
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2456 return page, xref, rot, mediabox
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2457
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2458
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2459 def page_rotation_reset(page, xref, rot, mediabox):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2460 """Reset page rotation to original values.
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2461
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2462 To be used before we return tables."""
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2463 doc = page.parent # document of the page
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2464 doc.update_stream(xref, b" ") # remove de-rotation matrix
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2465 page.set_mediabox(mediabox) # set mediabox to old value
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2466 page.set_rotation(rot) # set rotation to old value
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2467 pno = page.number
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2468 page = doc[pno] # update page info
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2469 return page
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2470
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2471
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2472 def find_tables(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2473 page,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2474 clip=None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2475 vertical_strategy: str = "lines",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2476 horizontal_strategy: str = "lines",
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2477 vertical_lines: list = None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2478 horizontal_lines: list = None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2479 snap_tolerance: float = DEFAULT_SNAP_TOLERANCE,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2480 snap_x_tolerance: float = None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2481 snap_y_tolerance: float = None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2482 join_tolerance: float = DEFAULT_JOIN_TOLERANCE,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2483 join_x_tolerance: float = None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2484 join_y_tolerance: float = None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2485 edge_min_length: float = 3,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2486 min_words_vertical: float = DEFAULT_MIN_WORDS_VERTICAL,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2487 min_words_horizontal: float = DEFAULT_MIN_WORDS_HORIZONTAL,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2488 intersection_tolerance: float = 3,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2489 intersection_x_tolerance: float = None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2490 intersection_y_tolerance: float = None,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2491 text_tolerance=3,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2492 text_x_tolerance=3,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2493 text_y_tolerance=3,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2494 strategy=None, # offer abbreviation
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2495 add_lines=None, # user-specified lines
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2496 add_boxes=None, # user-specified rectangles
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2497 paths=None, # accept vector graphics as parameter
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2498 ):
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2499 global CHARS, EDGES
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2500 CHARS = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2501 EDGES = []
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2502 old_small = bool(TOOLS.set_small_glyph_heights()) # save old value
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2503 TOOLS.set_small_glyph_heights(True) # we need minimum bboxes
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2504 if page.rotation != 0:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2505 page, old_xref, old_rot, old_mediabox = page_rotation_set0(page)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2506 else:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2507 old_xref, old_rot, old_mediabox = None, None, None
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2508
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2509 if snap_x_tolerance is None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2510 snap_x_tolerance = UNSET
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2511 if snap_y_tolerance is None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2512 snap_y_tolerance = UNSET
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2513 if join_x_tolerance is None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2514 join_x_tolerance = UNSET
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2515 if join_y_tolerance is None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2516 join_y_tolerance = UNSET
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2517 if intersection_x_tolerance is None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2518 intersection_x_tolerance = UNSET
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2519 if intersection_y_tolerance is None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2520 intersection_y_tolerance = UNSET
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2521 if strategy is not None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2522 vertical_strategy = strategy
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2523 horizontal_strategy = strategy
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2524
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2525 settings = {
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2526 "vertical_strategy": vertical_strategy,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2527 "horizontal_strategy": horizontal_strategy,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2528 "explicit_vertical_lines": vertical_lines,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2529 "explicit_horizontal_lines": horizontal_lines,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2530 "snap_tolerance": snap_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2531 "snap_x_tolerance": snap_x_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2532 "snap_y_tolerance": snap_y_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2533 "join_tolerance": join_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2534 "join_x_tolerance": join_x_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2535 "join_y_tolerance": join_y_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2536 "edge_min_length": edge_min_length,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2537 "min_words_vertical": min_words_vertical,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2538 "min_words_horizontal": min_words_horizontal,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2539 "intersection_tolerance": intersection_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2540 "intersection_x_tolerance": intersection_x_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2541 "intersection_y_tolerance": intersection_y_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2542 "text_tolerance": text_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2543 "text_x_tolerance": text_x_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2544 "text_y_tolerance": text_y_tolerance,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2545 }
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2546 tset = TableSettings.resolve(settings=settings)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2547 page.table_settings = tset
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2548
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2549 make_chars(page, clip=clip) # create character list of page
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2550 make_edges(
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2551 page,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2552 clip=clip,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2553 tset=tset,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2554 paths=paths,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2555 add_lines=add_lines,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2556 add_boxes=add_boxes,
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2557 ) # create lines and curves
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2558 tables = TableFinder(page, settings=tset)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2559
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2560 TOOLS.set_small_glyph_heights(old_small)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2561 if old_xref is not None:
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2562 page = page_rotation_reset(page, old_xref, old_rot, old_mediabox)
1d09e1dec1d9 ADD: PyMuPDF v1.26.4: the original sdist. Franz Glasner <fzglas.hg@dom66.de> parents: diff changeset	2563 return tables

Mercurial > hgrepos > Python2 > PyMuPDF

annotate src/table.py @ 46:7ee69f120f19 default tip