James R. Barlow
873f915212
docs: mention problems with Debian/Ubuntu and other tidying
2021-03-09 23:24:10 -08:00
James R. Barlow
18e613657c
docker-compose: fix typo
2021-02-14 01:23:01 -08:00
James R. Barlow
a48ca556c7
Add filter_pdf_page hook
2021-02-14 01:22:33 -08:00
James R. Barlow
206c675df6
docs: api
2021-01-31 19:26:35 -08:00
James R. Barlow
6c8f9223e9
Update awslambda to new pluginspec
2021-01-31 03:00:05 -08:00
James R. Barlow
85c6a974ca
Fix calls to hook.get_executor
2021-01-31 02:46:44 -08:00
James R. Barlow
dccdcfaa91
leptonica: tidy
2021-01-31 02:46:09 -08:00
James R. Barlow
b1da09f141
Add plugin for setting logging console
...
So that we are not tied to tqdm.
2021-01-31 02:29:11 -08:00
James R. Barlow
42c84531e4
optimize: rewrite JPEG optimize to avoid use of tqdm and parallelize
...
For some reason JPEG optimization was not done in parallel, and was
perhaps never done in parallel. Strange oversight.
2021-01-31 02:18:46 -08:00
James R. Barlow
16bda74974
Refactor - decouple progressbar from executor
2021-01-30 20:42:00 -08:00
James R. Barlow
d274d88929
Refactor to eliminate global state in _concurrent
2021-01-30 17:36:30 -08:00
James R. Barlow
386cabff00
Make progress pool common rather than plugin-specific
2021-01-24 23:56:09 -08:00
James R. Barlow
3bd5054634
lambda: move to extra_plugins folder
2021-01-24 23:47:26 -08:00
James R. Barlow
6a8dd65aa2
lambda: more issues related to new executor semantics
...
Now all tests pass, except for:
-tests that check the progress bar
-tests where xdist may or may not load a _lambda_plugin by running
some other test first before a test in optimize
2021-01-24 23:46:40 -08:00
James R. Barlow
6083b4f0a7
lambda: don't overrun number of workers needed
2021-01-24 23:46:40 -08:00
James R. Barlow
1a3ce59476
lambda: Don't be paranoid about exception marshalling
...
It works
2021-01-24 23:46:40 -08:00
James R. Barlow
c395436ba3
lambda: tidying, special casing use_threads
2021-01-24 23:46:40 -08:00
James R. Barlow
8d23d0b441
Operational lambda executor
2021-01-24 23:46:40 -08:00
James R. Barlow
c6a2716cdb
Temporary move into package
2021-01-24 23:46:40 -08:00
James R. Barlow
5545bae76f
lambda_plugin.py: doesn't work since entry point needs to be in package
2021-01-24 23:46:33 -08:00
James R. Barlow
7bccb8c748
tests: fix concurrency
2021-01-24 23:46:33 -08:00
James R. Barlow
173c0d1274
concurrency: lock progress pool
...
For API sanity and to communicate expectations. One progress pool at
a time is plenty of complexity.
2021-01-24 23:46:33 -08:00
James R. Barlow
6953f32465
pdfinfo: remove some messy concurrency handling
...
We can cut down on the use of global variables and save opening
an extra copy of the Pdf when threaded.
2021-01-24 23:46:33 -08:00
James R. Barlow
26b4d9bb4b
Refactor concurrency so that it is pluggable
...
However, this may not be the best idea because it involves global
state that could be overridden by a parallel call to ocrmypdf.ocr.
2021-01-24 23:46:29 -08:00
James R. Barlow
34e564cd7d
Use queue.Queue instead of multiprocessing.Queue in threaded mode
2021-01-24 23:45:26 -08:00
James R. Barlow
504d5776d2
Refactor plugin manager to eliminate callback
2021-01-24 23:42:40 -08:00
James R. Barlow
ee23976858
Re-sequence plugin installation
2021-01-24 23:42:28 -08:00
James R. Barlow
f559316881
Insert setuptools plugins with ocrmypdf prefix
2021-01-24 23:42:09 -08:00
James R. Barlow
084610c242
Automate insertion of builtin modules
2021-01-24 23:41:50 -08:00
James R. Barlow
9ff627472b
Update pre-commit
2021-01-24 23:40:59 -08:00
James R. Barlow
956310d1ec
Import PageContext, PdfContext since they are referenced in pluginspec
2021-01-24 02:04:47 -08:00
James R. Barlow
1a982da442
tests: confirm that we produce pdf when optimization is off
2021-01-24 01:54:25 -08:00
James R. Barlow
4879a1f0de
docs: no MS Store Python
2021-01-18 13:27:31 -08:00
James R. Barlow
ce66bcc9c8
github: Ask how ocrmypdf was installed
2021-01-10 02:35:24 -08:00
James R. Barlow
1ebf3144af
v11.5.0 release notes
2021-01-09 16:48:40 -08:00
James R. Barlow
7a1cccbc4e
Fallback to LeptonicaErrorTrap_Redirect if ffi.callback fails
...
Might fix issue #709 , Apple silicon support.
2021-01-09 16:47:11 -08:00
James R. Barlow
ebacff1b39
tests: Fix debug logging test
2021-01-09 16:41:57 -08:00
James R. Barlow
c7c447be66
Add test for configure_debug_logging
...
Since we can't directly test it
2021-01-09 16:02:12 -08:00
James R. Barlow
91aa175602
Consider text when determining page raster DPI
...
Previously if we found vectors of any sort on a page, we would bump
the DPI up to 400. We did nothing
about pages with text. As a result,
pages with a low image resolution
and printable text would have the text downgraded to image
resolution when --force-ocr was used.
We don't try to determine if the text is visible or invisible OCR text, since
that is a slower test. --redo-ocr would improve such cases anyway.
2021-01-09 16:01:49 -08:00
James R. Barlow
b267494e4a
Create raster PDF pages to match input page size
...
Previously we produced a raster image, then multiplied image width
by DPI to get the page size. However if there is rounding the
page size may not match exactly. In this modified approach we
constrain the page size to match.
2021-01-08 15:10:43 -08:00
James R. Barlow
f687180ecc
tests: tidy pdfinfo
2021-01-08 15:04:52 -08:00
James R. Barlow
6f4b38b103
ghostscript: tidy comments
2021-01-08 00:41:03 -08:00
James R. Barlow
d32324859c
v11.4.5 release notes
2021-01-06 11:42:28 -08:00
James R. Barlow
48222b87b5
Merge branch 'master' of github.com:jbarlow83/OCRmyPDF
2021-01-06 03:59:40 -08:00
62e5edc72b
fix unclosed file warnings. ( #710 )
...
Co-authored-by: Jonas Winkler <jonas.winkler@jpwinkler.de >
2021-01-06 03:59:28 -08:00
James R. Barlow
2846d46bb8
Remove .coveragerc and fold into setup.cfg
2021-01-06 03:58:18 -08:00
James R. Barlow
47ef1914d4
v11.4.4 release notes
2021-01-01 01:39:24 -08:00
James R. Barlow
df157552f3
Make ocrmypdf.ocr take a threading lock
2021-01-01 01:37:09 -08:00
James R. Barlow
0b3a526049
Partial fix crash on 'userunit' None ( #700 )
...
Our method of getting data from pdfminer would silently consume a StopIteration
if pdfminer returned no processed pages, leading to odd error message.
We improve an error from pdfminer properly, and returning a more
descriptive error of our own.
It would be possible for ocrmypdf to repair the file before sending it to
pdfminer, but this seems to be rare enough that we won't do that yet.
2021-01-01 01:11:32 -08:00
James R. Barlow
1e80d412fa
tesseract: fix typing of some optional arguments
2021-01-01 00:46:00 -08:00
James R. Barlow
