James R. Barlow
8df1ea2754
Mark some slow tests
2019-05-17 01:42:27 -07:00
James R. Barlow
e528adc603
pylint removal
2019-05-17 01:09:06 -07:00
James R. Barlow
c1af0fb18d
Cleanup ghostscript error output
2019-05-17 00:50:29 -07:00
James R. Barlow
0cb4e854e5
Replace ProcessPoolExecutor with multiprocessing.Pool
...
There seems to be no reasonable way to handle Ctrl-C with a
ProcessPoolExecutor. Or at least you have to press it several times to
actually kill. Pool does the job.
2019-05-17 00:48:06 -07:00
James R. Barlow
13ab23ba54
Refactor weave_layers, introduce progress bar
...
Fixes a bug in this branch where --sidecar would fail by trying to iterator
the executor futures twice.
2019-05-16 14:57:31 -07:00
James R. Barlow
19263f00c6
Additional logging fixes; silence extremely verbose pdfminer logging
2019-05-16 13:44:44 -07:00
James R. Barlow
50bd129d7a
logging: don't pass log object to validation
2019-05-16 01:58:48 -07:00
James R. Barlow
471cdea232
Move app specific settings a library may not want to __main__
2019-05-16 01:29:26 -07:00
James R. Barlow
9d750828c7
Make logging format consistent with v8.3.0
2019-05-16 00:48:40 -07:00
James R. Barlow
5e025c3382
Reinstate log level in messages to be closer to old behavior
2019-05-15 15:46:36 -07:00
James R. Barlow
4410503349
More fixes to logging and disabled tests
2019-05-15 03:08:09 -07:00
James R. Barlow
486f73d5d6
Remove custom logger
2019-05-15 02:28:13 -07:00
James R. Barlow
b10285d11b
Fix warnings
2019-05-14 16:34:42 -07:00
James R. Barlow
c904b430b6
Merge master into api branch; all test pass
2019-05-14 16:33:02 -07:00
James R. Barlow
07d4fff3d4
docs: mention FreeBSD works
2019-05-14 02:13:56 -07:00
James R. Barlow
7e388f59af
Move completions to better location/Homebrew compat
v8.3.0
2019-05-13 00:22:52 -07:00
James R. Barlow
84ec83151d
v8.3.0 notes: clarify
2019-05-12 03:36:41 -07:00
James R. Barlow
0a72c12ff0
weave: add new test for link consistency
2019-05-12 03:36:33 -07:00
James R. Barlow
5adbddd1f9
ghostscript: rendering threads has no effect on pdfwrite, so remove it
...
See
https://www.ghostscript.com/doc/current/Language.htm
2019-05-12 03:36:07 -07:00
James R. Barlow
c2fecffdb4
Require pikepdf 1.3.0
2019-05-12 02:16:05 -07:00
James R. Barlow
7dea0a8362
v8.3.0 release notes in progress
2019-05-11 12:50:44 -07:00
James R. Barlow
482cb788ed
Don't use MagicMock() as a dummy logger in pytest
2019-05-11 12:44:17 -07:00
James R. Barlow
15a988b999
weave: use emplacement method, scrap TOC repair
...
The new emplacement method updates page objects in place without
generating new objgen numbers, meaning we no longer need to update the table
of contents to preserve links.
2019-05-11 12:40:25 -07:00
James R. Barlow
83398e54ea
weave: fix corruption of certain high page count files
...
Corruption occurred when replacements was not incremented for multiple
consecutive pages.
2019-05-11 12:22:21 -07:00
James R. Barlow
bcdd196699
ghostscript: remove unnecessary post-render resizing step
2019-05-11 12:10:50 -07:00
James R. Barlow
0cd576e701
Rename bash completions file
2019-05-11 10:52:42 -07:00
James R. Barlow
4d5e0eb749
docs: mention completions
2019-05-06 18:07:41 -07:00
Frank and jbarlow83
7ed0f8f50e
Add bash completion ( #384 )
...
* Add bash completion
file must be copied to completion folder e.g. /usr/share/bash-completion/completions
2019-05-06 15:18:15 -07:00
James R. Barlow
79c84eefa3
Fix main.txt
v8.2.4
2019-04-23 02:21:31 -07:00
James R. Barlow
5398003160
Fix test.txt
2019-04-23 00:42:40 -07:00
James R. Barlow
58b2bed99d
v8.2.4 notes
2019-04-23 00:07:12 -07:00
James R. Barlow
58c29ffb5c
weave: use explicit pdf.close(), drastically reduce open file handles
...
With the new pikepdf 1.2.0 we no longer need to hold file handles
open because of the "copy to memory" functionality. We retain
the behavior of closing/reopening the output PDF every 100 pages as
a way to limit memory usage.
2019-04-18 15:12:48 -07:00
James R. Barlow
f615b6f0e8
pdfinfo: be more specific about detecting XFA we can't render
2019-04-18 15:07:25 -07:00
James R. Barlow
e0c8dadcce
Explicitly close most pikepdf.Pdf when done with them
2019-04-18 15:02:12 -07:00
James R. Barlow
9a86f53109
Ignore pip-wheel-metadata folder
...
https://github.com/pypa/pip/issues/6213
2019-04-18 10:42:10 -07:00
James R. Barlow
91cb092aa0
Remove PyCharm debugger hack
2019-04-18 10:15:02 -07:00
James R. Barlow
f4b87915df
Fix --redo-ocr
2019-04-15 13:11:26 -07:00
James R. Barlow
922a107b7f
Remove safety traversal of PDF table of contents
...
qpdf fixed the danging reference issue (qpdf #240 ) in 8.3.0, which is
required by pikepdf 1.1.0. We no
longer need the workaround.
2019-04-13 00:24:03 -07:00
mawi
1c44fd4f3b
fix: typo
2019-04-08 15:01:04 +02:00
mawi
c92ccc6134
fix: tests
2019-04-08 14:57:42 +02:00
mawi
1137534e97
fix: update pytest version
...
Solves install error: pkg_resources.ContextualVersionConflict: (pytest 4.3.0 (/app/.eggs/pytest-4.3.0-py3.6.egg), Requirement.parse('pytest>=4.4.0'), {'pytest-xdist'})
2019-04-08 11:08:29 +02:00
mawi
39617dd739
fix: remove ruffus
2019-04-08 11:07:32 +02:00
mawi
6590875756
feat: add triage step
...
remove tqdm demo
2019-04-08 10:26:56 +02:00
mawi
01bbf064e0
feat: add tqdm progress bar
...
This is just a POC. Will be removed.
2019-04-05 19:52:38 +02:00
mawi
fc1c4f12f5
feat: add concurrent.futures pipeline
2019-04-05 18:48:34 +02:00
mawi
2647382cf6
fix: most of the tests (37 failed, 133 passed, 28 skipped)
2019-04-05 14:06:07 +02:00
mawi
783a128bd1
feat: move to sync (none ETL) implementation - remove ruffus
2019-04-04 21:02:38 +02:00
Martin Wind
b214aa5b38
feat: move to sync (none ETL) implementation
2019-04-03 19:59:43 +02:00
James R. Barlow
6e49bb3588
v8.2.3 notes
v8.2.3
2019-04-03 01:19:12 -07:00
Martin Wind
aa512b6181
feat: move to sync (none ETL) implementation (WIP)
2019-04-02 20:03:09 +02:00