James R. Barlow
dc0fb25e64
Render hocr page: no longer needs an image as input
2016-01-15 15:16:47 -08:00
James R. Barlow
f3e04cce56
Update pipeline.svg
2016-01-15 14:56:16 -08:00
James R. Barlow
7067110308
Add safety check to prevent merge from running when not sensible
2016-01-15 14:54:45 -08:00
James R. Barlow
599d889703
Implement "perfect reconstruction" - transfer page and watermark OCR layer
...
Works, does not account for changes to clean/deskew, etc.
Surprisingly, it works. PyPDF2 fixes since last attempt?
2016-01-15 14:39:12 -08:00
James R. Barlow
2fa8366632
Merge branch 'feature/test-pageinfo-cleanup' into develop
2016-01-15 14:18:01 -08:00
James R. Barlow
c368c51bad
New hocrtransform test
2016-01-15 14:14:08 -08:00
James R. Barlow
7c558b3713
Move pageinfo test into tests folder
2016-01-11 17:40:44 -08:00
James R. Barlow
8d323ae510
Merge branch 'feature/pagesegmode' into develop
2016-01-11 17:23:00 -08:00
James R. Barlow
3b53e9adac
Use tesseract cache for -psm
2016-01-11 17:22:50 -08:00
James R. Barlow
074c1d71b4
Activate --tesseract-pagesegmode
2016-01-11 17:19:32 -08:00
James R. Barlow
1fca9a004d
Adjust command line parameters
...
Was splitting each argument to --tesseract-config into a list of single
character strings
2016-01-11 16:57:19 -08:00
James R. Barlow
b485a1ef78
Override ruffus' handling of --jobs
...
Ruffus treats omitted parameter as -j1. For our purposes it makes more
sense for omitting the parameter to mean "use all CPUs". As such we
must be able to distinguish -j1 from the parameter -j being omitted.
Telling ruffus to ignore the argument actually just makes it not auto
generate the argument. We can add an argument back with the same name.
2016-01-09 19:07:48 -08:00
James R. Barlow
326ef7a3ac
Merge branch 'hotfix/v3.1.1' into develop
...
# Conflicts:
# RELEASE_NOTES.rst
2016-01-09 18:55:04 -08:00
James R. Barlow
6af0815681
Bump version
2016-01-09 18:45:06 -08:00
James R. Barlow
66c2b9b78e
Merge branch 'hotfix/v3.1.1' into develop
2016-01-09 18:38:09 -08:00
James R. Barlow
d03c056cb1
Supporting all languages bloats the image by an extra 1 GB
...
Make it a special image
2016-01-04 16:49:06 -08:00
James R. Barlow
3f94d628fa
Dockerfile: remove manual build of unpaper
...
Fortunately unpaper now exists as binary package, eliminating the need
to install all of the build machinery and build it from source.
2016-01-04 15:07:12 -08:00
James R. Barlow
a64c7dbe99
Update dockerfile: include all languages
...
Also update ignore files
2016-01-04 14:27:16 -08:00
James R. Barlow
61b3ccb57c
Place ruffus database in temporary folder
...
Because we don't really use ruffus checkpoint feature, putting the
database in a permanent location does not help anything, but does cause
large database files and problems if the .ruffus_history.sqlite wanted
to be in a writable location.
2016-01-04 13:23:47 -08:00
James R. Barlow
424b4b33b1
Just go right ahead and demand Python 3.4
2016-01-04 12:56:51 -08:00
James R. Barlow
e510f89792
Python 2 warning message
2015-12-21 09:38:38 -08:00
James R. Barlow
49cd6cc619
Off by one error in page info calculation
2015-12-21 09:35:02 -08:00
James R. Barlow
9aa3d340d4
Tell Travis about the cache
2015-12-17 14:02:13 -08:00
James R. Barlow
09782242c8
Adjust test cases to use cache and noop more effectively
...
This reduces total execution time to 164s on my machine, down from
about double that.
2015-12-17 14:00:17 -08:00
James R. Barlow
9ec4aa039d
Add tesseract caching to speed up tests
2015-12-17 12:52:12 -08:00
James R. Barlow
ecebe2f24b
Let some tests use the spoofed tesseract
...
Where getting OCR doesn't matter
2015-12-17 11:56:09 -08:00
James R. Barlow
7313a77c2a
Implement pdf renderer side of tess spoof
2015-12-17 11:41:54 -08:00
James R. Barlow
45113676a3
Add Tesseract spoofing
2015-12-17 11:36:47 -08:00
James R. Barlow
102bd07019
Check for encrypted PDF and complain appropriately
2015-12-17 10:37:54 -08:00
James R. Barlow
9622e31da9
Use envvars in a new test case
...
And get rid of the messy binary replacement spoofing
2015-12-17 09:29:01 -08:00
James R. Barlow
1731ce2a44
Environment variables can now override default programs
2015-12-17 09:05:10 -08:00
James R. Barlow
276f421c44
Did a quick test of Ghostscript vs QPDF at PDF page splitting
...
qpdf won so hard it wasn't funny, even though it must be called once
per page to do the job. Perhaps Ghostscript interprets it as a call to
render the page?
time bash qpdf-test.fish ../tests/resources/multipage.pdf
0.07 real 0.02 user 0.03 sys
time gs -sDEVICE=pdfwrite -dSAFER -o '%06d.pdf' ../tests/resources/multipage.pdf
5.12 real 5.06 user 0.04 sys
2015-12-17 08:49:08 -08:00
James R. Barlow
133357779a
All subprocess invocations refactored out of main.py
2015-12-17 08:31:18 -08:00
James R. Barlow
5d8167b232
Move PDF validation check to qpdf.py
2015-12-17 08:28:00 -08:00
James R. Barlow
e76ae8c46c
Move more qpdf calls into qpdf.py
2015-12-17 08:24:48 -08:00
James R. Barlow
53a7c0e668
Refactor qpdf subprocess calls into module
2015-12-17 08:19:53 -08:00
James R. Barlow
4ca243e490
Merge commit '9f374461559460527e47237323e511123f31b6b0' into feature/envvars
2015-12-17 07:27:26 -08:00
jbarlow83
9f37446155
Merge pull request #34 from shemgp/master
...
Don't exit when qpdf repairs the file successfully but displays warning
2015-12-16 20:46:47 -08:00
Shem Pasamba
d7c7559b05
Use boolean instead of integers
2015-12-17 11:23:27 +08:00
Shem Pasamba
b2b66d1344
Don't exit when qpdf repair was successful
2015-12-17 11:20:20 +08:00
James R. Barlow
5d111a3c04
Refactor tesseract --pdfrenderer calls to tesseract.py
2015-12-16 17:48:26 -08:00
James R. Barlow
10416f847f
Migrate tesseract-hocr code to tesseract module, because modularity
2015-12-16 17:36:11 -08:00
James R. Barlow
79b3472b26
All tests passed, bump version
v3.1
2015-12-04 04:31:01 -08:00
James R. Barlow
f1b2f1ae08
Merge branch 'feature/pdfa-2' into develop
2015-12-04 04:04:08 -08:00
James R. Barlow
ee7d97ae8c
Trivial
2015-12-04 04:03:38 -08:00
James R. Barlow
7d9f473bb1
Remove eval() call by introspecting ExitCode
2015-12-04 03:34:53 -08:00
James R. Barlow
e77a5e5e75
We don't want threads. Really. Do. Not. Want.
2015-12-04 03:11:38 -08:00
James R. Barlow
6ab19af122
Comments
2015-12-04 03:09:39 -08:00
James R. Barlow
276fe49867
Better error messages for input file not found or invalid
...
Not as good finding a general way to deal with ruffus exceptions, but
better than nil.
2015-12-04 03:07:53 -08:00
James R. Barlow
acb31abe86
Fix issue #20 - fails on uppercase .PDF
2015-12-04 02:14:09 -08:00