File last modified: 23.4 minutes ago
-------------------------------------------------------
Task started at: UTC: 2014-03-18 17:22:02 ( PDT: 2014-03-18 10:22:02)
Task pid: 12506
ssh -A -n -c arcfour iw600709 '/petabox/sw/work/derive.php task_id=292795164&identifier=nfpa.nec.2014&server=iw600709&cmd=derive.php&args=dir%3D%252F35%252Fitems%252Fnfpa.nec.2014%26prevtask%3D292795062%26server_primary%3Dia600505.us.archive.org&submittime=2014-03-18+17%3A22%3A02.374037&submitter=carl%40media.org&priority=-6&wait_admin=0&finished=0'
GOT: [task_id=292795164&identifier=nfpa.nec.2014&server=iw600709&cmd=derive.php&args=dir%3D%252F35%252Fitems%252Fnfpa.nec.2014%26prevtask%3D292795062%26server_primary%3Dia600505.us.archive.org&submittime=2014-03-18+17%3A22%3A02.374037&submitter=carl%40media.org&priority=-6&wait_admin=0&finished=0]
[task_id] ==> [292795164]
[identifier] ==> [nfpa.nec.2014]
[server] ==> [iw600709]
[cmd] ==> [derive.php]
[args] ==> [dir=%2F35%2Fitems%2Fnfpa.nec.2014&prevtask=292795062&server_primary=ia600505.us.archive.org]
[submittime] ==> [2014-03-18 17:22:02.374037]
[submitter] ==> [carl@media.org]
[priority] ==> [-6]
[wait_admin] ==> [0]
[finished] ==> [0]
args ==> Array
(
[dir] => /35/items/nfpa.nec.2014
[prevtask] => 292795062
[server_primary] => ia600505.us.archive.org
)
[ PDT: 2014-03-18 10:22:02 ] Executing: rm -rfv /t/derive/nfpa.nec.2014
[ PDT: 2014-03-18 10:22:02 ] Executing: mkdir -p /t/derive/nfpa.nec.2014
Copying files from primary server to remote server...
[ PDT: 2014-03-18 10:22:02 ] Executing: /usr/bin/rsync --timeout=900 -av rsync://ia600505.us.archive.org/items_35/nfpa.nec.2014/ /t/derive/nfpa.nec.2014/
receiving incremental file list
./
nfpa.nec.2014.pdf
nfpa.nec.2014_archive.torrent
nfpa.nec.2014_files.xml
nfpa.nec.2014_meta.sqlite
nfpa.nec.2014_meta.xml
sent 128 bytes received 134256659 bytes 53702714.80 bytes/sec
total size is 134239897 speedup is 1.00
[ PDT: 2014-03-18 10:22:04 ] Executing: nice /usr/local/petabox/deriver/derive.php /t/derive/nfpa.nec.2014 'task_id=292795164&identifier=nfpa.nec.2014&server=iw600709&cmd=derive.php&args=dir%3D%252F35%252Fitems%252Fnfpa.nec.2014%26prevtask%3D292795062%26server_primary%3Dia600505.us.archive.org&submittime=2014-03-18+17%3A22%3A02.374037&submitter=carl%40media.org&priority=-6&wait_admin=0&finished=0'
[ PDT: 2014-03-18 10:22:04 ] Executing: mkdir -m a=rwx -p /t/BookItemOperation/nfpa.nec.2014/
[ PDT: 2014-03-18 10:22:04 ] Executing: rm -rf /t/BookItemOperation/nfpa.nec.2014/*
<--------------- BookOp SetupMetaXML (v55179 Mar18 10:22) Starting PDT: 2014-03-18 10:22:04 ------------------
vvvvvv Beginning run of CleanMeta bookop vvvvvv
^^^^^^^^^^^ End of CleanMeta bookop ^^^^^^^^^^^
Bound NOID 13960/t2g760354 with server message:
Id: 13960/t2g760354
Element: goto
Bind: set
Status: ok, 40 bytes written, replacing 0 bytes
Inserting new cdlib ark identifier ark:/13960/t2g760354
loaded meta XML from: /t/derive/nfpa.nec.2014/nfpa.nec.2014_meta.xml
modifying element: identifier-access
with value: 'http://archive.org/details/nfpa.nec.2014'
found (0) "identifier-access" elements
appending element "identifier-access": http://archive.org/details/nfpa.nec.2014
modifying element: identifier-ark
with value: 'ark:/13960/t2g760354'
found (0) "identifier-ark" elements
appending element "identifier-ark": ark:/13960/t2g760354
checking and formatting new meta.xml with xmllint:
[ PDT: 2014-03-18 10:22:04 ] Executing: /usr/bin/xmllint --format '/t/BookItemOperation/nfpa.nec.2014/nfpa.nec.2014_tmp.xml' > '/t/BookItemOperation/nfpa.nec.2014/nfpa.nec.2014_fmt.xml'
loaded meta XML from: /t/derive/nfpa.nec.2014/nfpa.nec.2014_meta.xml
modifying element: imagecount
with value: '924'
found (0) "imagecount" elements
appending element "imagecount": 924
Updating image imagecount=924 in nfpa.nec.2014_meta.xml
checking and formatting new meta.xml with xmllint:
[ PDT: 2014-03-18 10:22:04 ] Executing: /usr/bin/xmllint --format '/t/BookItemOperation/nfpa.nec.2014/nfpa.nec.2014_tmp.xml' > '/t/BookItemOperation/nfpa.nec.2014/nfpa.nec.2014_fmt.xml'
--------------- BookOp SetupMetaXML Finished PDT: 2014-03-18 10:22:04 (Took 1.0 second) ------------------->
[ PDT: 2014-03-18 10:22:04 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
./
nfpa.nec.2014_meta.xml
sent 743 bytes received 52 bytes 530.00 bytes/sec
total size is 134240066 speedup is 168855.43
[ PDT: 2014-03-18 10:22:05 ] Executing: rm -rf /t/BookItemOperation/nfpa.nec.2014/*
Updating metadata table (after SetupMetaXML)
<--------------- BookOp DevelopRawJp2 (v38364 Mar18 10:22) Starting PDT: 2014-03-18 10:22:05 ------------------
Running DevelopRawJp2 BookItemOperation $Revision: 38364 $ $Date: 2011-09-23 07:50:28 +0000 (Fri, 23 Sep 2011) $
[ PDT: 2014-03-18 10:22:05 ] Executing: rm -rf /t/BookItemOperation/nfpa.nec.2014/*
No /t/derive/nfpa.nec.2014/nfpa.nec.2014_orig_cr2.tar found. Continuing.
--------------- BookOp DevelopRawJp2 Finished PDT: 2014-03-18 10:22:05 (Took 1.0 second) ------------------->
[ PDT: 2014-03-18 10:22:05 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
sent 153 bytes received 12 bytes 330.00 bytes/sec
total size is 134240066 speedup is 813576.16
[ PDT: 2014-03-18 10:22:05 ] Executing: rm -rf /t/BookItemOperation/nfpa.nec.2014/*
<--------------- BookOp AbbyyZipToGz (v38364 Mar18 10:22) Starting PDT: 2014-03-18 10:22:05 ------------------
Running AbbyyZipToGz BookItemOperation $Revision: 38364 $ $Date: 2011-09-23 07:50:28 +0000 (Fri, 23 Sep 2011) $
[ PDT: 2014-03-18 10:22:05 ] Executing: rm -rf /t/BookItemOperation/nfpa.nec.2014/*
No /t/derive/nfpa.nec.2014/nfpa.nec.2014_abbyy.zip or /t/derive/nfpa.nec.2014/nfpa.nec.2014_abbyy.xml found. Nothing to do.
--------------- BookOp AbbyyZipToGz Finished PDT: 2014-03-18 10:22:05 (Took 1.0 second) ------------------->
[ PDT: 2014-03-18 10:22:05 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
sent 153 bytes received 12 bytes 330.00 bytes/sec
total size is 134240066 speedup is 813576.16
[ PDT: 2014-03-18 10:22:05 ] Executing: rm -rf /t/BookItemOperation/nfpa.nec.2014/*
<--------------- BookOp DevelopMekel (v38252 Mar18 10:22) Starting PDT: 2014-03-18 10:22:05 ------------------
Running DevelopMekel BookItemOperation $Revision: 38252 $ $Date: 2011-09-17 00:02:26 +0000 (Sat, 17 Sep 2011) $
Repub state is not 4, so skipping DevelopMekel
--------------- BookOp DevelopMekel Finished PDT: 2014-03-18 10:22:05 (Took 1.0 second) ------------------->
[ PDT: 2014-03-18 10:22:05 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
sent 153 bytes received 12 bytes 330.00 bytes/sec
total size is 134240066 speedup is 813576.16
[ PDT: 2014-03-18 10:22:05 ] Executing: rm -rf /t/BookItemOperation/nfpa.nec.2014/*
[ PDT: 2014-03-18 10:22:05 ] Executing: rm -rf /t/BookItemOperation/nfpa.nec.2014/
Updating metadata table
--------------------
Source => Target
Source nfpa.nec.2014.pdf : "Text PDF"
=> Target nfpa.nec.2014_jp2.zip : "Single Page Processed JP2 ZIP"
--------------------
Derivation Analysis
NonSource nfpa.nec.2014_archive.torrent : "Archive BitTorrent"
NonSource nfpa.nec.2014_files.xml : "Metadata"
NonSource nfpa.nec.2014_meta.sqlite : "Metadata"
NonSource nfpa.nec.2014_meta.xml : "Metadata"
<--------------- Module ProcessJP2 (v54800 2014Mar18 10:22) Starting PDT: 2014-03-18 10:22:05 ------------------
[ PDT: 2014-03-18 10:22:05 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 10:22:05 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
attempting to make "Single Page Processed JP2 ZIP" from "Text PDF"
Accepting pdftoppm version 0.20.5, exceeds required minimum of 0.10.4
[Built on PDFDigester $Revision: 52281 $ $Date: 2013-07-01 23:58:42 +0000 (Mon, 01 Jul 2013) $]
=== Heuristic Resolution Analysis ===
number of pages in PDF: 924
median page size: 8.500 x 11.000
Too few embedded images, must not be full-page images; setting resolution to default value of 300
Updating meta.xml with ppi = "300"
checking and formatting new meta.xml with xmllint:
[ PDT: 2014-03-18 10:22:08 ] Executing: /usr/bin/xmllint --format '/f/_nfpa.nec.2014/nfpa.nec.2014_tmp.xml' > '/f/_nfpa.nec.2014/nfpa.nec.2014_fmt.xml'
0000 c1c4444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444
0100 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444
0200 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444
0300 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444
0400 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444
0500 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444
0600 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444
0700 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444
0800 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444 4444444444
0900 4444444444 4444444444 444c
[ PDT: 2014-03-18 10:39:49 ] Executing: du -sbD '/t/_nfpa.nec.2014/nfpa.nec.2014_jp2'
880708392 /t/_nfpa.nec.2014/nfpa.nec.2014_jp2
[ PDT: 2014-03-18 10:39:49 ] Executing: cd '/t/_nfpa.nec.2014/' && zip -rTq 'nfpa.nec.2014_jp2.zip' 'nfpa.nec.2014_jp2'
[ PDT: 2014-03-18 10:40:42 ] Executing: mv '/t/_nfpa.nec.2014/nfpa.nec.2014_jp2.zip' '/t/derive/nfpa.nec.2014/nfpa.nec.2014_jp2.zip'
[ PDT: 2014-03-18 10:40:42 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module ProcessJP2 Finished PDT: 2014-03-18 10:40:42 (Took 18.6 minutes) ------------------->
[ PDT: 2014-03-18 10:40:42 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
./
nfpa.nec.2014_files.xml
nfpa.nec.2014_jp2.zip
nfpa.nec.2014_meta.xml
sent 881055795 bytes received 108 bytes 34551211.88 bytes/sec
total size is 1015187466 speedup is 1.15
--------------------
Source => Target
Source nfpa.nec.2014.pdf : "Text PDF"
Source nfpa.nec.2014_jp2.zip : "Single Page Processed JP2 ZIP"
=> Target nfpa.nec.2014.gif : "Animated GIF"
=> Target nfpa.nec.2014_abbyy.gz : "Abbyy GZ"
--------------------
Derivation Analysis
UpToDate nfpa.nec.2014.pdf => nfpa.nec.2014_jp2.zip
NonSource nfpa.nec.2014_archive.torrent : "Archive BitTorrent"
NonSource nfpa.nec.2014_files.xml : "Metadata"
NonSource nfpa.nec.2014_meta.sqlite : "Metadata"
NonSource nfpa.nec.2014_meta.xml : "Metadata"
<--------------- Module AnimatedGIF (v50716 2014Mar18 10:41) Starting PDT: 2014-03-18 10:41:12 ------------------
[ PDT: 2014-03-18 10:41:12 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 10:41:12 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 10:41:12 ] Executing: /usr/bin/unzip -q '/t/derive/nfpa.nec.2014/nfpa.nec.2014_jp2.zip' -d '/t/_nfpa.nec.2014'
[ PDT: 2014-03-18 10:41:28 ] Executing: mkdir '/t/_nfpa.nec.2014//gifTmp'
Forming gifs:
0000 ++++++++++ ++++++++++ ++++++++++
[ PDT: 2014-03-18 10:41:40 ] Executing: gifsicle --delay 50 --loopcount=0 --colors 256 '/t/_nfpa.nec.2014//gifTmp/0.gif' '/t/_nfpa.nec.2014//gifTmp/1.gif' '/t/_nfpa.nec.2014//gifTmp/2.gif' '/t/_nfpa.nec.2014//gifTmp/3.gif' '/t/_nfpa.nec.2014//gifTmp/4.gif' '/t/_nfpa.nec.2014//gifTmp/5.gif' '/t/_nfpa.nec.2014//gifTmp/6.gif' '/t/_nfpa.nec.2014//gifTmp/7.gif' '/t/_nfpa.nec.2014//gifTmp/8.gif' '/t/_nfpa.nec.2014//gifTmp/9.gif' '/t/_nfpa.nec.2014//gifTmp/10.gif' '/t/_nfpa.nec.2014//gifTmp/11.gif' '/t/_nfpa.nec.2014//gifTmp/12.gif' '/t/_nfpa.nec.2014//gifTmp/13.gif' '/t/_nfpa.nec.2014//gifTmp/14.gif' '/t/_nfpa.nec.2014//gifTmp/15.gif' '/t/_nfpa.nec.2014//gifTmp/16.gif' '/t/_nfpa.nec.2014//gifTmp/17.gif' '/t/_nfpa.nec.2014//gifTmp/18.gif' '/t/_nfpa.nec.2014//gifTmp/19.gif' '/t/_nfpa.nec.2014//gifTmp/20.gif' '/t/_nfpa.nec.2014//gifTmp/21.gif' '/t/_nfpa.nec.2014//gifTmp/22.gif' '/t/_nfpa.nec.2014//gifTmp/23.gif' '/t/_nfpa.nec.2014//gifTmp/24.gif' '/t/_nfpa.nec.2014//gifTmp/25.gif' '/t/_nfpa.nec.2014//gifTmp/26.gif' '/t/_nfpa.nec.2014//gifTmp/27.gif' '/t/_nfpa.nec.2014//gifTmp/28.gif' '/t/_nfpa.nec.2014//gifTmp/29.gif' > '/t/_nfpa.nec.2014/tmp.gif'
[ PDT: 2014-03-18 10:41:40 ] Executing: mv /t/_nfpa.nec.2014/tmp.gif '/t/derive/nfpa.nec.2014/nfpa.nec.2014.gif'
[ PDT: 2014-03-18 10:41:40 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module AnimatedGIF Finished PDT: 2014-03-18 10:41:41 (Took 29.0 seconds) ------------------->
[ PDT: 2014-03-18 10:41:41 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
./
nfpa.nec.2014.gif
nfpa.nec.2014_files.xml
sent 152701 bytes received 71 bytes 305544.00 bytes/sec
total size is 1015339691 speedup is 6646.11
<--------------- Module AbbyyXML (v57065 2014Mar18 10:41) Starting PDT: 2014-03-18 10:41:41 ------------------
[ PDT: 2014-03-18 10:41:41 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 10:41:41 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
Setting OCR language to English
Setting OCR dpi to 300
(re)-fetching current list of ONLINE OCR hosts
Trying OCR host io700501-1; one of 36 eligible hosts
Got Zip Source...
[ PDT: 2014-03-18 10:41:41 ] Executing: zipinfo -h '/t/derive/nfpa.nec.2014/nfpa.nec.2014_jp2.zip'
Archive: /t/derive/nfpa.nec.2014/nfpa.nec.2014_jp2.zip
Zip file size: 880947221 bytes, number of entries: 925
Got 925 input files, will OCR in chunks of 25
[ PDT: 2014-03-18 10:41:41 ] Executing: unzip -q -j '/t/derive/nfpa.nec.2014/nfpa.nec.2014_jp2.zip' -d '/t/_nfpa.nec.2014/images'
[ PDT: 2014-03-18 10:41:57 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-0') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-0'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-0.xml'
[unpacking tar took 3.0 seconds]
Running OCR process on core 3 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 10:49:34 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 10:49:34 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-0'
Concatenating xml chunk 0
[ PDT: 2014-03-18 10:49:34 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-1') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-1'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-1.xml'
[unpacking tar took 3.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 10:58:24 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 10:58:24 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-1'
Concatenating xml chunk 1
[ PDT: 2014-03-18 10:58:24 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-2') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-2'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-2.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 2 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 11:09:30 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 11:09:30 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-2'
Concatenating xml chunk 2
[ PDT: 2014-03-18 11:09:30 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-3') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-3'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-3.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 2 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 11:17:17 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 11:17:17 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-3'
Concatenating xml chunk 3
[ PDT: 2014-03-18 11:17:18 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-4') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-4'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-4.xml'
[unpacking tar took 5.0 seconds]
Running OCR process on core 2 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 11:25:30 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 11:25:30 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-4'
Concatenating xml chunk 4
[ PDT: 2014-03-18 11:25:31 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-5') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-5'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-5.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 2 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 11:34:45 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 11:34:45 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-5'
Concatenating xml chunk 5
[ PDT: 2014-03-18 11:34:45 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-6') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-6'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-6.xml'
[unpacking tar took 3.0 seconds]
Running OCR process on core 2 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 11:45:49 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 11:45:50 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-6'
Concatenating xml chunk 6
[ PDT: 2014-03-18 11:45:50 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-7') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-7'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-7.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 2 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 11:56:25 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 11:56:25 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-7'
Concatenating xml chunk 7
[ PDT: 2014-03-18 11:56:26 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-8') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-8'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-8.xml'
[unpacking tar took 3.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 12:04:43 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 12:04:43 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-8'
Concatenating xml chunk 8
[ PDT: 2014-03-18 12:04:43 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-9') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-9'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-9.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 12:11:31 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 12:11:31 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-9'
Concatenating xml chunk 9
[ PDT: 2014-03-18 12:11:31 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-10') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-10'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-10.xml'
[unpacking tar took 3.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 12:21:48 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 12:21:49 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-10'
Concatenating xml chunk 10
[ PDT: 2014-03-18 12:21:49 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-11') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-11'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-11.xml'
[unpacking tar took 5.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 12:28:29 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 12:28:29 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-11'
Concatenating xml chunk 11
[ PDT: 2014-03-18 12:28:29 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-12') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-12'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-12.xml'
[unpacking tar took 5.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 12:37:03 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 12:37:03 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-12'
Concatenating xml chunk 12
[ PDT: 2014-03-18 12:37:04 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-13') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-13'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-13.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 12:44:01 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 12:44:01 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-13'
Concatenating xml chunk 13
[ PDT: 2014-03-18 12:44:02 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-14') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-14'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-14.xml'
[unpacking tar took 5.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 12:52:29 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 12:52:29 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-14'
Concatenating xml chunk 14
[ PDT: 2014-03-18 12:52:29 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-15') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-15'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-15.xml'
[unpacking tar took 6.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 13:03:55 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 13:03:55 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-15'
Concatenating xml chunk 15
[ PDT: 2014-03-18 13:03:55 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-16') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-16'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-16.xml'
[unpacking tar took 5.0 seconds]
Running OCR process on core 0 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 13:12:13 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 13:12:13 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-16'
Concatenating xml chunk 16
[ PDT: 2014-03-18 13:12:14 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-17') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-17'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-17.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 0 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 13:24:52 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 13:24:52 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-17'
Concatenating xml chunk 17
[ PDT: 2014-03-18 13:24:53 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-18') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-18'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-18.xml'
[unpacking tar took 5.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 13:35:04 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 13:35:04 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-18'
Concatenating xml chunk 18
[ PDT: 2014-03-18 13:35:04 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-19') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-19'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-19.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 13:43:52 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 13:43:52 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-19'
Concatenating xml chunk 19
[ PDT: 2014-03-18 13:43:53 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-20') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-20'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-20.xml'
[unpacking tar took 5.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 13:50:04 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 13:50:04 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-20'
Concatenating xml chunk 20
[ PDT: 2014-03-18 13:50:04 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-21') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-21'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-21.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 13:58:31 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 13:58:31 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-21'
Concatenating xml chunk 21
[ PDT: 2014-03-18 13:58:32 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-22') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-22'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-22.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 14:07:42 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 14:07:42 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-22'
Concatenating xml chunk 22
[ PDT: 2014-03-18 14:07:42 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-23') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-23'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-23.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 14:15:59 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 14:15:59 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-23'
Concatenating xml chunk 23
[ PDT: 2014-03-18 14:15:59 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-24') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-24'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-24.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 14:20:18 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 14:20:18 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-24'
Concatenating xml chunk 24
[ PDT: 2014-03-18 14:20:19 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-25') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-25'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-25.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 14:29:03 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 14:29:03 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-25'
Concatenating xml chunk 25
[ PDT: 2014-03-18 14:29:04 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-26') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-26'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-26.xml'
[unpacking tar took 3.0 seconds]
Running OCR process on core 2 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 14:38:11 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 14:38:11 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-26'
Concatenating xml chunk 26
[ PDT: 2014-03-18 14:38:12 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-27') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-27'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-27.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 2 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 14:48:38 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 14:48:38 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-27'
Concatenating xml chunk 27
[ PDT: 2014-03-18 14:48:39 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-28') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-28'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-28.xml'
[unpacking tar took 3.0 seconds]
Running OCR process on core 2 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 14:57:48 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 14:57:48 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-28'
Concatenating xml chunk 28
[ PDT: 2014-03-18 14:57:48 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-29') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-29'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-29.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 2 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 15:07:27 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 15:07:27 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-29'
Concatenating xml chunk 29
[ PDT: 2014-03-18 15:07:27 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-30') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-30'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-30.xml'
[unpacking tar took 3.0 seconds]
Running OCR process on core 2 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 15:17:35 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 15:17:35 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-30'
Concatenating xml chunk 30
[ PDT: 2014-03-18 15:17:36 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-31') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-31'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-31.xml'
[unpacking tar took 2.0 seconds]
Running OCR process on core 2 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 15:28:34 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 15:28:34 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-31'
Concatenating xml chunk 31
[ PDT: 2014-03-18 15:28:35 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-32') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-32'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-32.xml'
[unpacking tar took 2.0 seconds]
Running OCR process on core 0 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 15:38:17 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 15:38:17 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-32'
Concatenating xml chunk 32
[ PDT: 2014-03-18 15:38:18 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-33') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-33'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-33.xml'
[unpacking tar took 2.0 seconds]
Running OCR process on core 0 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 15:50:53 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 15:50:53 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-33'
Concatenating xml chunk 33
[ PDT: 2014-03-18 15:50:54 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-34') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-34'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-34.xml'
[unpacking tar took 3.0 seconds]
Running OCR process on core 2 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 15:58:58 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 15:58:59 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-34'
Concatenating xml chunk 34
[ PDT: 2014-03-18 15:58:59 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-35') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-35'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-35.xml'
[unpacking tar took 4.0 seconds]
Running OCR process on core 1 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 16:11:44 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 16:11:44 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-35'
Concatenating xml chunk 35
[ PDT: 2014-03-18 16:11:44 ] Executing: (cd '/t/_nfpa.nec.2014/' && tar -cf - 'images-36') | ssh io700501-1 '/usr/local/petabox/sw/books/bin/remoteOcr.php /usr/local/petabox '\''/f/_nfpa.nec.2014'\'' /usr/local/petabox/sw/books/bin/luraTechOcr.sh '\''images-36'\'' "2250828681 1581828133" "-lang English -dpi 300" 4' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy-36.xml'
[unpacking tar took 3.0 seconds]
Running OCR process on core 0 (numCores=4)
Beginning silent OCR call (to debug, undo stderr redirect to /dev/null)
[ PDT: 2014-03-18 16:19:04 ] Executing: ssh io700501-1 rm -rf '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 16:19:04 ] Executing: rm -rf '/t/_nfpa.nec.2014/images-36'
Concatenating xml chunk 36
Updating meta.xml with ocr = "ABBYY FineReader 9.0"
checking and formatting new meta.xml with xmllint:
[ PDT: 2014-03-18 16:19:04 ] Executing: /usr/bin/xmllint --format '/t/_nfpa.nec.2014/nfpa.nec.2014_tmp.xml' > '/t/_nfpa.nec.2014/nfpa.nec.2014_fmt.xml'
Checking /t/_nfpa.nec.2014/nfpa.nec.2014_abbyy.xml with xmllint and compressing
[ PDT: 2014-03-18 16:19:04 ] Executing: /usr/bin/xmllint --noout --stream '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy.xml'
[ PDT: 2014-03-18 16:19:25 ] Executing: timeout 36440 python /usr/local/petabox/sw/books/ol_search/solr_post.py 'nfpa.nec.2014' '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy.xml'
search inside: 0.1 mins, page 100
search inside: 0.2 mins, page 200
search inside: 0.3 mins, page 300
search inside: 0.5 mins, page 400
search inside: 0.7 mins, page 500
search inside: 1.0 mins, page 600
search inside: 1.4 mins, page 700
search inside: 1.9 mins, page 800
search inside: 2.8 mins, page 900
[ PDT: 2014-03-18 16:22:34 ] Executing: gzip -c '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy.xml' > '/t/derive/nfpa.nec.2014/nfpa.nec.2014_abbyy.gz'
[ PDT: 2014-03-18 16:22:52 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module AbbyyXML Finished PDT: 2014-03-18 16:22:52 (Took 5.7 hours) ------------------->
[ PDT: 2014-03-18 16:22:52 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
./
nfpa.nec.2014_abbyy.gz
nfpa.nec.2014_files.xml
nfpa.nec.2014_meta.xml
sent 60264813 bytes received 108 bytes 17218548.86 bytes/sec
total size is 1075595924 speedup is 17.85
--------------------
Source => Target
Source nfpa.nec.2014.gif : "Animated GIF"
Source nfpa.nec.2014.pdf : "Text PDF"
Source nfpa.nec.2014_abbyy.gz : "Abbyy GZ"
=> Target nfpa.nec.2014_djvu.xml : "Djvu XML"
=> Target nfpa.nec.2014.epub : "EPUB"
Source nfpa.nec.2014_jp2.zip : "Single Page Processed JP2 ZIP"
--------------------
Derivation Analysis
UpToDate nfpa.nec.2014.pdf => nfpa.nec.2014_jp2.zip
UpToDate nfpa.nec.2014_jp2.zip => nfpa.nec.2014.gif
UpToDate nfpa.nec.2014_jp2.zip => nfpa.nec.2014_abbyy.gz
NonSource nfpa.nec.2014_archive.torrent : "Archive BitTorrent"
NonSource nfpa.nec.2014_files.xml : "Metadata"
NonSource nfpa.nec.2014_meta.sqlite : "Metadata"
NonSource nfpa.nec.2014_meta.xml : "Metadata"
<--------------- Module DjvuXML (v38071 2014Mar18 16:23) Starting PDT: 2014-03-18 16:23:00 ------------------
[ PDT: 2014-03-18 16:23:00 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 16:23:00 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 16:23:00 ] Executing: gunzip -c '/t/derive/nfpa.nec.2014/nfpa.nec.2014_abbyy.gz' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy.xml'
Scandata not found, proceeding without scandata.xml
[ PDT: 2014-03-18 16:23:05 ] Executing: perl /usr/local/petabox/sw/books/bin/AbbyyToDjvuXml.pl '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy.xml' '/t/derive/nfpa.nec.2014/' 'nfpa.nec.2014' '/t/_nfpa.nec.2014/djvuxml.stub'
gotScanData=0, gotJp2Archive=1, gotJpgArchive=0, gotTifArchive=0
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
++++++++++ ++++++++++ ++++
Checking /t/_nfpa.nec.2014/djvuxml.stub with xmllint
[ PDT: 2014-03-18 16:38:38 ] Executing: /usr/bin/xmllint --noout --stream '/t/_nfpa.nec.2014/djvuxml.stub'
[ PDT: 2014-03-18 16:38:40 ] Executing: mv '/t/_nfpa.nec.2014/djvuxml.stub' '/t/derive/nfpa.nec.2014/nfpa.nec.2014_djvu.xml'
[ PDT: 2014-03-18 16:38:40 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module DjvuXML Finished PDT: 2014-03-18 16:38:40 (Took 15.7 minutes) ------------------->
[ PDT: 2014-03-18 16:38:40 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
./
nfpa.nec.2014_djvu.xml
nfpa.nec.2014_files.xml
sent 39340383 bytes received 71 bytes 11240129.71 bytes/sec
total size is 1114930718 speedup is 28.34
<--------------- Module EPUB (v36000 2014Mar18 16:38) Starting PDT: 2014-03-18 16:38:43 ------------------
[ PDT: 2014-03-18 16:38:43 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 16:38:43 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 16:38:43 ] Executing: gunzip -c '/t/derive/nfpa.nec.2014/nfpa.nec.2014_abbyy.gz' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy.xml'
scandata doesn't exist yet, skipping this module for now
[ PDT: 2014-03-18 16:38:47 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module EPUB Finished PDT: 2014-03-18 16:38:48 (Took 5.0 seconds) ------------------->
--------------------
Source => Target
Source nfpa.nec.2014.gif : "Animated GIF"
Source nfpa.nec.2014.pdf : "Text PDF"
Source nfpa.nec.2014_abbyy.gz : "Abbyy GZ"
=> Target nfpa.nec.2014.epub : "EPUB"
Source nfpa.nec.2014_djvu.xml : "Djvu XML"
=> Target nfpa.nec.2014_text.pdf : "Additional Text PDF"
=> Target nfpa.nec.2014_pdf.zip : "Single Page Zipped PDF"
=> Target nfpa.nec.2014_scandata.xml : "Scandata"
=> Target nfpa.nec.2014.djvu : "DjVu"
=> Target nfpa.nec.2014_toc.xml : "Contents"
Source nfpa.nec.2014_jp2.zip : "Single Page Processed JP2 ZIP"
--------------------
Derivation Analysis
UpToDate nfpa.nec.2014.pdf => nfpa.nec.2014_jp2.zip
UpToDate nfpa.nec.2014_abbyy.gz => nfpa.nec.2014_djvu.xml
UpToDate nfpa.nec.2014_jp2.zip => nfpa.nec.2014.gif
UpToDate nfpa.nec.2014_jp2.zip => nfpa.nec.2014_abbyy.gz
NonSource nfpa.nec.2014_archive.torrent : "Archive BitTorrent"
NonSource nfpa.nec.2014_files.xml : "Metadata"
NonSource nfpa.nec.2014_meta.sqlite : "Metadata"
NonSource nfpa.nec.2014_meta.xml : "Metadata"
<--------------- Module DjVu (v38041 2014Mar18 16:38) Starting PDT: 2014-03-18 16:38:53 ------------------
[ PDT: 2014-03-18 16:38:53 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 16:38:53 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
Found image archive PROCESSED_JP2 for nfpa.nec.2014 in /t/derive/nfpa.nec.2014/
[ PDT: 2014-03-18 16:38:53 ] Executing: /usr/bin/unzip -oq '/t/derive/nfpa.nec.2014//nfpa.nec.2014_jp2.zip' -d '/t/_nfpa.nec.2014/'
Creating filelist.txt. gotScanData = 0
[ PDT: 2014-03-18 16:39:08 ] Executing: mktemp -d
0000 ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
0100 ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
0200 ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
0300 ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
0400 ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
0500 ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
0600 ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
0700 ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
0800 ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++ ++++++++++
0900 ++++++++++ ++++++++++ ++++
[ PDT: 2014-03-18 16:53:47 ] Executing: rm -rf /tmp/tmp.WdLGE7Wa7j
[ PDT: 2014-03-18 16:53:47 ] Executing: /usr/local/djvu/bin/documenttodjvu --profile=manuscript300 --filelist='/t/_nfpa.nec.2014/filelist.txt' '/t/_nfpa.nec.2014/nfpa.nec.2014.djvu.noocr' 2>&1
Translating absolute paths in djvu.xml
[ PDT: 2014-03-18 17:13:42 ] Executing: /usr/local/djvu/bin/djvuparsexml '/t/_nfpa.nec.2014//translated-djvu.xml'
[ PDT: 2014-03-18 17:24:05 ] Executing: mv '/t/_nfpa.nec.2014//nfpa.nec.2014.djvu.noocr' '/t/derive/nfpa.nec.2014/nfpa.nec.2014.djvu'
[ PDT: 2014-03-18 17:24:05 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module DjVu Finished PDT: 2014-03-18 17:24:06 (Took 45.2 minutes) ------------------->
[ PDT: 2014-03-18 17:24:06 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
./
nfpa.nec.2014.djvu
nfpa.nec.2014_files.xml
sent 40601835 bytes received 71 bytes 27067937.33 bytes/sec
total size is 1155526650 speedup is 28.46
<--------------- Module TOC (v39713 2014Mar18 17:24) Starting PDT: 2014-03-18 17:24:07 ------------------
[ PDT: 2014-03-18 17:24:07 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 17:24:07 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
scandata doesn't exist yet, skipping this module for now
[ PDT: 2014-03-18 17:24:07 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module TOC Finished PDT: 2014-03-18 17:24:07 (Took 1.0 second) ------------------->
<--------------- Module ScandataXML (v35935 2014Mar18 17:24) Starting PDT: 2014-03-18 17:24:07 ------------------
[ PDT: 2014-03-18 17:24:07 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 17:24:07 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
Made image archive PROCESSED_JP2 for nfpa.nec.2014 in /t/derive/nfpa.nec.2014
[ PDT: 2014-03-18 17:24:07 ] Executing: /usr/bin/unzip -oq '/t/derive/nfpa.nec.2014/nfpa.nec.2014_jp2.zip' -d '/t/_nfpa.nec.2014/'
Seeking title page...
Title: "2014 national electrical code"
Start word: "2014"
Candidate words:
p. 0 (2014), 28 px (0.29)
p. 4 national 41 px (0.00)
Selected title page: 4
checking and formatting new scandata.xml with xmllint:
[ PDT: 2014-03-18 17:24:23 ] Executing: /usr/bin/xmllint --format '/t/_nfpa.nec.2014/nfpa.nec.2014_tmp.xml' > '/t/_nfpa.nec.2014/nfpa.nec.2014_fmt.xml'
[ PDT: 2014-03-18 17:24:24 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module ScandataXML Finished PDT: 2014-03-18 17:24:24 (Took 17.0 seconds) ------------------->
[ PDT: 2014-03-18 17:24:24 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
./
nfpa.nec.2014_files.xml
nfpa.nec.2014_scandata.xml
sent 277871 bytes received 77 bytes 111179.20 bytes/sec
total size is 1155804117 speedup is 4158.35
<--------------- Module PDF (v35935 2014Mar18 17:24) Starting PDT: 2014-03-18 17:24:26 ------------------
[ PDT: 2014-03-18 17:24:26 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 17:24:26 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[Built on PDFBase $Revision: 50576 $ $Date: 2013-04-02 23:23:04 +0000 (Tue, 02 Apr 2013) $]
Not a newspaper, so skipping single-page-pdf-zip format
[ PDT: 2014-03-18 17:24:26 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module PDF Finished PDT: 2014-03-18 17:24:26 (Took 1.0 second) ------------------->
<--------------- Module HackPDF (v35935 2014Mar18 17:24) Starting PDT: 2014-03-18 17:24:26 ------------------
[ PDT: 2014-03-18 17:24:26 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 17:24:26 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
Skipping module because contributed pdf already has a text layer
[ PDT: 2014-03-18 17:24:26 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module HackPDF Finished PDT: 2014-03-18 17:24:26 (Took 1.0 second) ------------------->
<--------------- Module EPUB (v36000 2014Mar18 17:24) Starting PDT: 2014-03-18 17:24:26 ------------------
[ PDT: 2014-03-18 17:24:26 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 17:24:26 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 17:24:26 ] Executing: gunzip -c '/t/derive/nfpa.nec.2014/nfpa.nec.2014_abbyy.gz' > '/t/_nfpa.nec.2014/nfpa.nec.2014_abbyy.xml'
[ PDT: 2014-03-18 17:24:32 ] Executing: ulimit -v 1048576; PATH=/petabox/sw/bin:$PATH LD_LIBRARY_PATH=/petabox/sw/lib/kakadu python /petabox/www/datanode/epub/convert_iabook.py --epub --document='nfpa.nec.2014' 'nfpa.nec.2014' '/t/derive/nfpa.nec.2014/' '/t/_nfpa.nec.2014/tmp.epub' 2>&1
[ PDT: 2014-03-18 17:25:22 ] Executing: mv '/t/_nfpa.nec.2014/tmp.epub' '/t/derive/nfpa.nec.2014/nfpa.nec.2014.epub'
[ PDT: 2014-03-18 17:25:22 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module EPUB Finished PDT: 2014-03-18 17:25:22 (Took 56.0 seconds) ------------------->
[ PDT: 2014-03-18 17:25:22 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
./
nfpa.nec.2014.epub
nfpa.nec.2014_files.xml
sent 1482352 bytes received 77 bytes 988286.00 bytes/sec
total size is 1157285694 speedup is 780.67
--------------------
Source => Target
Source nfpa.nec.2014.djvu : "DjVu"
=> Target nfpa.nec.2014_djvu.txt : "DjVuTXT"
Source nfpa.nec.2014.gif : "Animated GIF"
Source nfpa.nec.2014.pdf : "Text PDF"
Source nfpa.nec.2014_abbyy.gz : "Abbyy GZ"
Source nfpa.nec.2014_djvu.xml : "Djvu XML"
=> Target nfpa.nec.2014_text.pdf : "Additional Text PDF"
=> Target nfpa.nec.2014_pdf.zip : "Single Page Zipped PDF"
=> Target nfpa.nec.2014_toc.xml : "Contents"
Source nfpa.nec.2014_jp2.zip : "Single Page Processed JP2 ZIP"
--------------------
Derivation Analysis
NonSource nfpa.nec.2014.epub : "EPUB"
NonSource nfpa.nec.2014_archive.torrent : "Archive BitTorrent"
NonSource nfpa.nec.2014_files.xml : "Metadata"
NonSource nfpa.nec.2014_meta.sqlite : "Metadata"
NonSource nfpa.nec.2014_meta.xml : "Metadata"
NonSource nfpa.nec.2014_scandata.xml : "Scandata"
UpToDate nfpa.nec.2014.pdf => nfpa.nec.2014_jp2.zip
UpToDate nfpa.nec.2014_abbyy.gz => nfpa.nec.2014_djvu.xml
UpToDate nfpa.nec.2014_abbyy.gz => nfpa.nec.2014.epub
UpToDate nfpa.nec.2014_djvu.xml => nfpa.nec.2014_scandata.xml
UpToDate nfpa.nec.2014_djvu.xml => nfpa.nec.2014.djvu
UpToDate nfpa.nec.2014_jp2.zip => nfpa.nec.2014.gif
UpToDate nfpa.nec.2014_jp2.zip => nfpa.nec.2014_abbyy.gz
<--------------- Module DJVUTXT (v38312 2014Mar18 17:25) Starting PDT: 2014-03-18 17:25:28 ------------------
[ PDT: 2014-03-18 17:25:28 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 17:25:28 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
Writing filtered output of /usr/local/djvu/bin/djvutotext '/t/derive/nfpa.nec.2014/nfpa.nec.2014.djvu' to /t/_nfpa.nec.2014/djvutxt.tmp
[ PDT: 2014-03-18 17:26:12 ] Executing: mv '/t/_nfpa.nec.2014/djvutxt.tmp' '/t/derive/nfpa.nec.2014/nfpa.nec.2014_djvu.txt'
[ PDT: 2014-03-18 17:26:12 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module DJVUTXT Finished PDT: 2014-03-18 17:26:12 (Took 44.0 seconds) ------------------->
[ PDT: 2014-03-18 17:26:12 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
./
nfpa.nec.2014_djvu.txt
nfpa.nec.2014_files.xml
sent 4353125 bytes received 77 bytes 2902134.67 bytes/sec
total size is 1161637535 speedup is 266.85
<--------------- Module TOC (v39713 2014Mar18 17:26) Starting PDT: 2014-03-18 17:26:13 ------------------
[ PDT: 2014-03-18 17:26:13 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 17:26:13 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
scandata version too low, skipping creation of Contents file
[ PDT: 2014-03-18 17:26:13 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module TOC Finished PDT: 2014-03-18 17:26:13 (Took 1.0 second) ------------------->
<--------------- Module HackPDF (v35935 2014Mar18 17:26) Starting PDT: 2014-03-18 17:26:13 ------------------
[ PDT: 2014-03-18 17:26:13 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 17:26:13 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
Skipping module because contributed pdf already has a text layer
[ PDT: 2014-03-18 17:26:13 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module HackPDF Finished PDT: 2014-03-18 17:26:13 (Took 1.0 second) ------------------->
<--------------- Module PDF (v35935 2014Mar18 17:26) Starting PDT: 2014-03-18 17:26:13 ------------------
[ PDT: 2014-03-18 17:26:13 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 17:26:13 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[Built on PDFBase $Revision: 50576 $ $Date: 2013-04-02 23:23:04 +0000 (Tue, 02 Apr 2013) $]
Not a newspaper, so skipping single-page-pdf-zip format
[ PDT: 2014-03-18 17:26:13 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module PDF Finished PDT: 2014-03-18 17:26:13 (Took 1.0 second) ------------------->
--------------------
Source => Target
Source nfpa.nec.2014.djvu : "DjVu"
Source nfpa.nec.2014.gif : "Animated GIF"
Source nfpa.nec.2014.pdf : "Text PDF"
Source nfpa.nec.2014_abbyy.gz : "Abbyy GZ"
Source nfpa.nec.2014_djvu.xml : "Djvu XML"
=> Target nfpa.nec.2014_text.pdf : "Additional Text PDF"
=> Target nfpa.nec.2014_pdf.zip : "Single Page Zipped PDF"
=> Target nfpa.nec.2014_toc.xml : "Contents"
Source nfpa.nec.2014_jp2.zip : "Single Page Processed JP2 ZIP"
--------------------
Derivation Analysis
UpToDate nfpa.nec.2014.djvu => nfpa.nec.2014_djvu.txt
UpToDate nfpa.nec.2014.pdf => nfpa.nec.2014_jp2.zip
UpToDate nfpa.nec.2014_abbyy.gz => nfpa.nec.2014_djvu.xml
UpToDate nfpa.nec.2014_abbyy.gz => nfpa.nec.2014.epub
UpToDate nfpa.nec.2014_djvu.xml => nfpa.nec.2014_scandata.xml
UpToDate nfpa.nec.2014_djvu.xml => nfpa.nec.2014.djvu
UpToDate nfpa.nec.2014_jp2.zip => nfpa.nec.2014.gif
UpToDate nfpa.nec.2014_jp2.zip => nfpa.nec.2014_abbyy.gz
NonSource nfpa.nec.2014.epub : "EPUB"
NonSource nfpa.nec.2014_archive.torrent : "Archive BitTorrent"
NonSource nfpa.nec.2014_djvu.txt : "DjVuTXT"
NonSource nfpa.nec.2014_files.xml : "Metadata"
NonSource nfpa.nec.2014_meta.sqlite : "Metadata"
NonSource nfpa.nec.2014_meta.xml : "Metadata"
NonSource nfpa.nec.2014_scandata.xml : "Scandata"
<--------------- Module TOC (v39713 2014Mar18 17:26) Starting PDT: 2014-03-18 17:26:18 ------------------
[ PDT: 2014-03-18 17:26:18 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 17:26:18 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
scandata version too low, skipping creation of Contents file
[ PDT: 2014-03-18 17:26:18 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module TOC Finished PDT: 2014-03-18 17:26:18 (Took 1.0 second) ------------------->
[ PDT: 2014-03-18 17:26:18 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
nfpa.nec.2014_files.xml
sent 368 bytes received 55 bytes 846.00 bytes/sec
total size is 1161637535 speedup is 2746188.03
<--------------- Module PDF (v35935 2014Mar18 17:26) Starting PDT: 2014-03-18 17:26:18 ------------------
[ PDT: 2014-03-18 17:26:18 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 17:26:18 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[Built on PDFBase $Revision: 50576 $ $Date: 2013-04-02 23:23:04 +0000 (Tue, 02 Apr 2013) $]
Not a newspaper, so skipping single-page-pdf-zip format
[ PDT: 2014-03-18 17:26:18 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module PDF Finished PDT: 2014-03-18 17:26:18 (Took 1.0 second) ------------------->
<--------------- Module HackPDF (v35935 2014Mar18 17:26) Starting PDT: 2014-03-18 17:26:18 ------------------
[ PDT: 2014-03-18 17:26:18 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
[ PDT: 2014-03-18 17:26:18 ] Executing: mkdir '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
Skipping module because contributed pdf already has a text layer
[ PDT: 2014-03-18 17:26:18 ] Executing: rm -rf '/t/_nfpa.nec.2014/' '/f/_nfpa.nec.2014/'
--------------- Module HackPDF Finished PDT: 2014-03-18 17:26:18 (Took 1.0 second) ------------------->
Updating meta.xml with repub_state = "4"
checking and formatting new meta.xml with xmllint:
[ PDT: 2014-03-18 17:26:18 ] Executing: /usr/bin/xmllint --format '/t/nfpa.nec.2014_tmp.xml' > '/t/nfpa.nec.2014_fmt.xml'
[ PDT: 2014-03-18 17:26:18 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
./
nfpa.nec.2014_meta.xml
sent 985 bytes received 52 bytes 2074.00 bytes/sec
total size is 1161637566 speedup is 1120190.52
REMOVING file info from _files.xml FOR FILES THAT NO LONGER EXIST...
... done
===================================================
finish()...
ASSIGNING [format]s in _files.xml IF MISSING...
Updating checksum(s) for nfpa.nec.2014_scandata.xml...
Updating checksum(s) for nfpa.nec.2014.epub...
Updating checksum(s) for nfpa.nec.2014_djvu.txt...
Updating checksum(s) for nfpa.nec.2014_meta.xml...
Updating checksum(s) for nfpa.nec.2014_abbyy.gz...
Updating checksum(s) for nfpa.nec.2014_jp2.zip...
Updating checksum(s) for nfpa.nec.2014_djvu.xml...
Updating checksum(s) for nfpa.nec.2014.djvu...
Updating checksum(s) for nfpa.nec.2014.gif...
... done
REMOVING file info from _files.xml FOR FILES THAT NO LONGER EXIST...
... done
made changes, SAVING new version of _files.xml to disk...
... done
UPDATING nfpa.nec.2014_archive.torrent IN /t/derive/nfpa.nec.2014...
[ PDT: 2014-03-18 17:26:31 ] Executing: /usr/local/petabox/sw/bin/ia_make_torrent.py nfpa.nec.2014 -target=nfpa.nec.2014/nfpa.nec.2014_archive.torrent -ID=nfpa.nec.2014 -omitInternalFiles -pieceKB=1024 -log=/dev/null -stdout -petabox=/usr/local/petabox -loc=http://ia600505.us.archive.org/35/items/ -loc=http://ia700505.us.archive.org/35/items/ -trackerPort=6969 -tracker=http://bt1.archive.org -tracker=http://bt2.archive.org -noPad -regenerate -quiet
{"infohash":"d810af19463893905dd2894a4afe29e531cad7a1"}
Success, nfpa.nec.2014_archive.torrent created or updated, new infohash: d810af19463893905dd2894a4afe29e531cad7a1
Adding d810af19463893905dd2894a4afe29e531cad7a1 as file hash btih to nfpa.nec.2014_archive.torrent entry in nfpa.nec.2014_files.xml.
[Elapsed time: 0:00:04 for 1108 MB item; Archive Torrent is 25222 bytes]
... done
UPDATING nfpa.nec.2014_files.xml ENTRY FOR nfpa.nec.2014_archive.torrent...
ASSIGNING [format]s in _files.xml IF MISSING...
Updating checksum(s) for nfpa.nec.2014_archive.torrent...
ASSIGNING "nfpa.nec.2014_archive.torrent" to format "Archive BitTorrent"
... done
made changes, SAVING new version of _files.xml to disk...
... done
Updating metadata table
Setting file permissions for nfpa.nec.2014.
This is a public item.
Sync-ing item... [ PDT: 2014-03-18 17:26:34 ] Executing: /petabox/sw/bin/dsync.py /t/derive/nfpa.nec.2014
...sunk in 0 seconds.
Calling Metadata::clear_cache('nfpa.nec.2014')
Recaching item metadata
Copying files from remote server back to primary server...
[ PDT: 2014-03-18 17:26:34 ] Executing: /usr/bin/rsync --timeout=900 -av --delete-after /t/derive/nfpa.nec.2014/ ia600505.us.archive.org:/35/items/nfpa.nec.2014
building file list ... done
nfpa.nec.2014_archive.torrent
nfpa.nec.2014_files.xml
sent 29024 bytes received 161 bytes 19456.67 bytes/sec
total size is 1161657521 speedup is 39803.24
[ PDT: 2014-03-18 17:26:35 ] Executing: ssh ia600505.us.archive.org /petabox/sw/bin/dsync.py /35/items/nfpa.nec.2014
[ PDT: 2014-03-18 17:26:35 ] Executing: rm -rfv /t/derive/nfpa.nec.2014
removed ‘/t/derive/nfpa.nec.2014/nfpa.nec.2014_meta.sqlite’
removed ‘/t/derive/nfpa.nec.2014/nfpa.nec.2014_scandata.xml’
removed ‘/t/derive/nfpa.nec.2014/nfpa.nec.2014_files.xml’
removed ‘/t/derive/nfpa.nec.2014/nfpa.nec.2014.epub’
removed ‘/t/derive/nfpa.nec.2014/nfpa.nec.2014_archive.torrent’
removed ‘/t/derive/nfpa.nec.2014/nfpa.nec.2014_djvu.txt’
removed ‘/t/derive/nfpa.nec.2014/nfpa.nec.2014_meta.xml’
removed ‘/t/derive/nfpa.nec.2014/nfpa.nec.2014_abbyy.gz’
removed ‘/t/derive/nfpa.nec.2014/nfpa.nec.2014_jp2.zip’
removed ‘/t/derive/nfpa.nec.2014/nfpa.nec.2014_djvu.xml’
removed ‘/t/derive/nfpa.nec.2014/nfpa.nec.2014.pdf’
removed ‘/t/derive/nfpa.nec.2014/nfpa.nec.2014.djvu’
removed ‘/t/derive/nfpa.nec.2014/nfpa.nec.2014.gif’
removed directory: ‘/t/derive/nfpa.nec.2014’
Item queued for bup task!
[total task time: 7.1 hours][includes 2.0 seconds for initial rsync]
TASK FINISHED WITH SUCCESS at UTC: 2014-03-19 00:26:35, ( PDT: 2014-03-18 17:26:35)