voyent
ICEPDF minimum system requirement for processing 10000 per min  XML
Forum Index -> General Help
Author Message
ankit2012

Joined: 11/Nov/2016 08:49:31
Messages: 7
Offline


Hi All,

I am using ICEPDF to convert multipage PDF to multipage TIFF. In my system we have to convert 10000 multipage PDF to multipage tiff withing 10 min.
Can any one help would should be system architecture. And how can i optimize code for better processing.
PDF size is 50KB.

Currenly I am able to convert only 2000 PDF to TIFF per hour.

Very much help needed.

Thanks for supoort.
patrick.corless

Joined: 26/Oct/2004 00:00:00
Messages: 1982
Offline


It should be possible to get closer to your desired capture time. Could you post your capture code? Also are you locked into using a particular TIFF compression format?

[Email]
ankit2012

Joined: 11/Nov/2016 08:49:31
Messages: 7
Offline


I have tried all available compression format supoort by icepdf. and presently i am using COMPRESSION_LZW.
patrick.corless

Joined: 26/Oct/2004 00:00:00
Messages: 1982
Offline


There is some more information on the various compression modes, on this thread, http://www.icesoft.org/JForum/posts/list/23229.page . A lot of the time is spent doing the actual image compression as well as creating new Buffered images, but I'm not sure if the later can be avoid for multi-page capture.
[Email]
ankit2012

Joined: 11/Nov/2016 08:49:31
Messages: 7
Offline


Hi Patrick,

Thanks for prompt reply,

Could you please help me, in defining optimum hardware for processing 10000 tiff conversion withing 10 min.

patrick.corless

Joined: 26/Oct/2004 00:00:00
Messages: 1982
Offline


Do you have a sample document or some code we could review and test on our end?
[Email]
ankit2012

Joined: 11/Nov/2016 08:49:31
Messages: 7
Offline


Hi Patrick,

I have already shared sample code with you, which take approximate 4-8 sec in tiff conversion with , 8GB physical memory, 2 GB heap and 8 core processor.
patrick.corless

Joined: 26/Oct/2004 00:00:00
Messages: 1982
Offline


Thanks, I'll take a look.
[Email]
ankit2012

Joined: 11/Nov/2016 08:49:31
Messages: 7
Offline


Hi,

Have you found any thing.
ankit2012

Joined: 11/Nov/2016 08:49:31
Messages: 7
Offline


Hi Patrick,


Have you found any thing?
patrick.corless

Joined: 26/Oct/2004 00:00:00
Messages: 1982
Offline


I had some time today to run some capture time tests on a few documents. On a document set that was mainly text based with small to medium sized images. My page.int->buffer creation->page.paint is averaging about 50 ms per page. The time of course can go up quite quickly if there large images in the content set.

From a thread count of 2-4 threads seems to be the sweet spot for CPU and file access. This can easily half the capture time on a document by document the bases. However this is hard to setup when capturing multipage tiffs.

The elephant in the room of course is the time taken to compress and write the tiff to disk which is by far the most time consuming of the whole capture and conversion process. There are few system properties you can uses to speed up the paint times but these will be expense of render quality.

-Dorg.icepdf.core.screen.antiAliasing="VALUE_ANTIALIAS_OFF"
-Dorg.icepdf.core.screen.render="VALUE_RENDER_SPEED"
-Dorg.icepdf.core.screen.fractionalmetrics="VALUE_FRACTIONALMETRICS_OFF"
-Dorg.icepdf.core.screen.alphaInterpolation="VALUE_ALPHA_INTERPOLATION_DEFAULT"





[Email]
ankit2012

Joined: 11/Nov/2016 08:49:31
Messages: 7
Offline


Thanks Patrick.

I have one more query.
Could you please help me in enabling log for icepdf.jar?

patrick.corless

Joined: 26/Oct/2004 00:00:00
Messages: 1982
Offline


We use java util logging for ICEpdf, simple yes but it works well enough for us. There is a write up on our wiki http://www.icesoft.org/wiki/display/PDF/Logging .


On my local system use the following system property to setup the logging properties file.
-Djava.util.logging.config.file=
"d:/svn/ossrepo/icepdf/trunk/icepdf/lib/logging.properties"

The lib folder of the bundle you downloaded will have the properties file. I generally change .level = INFO to .level = FINER. Just uncomment the java.util.logging.FileHandler.formatter lines if you want to redirect to a file.
[Email]
 
Forum Index -> General Help
Go to:   
Powered by JForum 2.1.7ice © JForum Team