You are here: PSPad forum > Bug report / Hlášení chyb > cannot open large file

cannot open large file

#1 cannot open large file

Posted by: Lolo | Date: 02/27/2009 16:52 | IP: IP Logged

Hello,

I tried to open a large text file (about 368MB) and PSPad told me:
"cannot open file 'myfile.txt'"
Is it a bug?

Another thing.
Open PSPad and create a new file.
Create a line with 400 characters for example.
copy and paste it about 800000 times
For information, PSPad takes about 840MB of memory
If you tried to save the file (Ctrl+S), PSPad crash:
Exception class: EOutOfMemory
Exception address: 004062CB

I am on Windows XP sp3 and I have 2,5 GB of memory.
Is it a bug?

Also, I would like to know what is the aim of OpenFileSizeLimit=250000000 in special settings?
Changing this value do nothing if I try to open larger file than OpenFileSizeLimit value.

Thanks a lot and have a nice day.

Lolo.

Options: Reply | Quote | Up ^


#2 Re: cannot open large file

Posted by: pspad | Date: 02/27/2009 17:33 | IP: IP Logged

> I tried to open a large text file (about 368MB) and PSPad told me:
> "cannot open file 'myfile.txt'"
> Is it a bug?

PSpad isn't projected for such large files. It depends of file
encoding.

> Another thing.
> Open PSPad and create a new file.
> Create a line with 400 characters for example.
> copy and paste it about 800000 times
> For information, PSPad takes about 840MB of memory
> If you tried to save the file (Ctrl+S), PSPad crash:
> Exception class: EOutOfMemory
> Exception address: 004062CB

Each 32 bit process has 2 GB memory limit.
PSPad works in UNICODE. It means each char consumes 2 bytes.
If you will paste again and again, you fill your memory. Did you hear
about undo buffer?

> I am on Windows XP sp3 and I have 2,5 GB of memory.
> Is it a bug?

No, it's problem of user.

> Also, I would like to know what is the aim of OpenFileSizeLimit=250000000 in
> special settings?

I'ts used for question if you really need to open big file

Options: Reply | Quote | Up ^


#3 Re: cannot open large file

Posted by: Lolo | Date: 03/04/2009 14:01 | IP: IP Logged

Thank you for your answer.

>PSpad isn't projected for such large files.
What a pity because it is hard too find a software able to open.
Even Notepad++ can't open large file.

>When you talk about: "It depends of file encoding."
What are you thinking about?
Do you think about ANSI or UTF8 encoding?

PSPad seems to take twice of memory than file size whatever encoding I choose in option.

>> Also, I would like to know what is the aim of OpenFileSizeLimit=250000000 in
>> special settings?

>I'ts used for question if you really need to open big file
I have never see this question even in opening a big file.

Options: Reply | Quote | Up ^


#4 Re: cannot open large file

Posted by: pspad | Date: 03/04/2009 18:37 | IP: IP Logged

PSPad works in unicode. Each char consums 2 bytes.
If you encode file during open, it consums another memory.

Options: Reply | Quote | Up ^


#5 Re: cannot open large file

Posted by: MichalKarlik | Date: 03/05/2009 07:32 | IP: IP Logged

Dear Sir,

I do not know if this information is useful for you but program EmEditor (www.emeditor.com) is able:

to open up to 248 GB or 2.1 billion lines with only a little memory
to open even larger than 248 GB by opening a portion of the file with the new custom bar - Large File Controller

I do not have personal experiences with this editor (my files are smaler), but found on Internet, that some programmers use this one for manipulating with big files.

Sincerely,

Michal Karlik

Options: Reply | Quote | Up ^


#6 Re: cannot open large file

Posted by: pspad | Date: 03/05/2009 07:44 | IP: IP Logged

EM editor doesn't work in unicode. As i wrote in unicode each char consums 2 or 4 bytes of memory.

There are two editor access to files:
1. load whole file into memory
2. load only part of file (buffer)

PSPad uses first (worst) method.
You can of course use EM Editor if is better for you

Options: Reply | Quote | Up ^


#7 Re: cannot open large file

Posted by: kubak | Date: 09/19/2013 11:49 | IP: IP Logged

First of all, Thank you Jan for this amazing editor !

I just wanted to ask if you considered making use of both methods, like switching to the buffering method if files are bigger than certain (adjustable) size ?

Opening big files in the only feature PSPad is missing...its still the best though smiling smiley

Edited 1 time(s). Last edit at 09/19/2013 11:50 by kubak.

Options: Reply | Quote | Up ^


#8 Re: cannot open large file

Posted by: mgutt | Date: 02/12/2015 18:25 | IP: IP Logged

+1 for big files

With 16 GB of RAM i don't really understand why I'm not able to open a 200 MB text file.

Options: Reply | Quote | Up ^


#9 Re: cannot open large file

Posted by: pspad | Date: 02/12/2015 19:15 | IP: IP Logged

200MB file you open without any problem with PSPad.
You can have terabytes of RAM, 32 bits process is limited by 2GB of RAM

Options: Reply | Quote | Up ^


#10 Re: cannot open large file

Posted by: Gorlash | Date: 02/24/2015 15:40 | IP: IP Logged

I would also like to add a vote for modifying PsPad to handle large files...
I find that I fairly regularly need to open files of hundreds of megabytes... JSON log files and other such elements. Having to keep a separate editor to handle them, isn't the end of the world, but it would be handier if my primary editor could handle this on its own.

The key, as pspad already noted, is to modify the underlying editor to only open part of the file rather than the whole thing. My guess is, it would take major changes in the underlying editor engine, which would likely be a great deal of work... sad smiley

Options: Reply | Quote | Up ^






Editor PSPad - freeware editor, © 2001 - 2015 Jan Fiala
Hosted by Webhosting TOJEONO.CZ, design by WebDesign PAY & SOFT, code Petr Dvořák