FreeArc

[m^2]

I just noticed that plugins are out of schedule. Did you decide that they are not needed? Or did I miss that they are implemented already?

[Bulat Ziganshin]

what plugins?

[m^2]

I remember there was a talk about possibility of writing a dll and plugging it to FA, so FA could use it like a native method.
I always wanted to make a QuickLZ plugin (and a SlugX too, as long as I had a hope to get my hands on it's sources).

[Bulat Ziganshin]

actually, i implemented this in simple form back in Oct08 - look at Addons/CLS directory. readme.tct and simple_codec.cpp are the starting point. if you need to parse method parameters - define parse_params as it's done in complex_codec.cpp

i've started to develop new compression plugins scheme called CELS, with plans to use it for internal compressors too, but not finished it. releasing new versions almost real time, it's hard to develop anything that doesn't have immediate effect

for external compressors, i plan to support stdin-to-stdout mode that will make them as fast as internal ones except for time required to start external executable

[m^2]

So I missed it.
Any way to make it OS-portable?

[Bulat Ziganshin]

just provide patch to AddClsCompressors() in freearc sources

[Bulat Ziganshin]

--Main
1166 Logfile:=Here you can define a logfile
1447 Temporary directory:=Here you can define a directory for temporary files. Choose the fastest drive with high capacity.

i've modified it a bit:

1166 Logfile:=Logfile logs every operation you have performed and its results
1447 Temporary directory:=Temporary files may be created in this directory during compression or extraction operations. Choose the fastest drive with capacity enough to store all files that your largest archive may include.

[Black_Fox]

What is the name & password to FA.org SVN repo?

[Bulat Ziganshin]

http://freearc.org:8080/freearc/trunk should allow anonymous access. seems that i misconfigured it

[Bulat Ziganshin]

new version:

• file deletion from zip/7z archives ('d' command)
• 4x4: fixed problems with SFX and archive update
• 4x4: storing incompressible blocks
• grzip: reduced (de)compression threads priority
• added tooltips to some Setings dialog controls
• disabled new encryption scheme until 0.75
• Windows versions now are reported on the Statistics page

[zody]

4x4: fixed problems with SFX and archive update

nice! I noticed this yesterday... I thought data transfer was currupt, but FA decompressed fine....

4x4: storing incompressible blocks

will hopefully help a lot for video and random data in games


FA.org SVN doesnt work yet

[Intrinsic]

What switches do i need to get the following detailed info i had under earlier versions of freearc?

Freearc info ~dec 2009
Compressing 5 files of 0 bytes: 0.02 secs
Using storing
Memory for compression 0b, decompression 0b
Solid block compression results
storing: 0 bytes in -0.000 seconds
Compressing 61 files of 3,166,179 bytes: 0.03 secs
Using delta+rep:3124kb+ccm130:5
Memory for compression 780mb, decompression 780mb100%100%100%100%100%1 00%100%100%100%
Solid block compression results (4.583 seconds)
delta: 3,168,011 bytes in 0.031 seconds
rep:3124kb: 3,057,087 bytes in 0.000 seconds
ccm130:5: 758,918 bytes in 4.552 seconds

Writing directory: 4.75 secs
Found 4 directory names: 4.75 secs
Directory written: 4.75 secs100%
Compressed 66 files, 3,166,179 => 758,918 bytes. Ratio 23.9%
Compression time: cpu 0.16 secs, real 4.81 secs. Speed 658 kB/s
All OK

With latest alpha above all i get from -di is:
Compressed 66 files, 3,166,179 => 758,918 bytes. Ratio 23.9%
Compression time: cpu 0.17 secs, real 5.20 secs. Speed 609 kB/s
All OK

[Vacon]

Hello everyone,

What switches do i need to get the following detailed info i had under earlier versions of freearc?
[...]
With latest alpha above all i get from -di is:
Compressed 66 files, 3,166,179 => 758,918 bytes. Ratio 23.9%
Compression time: cpu 0.17 secs, real 5.20 secs. Speed 609 kB/s
All OK

What about the "lt"-option (it's a L and a T)?

Best regards!

[Intrinsic]

Using -lt failed, using -di-lt gave less details, -dilt gave less details, -di=lt gave less details. Any other ideas?

[Bulat Ziganshin]

-di -di+$#! gives the maximum info. feel free to remove unnecessary symbols

[Intrinsic]

Thanks that gives the info i want including filetype detection details.

[Vacon]

Hello everyone,

Using -lt failed, using -di-lt gave less details, -dilt gave less details, -di=lt gave less details. Any other ideas?

Sorry for delay What do you mean by "failed"?
This is what I get (simple demo-test, first create the archive, then "lt" option):

j:\win7PE\Programs\FreeArc-portable\bin>arc a test.arc arc.exe
FreeArc 0.67 (August 23 2010) creating archive: test.arc
Compressed 1 file, 3,553,792 => 864,376 bytes. Ratio 24.3%
Compression time: cpu 4.88 secs, real 8.08 secs. Speed 440 kB/s
All OK

j:\win7PE\Programs\FreeArc-portable\bin>arc lt test.arc
FreeArc 0.67 (August 23 2010) listing archive: test.arc
Listing archive: test.arc

Archive type: FreeArc
Total bytes: 3,553,792
Compressed bytes: 864,726
Ratio: 24.3%

Directory blocks: 1
Directory, bytes: 78
Directory, compressed: 88
Solid blocks: 1
Avg. blocksize: 3471 kb

Compression memory: 8 mb
Decompression memory: 8 mb
Dictionary: 3506kb + 3mb

Archive locked: -
Archive comment: -
Recovery info: -
SFX size: -
Headers encrypted: -
Encryption algorithms: -

              Pos            Size      Compressed   Files Method
-----------------------------------------------------------------------------
               31       3,553,792         864,726       1 rep:3506kb+exe+delta+l
zma:3mb:normal:32:mc16
-----------------------------------------------------------------------------
1 files, 3,553,792 bytes, 864,726 compressed
All OK

j:\win7PE\Programs\FreeArc-portable\bin>

Best regards!

[Intrinsic]

You got confused about the info i wanted i was after details at each step(ie rep/delta/ccm) on the "performance"(can't think of the word i'm after) it had achieved during compression, not listing the archive details. Thanks for trying to help though appreciate it.

[Doug8796]

Is there any way you can remove datetimes from freearc so that I can try to share information from computer to computer without having to recompress?

[JangoFatXL]

hmm, seems like now I'm also affected with extraction problems like someone else posted here

http://sourceforge.net/apps/phpbb/fr...&t=87&start=10

With the latest version (23rd August 2010) I cannot extract my Ubuntu VM.
Extraction itself definitely worked "some alpha versions ago" as I remember I posted here

http://sourceforge.net/apps/phpbb/fr...&t=71&start=10

some stuff concerning linux.
My posting was on 1st August 2010 so I used the latest version before that point (could be useful for diff'ing). That was the last time I extracted the archive. Maybe some versions after worked, too, but I don't know.

log excerpt of last two tries:

D:\>FreeArc t --noarcext -- D:\Portable-VirtualBox_v3.2.0-Starter_v4.2.arc
FreeArc 0.67 (August 23 2010) Using additional options: --logfile=C:\Program Files (x86)\FreeArc\log.txt --workdir=D:\Eigene Dateien
Testing archive: D:\Portable-VirtualBox_v3.2.0-Starter_v4.2.arc

FEHLER: kann notwendigen Speicher f?r (De)Kompression rep:1565568kb nicht zuweisen

D:\>FreeArc x -dpD:\Portable-VirtualBox_v3.2.0-Starter_v4.2 --fullnames --noarcext -- D:\Portable-VirtualBox_v3.2.0-Starter_v4.2.arc
FreeArc 0.67 (August 23 2010) Using additional options: --logfile=C:\Program Files (x86)\FreeArc\log.txt --workdir=D:\Eigene Dateien
Extracting archive: D:\Portable-VirtualBox_v3.2.0-Starter_v4.2.arc
WARNUNG: kann notwendigen Speicher f?r (De)Kompression rep:1565568kb nicht zuweisen

translation of german message above == Error Message in infoline of FreeArc main window

--> cannot allocate required memory for decompression rep

a little bit strange: one time as error, another as warning (maybe try from context menu vs main window)

The error message in popup box --> see attachment

My system: Windows 7 Ultimate 64bit, 4GB RAM

If you want I can also upload the archive...

[tonifelfe]

More and more! If there is no certain way to unpack ANY arc-archive ANY time, ARC becomes not only worthless but harmful.

[JangoFatXL]

That's an exception, usually it works perfectly.

And remember: it's an ALPHA.

[Bulat Ziganshin]

new version:

• 4x4, grzip: reliable error handling
• Addons\LZMA-x64: external LZMA compressor that's compatible with internal one, allowing to use up to lzma:1g:max compression if you have enough RAM and 4x4:lzma for externals' multithreading
• [External compressor:XXX] sections: noheader=0 for external analogs of internal compressors, for console Arc.exe only: <stdin> and <stdout> specifiers to work w/o tempfiles
• ArcShellExt: "Archive operations" submenu for arbitrary files, configurable at "Explorer integration" page
• --nodates: don't store filetimes in archive
• unarc.dll: load facompress*.dll from the same directory as unarc.dll and unload them by UnloadDLL() (FreeArcExtract should not be called after UnloadDLL)
• Addons\Delphi: one more example of unarc.dll usage
• Linux: decreased thread priority for all (de)compression threads except for main one

LZMA-x64 readme:

In order to use 64-bit external LZMA (de)compression, add contents of arc-lzma-x64[-filter].ini to arc.ini.
Alternatively, you can use -cfg=arc-lzma-x64[-filter].ini option to change INI file for one command.

Please note that ini files provide multitude of command settings, from file-to-file to stdin-to-stdout mode.
With GUI FreeArc.exe, you can use only file-to-file mode as configured in arc-lzma-x64.ini.
With console Arc.exe, you can use any mode, including the most efficient one,
stdin-to-stdout mode as configured in arc-lzma-x64-filter.ini.

Also mention that lzma-freearc-x64.exe supports only subset of the FreeArc LZMA codec parameters.
Run lzma-freearc-x64.exe without parameters to see the list of options supported.

Usage examples:

FreeArc.exe create archive -cfg=arc-lzma-x64.ini -m=lzma:d1g -t
Arc.exe create archive -cfg=arc-lzma-x64-filter.ini -m=lzma:d1g -t
Arc.exe create archive -cfg=arc-lzma-x64-filter.ini -m=rep:1g+exe+delta+4x4:b64m:lzma:d64m -t

More examples of external compressors taking benefits of <stdin> or <stdout> support (not compatible with GUI FreeArc.exe):

[External compressor:bcj2]
mem = 50
packcmd   = 7za a -m0=BCJ2 -mmt=on -si $$arcpackedfile$$.7z <stdin>
unpackcmd = 7za e -si -so $$arcpackedfile$$.7z <stdout>
packedfile = $$arcpackedfile$$.7z

[External compressor:srep]
;options  = l%d (minimal match length, default=512)
packcmd   = srep {options} $$arcdatafile$$.tmp -   <stdout>
unpackcmd = srep -d - $$arcdatafile$$.tmp          <stdin>

[External compressor:slugx]
cmem = 260
dmem = 130
packcmd   = {compressor} c <stdin> : <stdout> :
unpackcmd = {compressor} d <stdin> : <stdout> :

Please also test 4x4 (i.e. multithreaded compression, archive updating, SFXes) very hard. i've finished rewriting this code, please check thoroughly whether it became really reliable


Jango, please test with new version before i will look into it

Doug8796, use --nodates and tell me whether it works for your purpose

[Doug8796]

this is how torrent7zip works with date times

http://i53.tinypic.com/1416sqp.png

[Doug8796]

this is how torrent7zip works with date times

http://i53.tinypic.com/1416sqp.png

It worked bulat!! NICE.. Is there a script to recompress multiple 7z files in a folder into arc with this command?

" -mx -lc800m -ld800m -mt1 -ma- --nodates "

Any help would be greatly appreciated ! I compressed same files on 2 computers and MD5 hashed the same This opens a new world of possibilities

[Bulat Ziganshin]

Is there a script to recompress multiple 7z files in a folder into arc with this command?

for + all2arc

or even simpler: select your files in FreeArc GUI and Tools/Convert

[Bulat Ziganshin]

lzma-freearc-x64.exe sources: http://freearc.org/download/testing/...reearc-src.arc

[zody]

Yeah, development continues right way!

LZMA x64 with 4x4 + SREP using stdin/out is AWESOME. Thank you =)

[zody]

There seem to be some bugs...when contents of arc-lzma-x64[-filter].ini is added to arc.ini compressions modes like -m4 do not work anymore.
I tested 4x4 with lzma:

arc.exe create archive -m=rep:1g+exe+delta+4x4:b64m:lzma:d64m -t "folder"

LZMA x64 is loaded without problems BUT arc.exe crashes quite random; msvcrt.dll is noticed on the error report

Regards

[Bulat Ziganshin]

There seem to be some bugs...when contents of arc-lzma-x64[-filter].ini is added to arc.ini compressions modes like -m4 do not work anymore.

Also mention that lzma-freearc-x64.exe supports only subset of the FreeArc LZMA codec parameters.
Run lzma-freearc-x64.exe without parameters to see the list of options supported.

I tested 4x4 with lzma:

arc.exe create archive -m=rep:1g+exe+delta+4x4:b64m:lzma:d64m -t "folder"

LZMA x64 is loaded without problems BUT arc.exe crashes quite random; msvcrt.dll is noticed on the error report

do you have enough ram, 6gb at least?