Re: [MacPerl] Running htget (server mirroring) under MacPerl ?

[Kevin Lenzo <lenzo@ux1.sp.cs.cmu.edu>]

Folks,

I'm involved with mirroring a web site/ftp site, 
and we have a unique situation where the web pages also 
point to ftp files outside the http hierarchy.

What we do (on a unix machine, btw, but this will work for
whatever given some tweaking) is upload a tar file by
non-anonymous ftp.  A cron entry executes a script at regular
intervals that checks for the file.  If it's found, it
unpacks the tar file, overwriting any duplicates that already
exist.  It's compact, because only the updated files are in
the tar file, and there are symbolic links under the unpacking
site to both the ftp tree and to the http tree.  This lets
us easily mirror to all 4 sites, updating both the ftp site
and the web pages.

I know i haven't given a macperl solution, but a similar strategy
is pretty easy to implement.

just my 2 yen, 

kevin
lenzo@cs.cmu.edu

> On Tue, 27 Feb 1996 13:43:13 +0000,
> px@fct.unl.pt (Joaquim Baptista [pxQuim]) wrote:
>  > At 10:26 27/2/96, Toni Zollikofer wrote:
>  >> Finally:  if somebody has a better idea of how to mirror parts of a WWW
>  >> sites to a local machine please tell me.
>  > As the saying goes, use the right tool for the job... a perl swiss army
>  > knive is not a good substitute for a real ftp screwdriver :-)
> 
> Hmm. Can't say I agree. 
>   I use a program called WebCopy. It runs on top if libwww so I don't
> think it should be very hard to get it working on a Mac with
> Mac-Libwww. Given the functionality of libwww, writing your own
> shouldn't be infeasible, either. 
>   Check out <URL:ftp://ftp.inf.utfsm.cl/pub/utfsm/perl/webcopy.tgz>
> (yup, that's in Chile).
>   I believe the home for Mac-libwww should still be somewhere near 
> <ftp://mors.gsfc.nasa.gov/pub/MacPerl/libwww-perl-0.40/> but surely
> somebody will correct me if this is up the creek. 
> 
> Hope this helps,
> 
> /* era */
> 
> .obNag: You'd think computer people would have learned not to type a
> space before a question mark? (Hint: Subject line.)
> 
> -- 
> See <http://www.ling.helsinki.fi/~reriksso/> for mantra, disclaimer, etc.
>