Print

Print


Hi Joel,
Using `wget -r -A mp3 http://www.followthedrinkinggourd.org` to scrape the website and just download mp3's on that server I get 23 files, all happen to be from http://www.followthedrinkinggourd.org/Music.

David Rice
AudioVisual Preservation Solutions
350 7th Avenue, Room 1603
New York, NY 10001
 
office: 212-564-2140
cell: 347-213-3517
[log in to unmask]
www.avpreserve.com

On Apr 6, 2010, at 12:52 PM, Joel Bresler wrote:

> Thanks to everyone who  replied. I fear none of the utilities mentioned so
> far are what I am after, but would be glad to learn that I'm wrong! I need
> something that will spider a website, and then come up with a list of either
> all the files in that domain OR all the files of a certain type, in my case,
> mp3s in that site. Ideally, this list would be in the form of clickable
> URLs. 
> 
> So for example, my Drinking Gourd site would have the following list:
> 
> http://www.followthedrinkinggourd.org/Music/1-Weavers.GoodnightIrene.FollowT
> heDrinkingGourd.mp3
> http://www.followthedrinkinggourd.org/Music/2-Weavers.GoodnightIrene.FollowT
> heDrinkingGourd.mp3
> http://www.followthedrinkinggourd.org/Music/3-Foster,AlexAndMichelLarue.Foll
> owTheDrinkingGourd.mp3
> 
> Etc., etc.
> 
> Since my online files are mirrored on my desktop computer, a 2nd choice
> would be some way to generate an exportable list from the Windoze search
> function. I am able to find all the MP3 files on my desktop in a given
> directory (and its subdirectories) but have no idea how to export that list
> in plain text to another program. 
> 
> Continued thanks!
> 
> Joel
> 
> Joel Bresler
> 250 E. Emerson Road
> Lexington, MA 02420
> United States
> 
> 1-781-862-4104 (Telephone & FAX)
> www.linkedin.com/in/joelbresler
> [log in to unmask]
> IN CASE OF VERIZON EMAIL PROBLEMS, PLEASE USE MY BACK-UP EMAIL:
> joelbresler-at-gmail.com
> 
> 
> -----Original Message-----
> From: Association for Recorded Sound Discussion List
> [mailto:[log in to unmask]] On Behalf Of Alex Hartov
> Sent: Sunday, April 04, 2010 11:04 PM
> To: [log in to unmask]
> Subject: Re: [ARSCLIST] Trying to find all MP3 files in a given website
> 
> HI Joel
> 
> Try "PageSucker."  Downloadable for free somewhere on the internet.  I have
> used it successfully on many occasions to download all the files form a
> site.  One can setup filters and selectively download based on file types
> (mime types).  
> 
> Take care
> 
> Alex Hartov
> 
> On Apr 4, 2010, at 8:32 PM, Thatcher Graham wrote:
> 
>> If you browse in Firefox, you can use the Firebug plug in to see all the
> page components.
>> Most of this is HTML of course.
>> 
>> -- Thatcher 
>> 
>> 
>> 
>> Joel Bresler wrote:
>>> Dear friends:
>>> 
>>> Mildly OT, but it does have to do with managing an online sound
>>> collection...
>>> 
>>> Can anyone advise of a utility, online or desktop, that will locate all
> the
>>> MP3 files in a given website? There are many "sitemap" services on the
> web,
>>> but the ones I've seen index just the HTML content. Meanwhile, Google
> allows
>>> searching in a particular site for particular file formats, but NOT
> Mp3's. 
>>> Thanks in advance for any assistance!!
>>> 
>>> Happy Passover and Happy Easter!
>>> 
>>> Joel Bresler
>>> 250 E. Emerson Road
>>> Lexington, MA 02420
>>> United States
>>> 
>>> 1-781-862-4104 (Telephone & FAX)
>>> www.linkedin.com/in/joelbresler
>>> [log in to unmask]
>>> IN CASE OF VERIZON EMAIL PROBLEMS, PLEASE USE MY BACK-UP EMAIL:
>>> 
> No virus found in this incoming message.
> Checked by AVG - www.avg.com 
> Version: 9.0.800 / Virus Database: 271.1.1/2787 - Release Date: 04/05/10
> 02:32:00