Hi Joel,
Using `wget -r -A mp3 http://www.followthedrinkinggourd.org` to scrape the website and just download mp3's on that server I get 23 files, all happen to be from http://www.followthedrinkinggourd.org/Music.
David Rice
AudioVisual Preservation Solutions
350 7th Avenue, Room 1603
New York, NY 10001
office: 212-564-2140
cell: 347-213-3517
[log in to unmask]
www.avpreserve.com
On Apr 6, 2010, at 12:52 PM, Joel Bresler wrote:
> Thanks to everyone who replied. I fear none of the utilities mentioned so
> far are what I am after, but would be glad to learn that I'm wrong! I need
> something that will spider a website, and then come up with a list of either
> all the files in that domain OR all the files of a certain type, in my case,
> mp3s in that site. Ideally, this list would be in the form of clickable
> URLs.
>
> So for example, my Drinking Gourd site would have the following list:
>
> http://www.followthedrinkinggourd.org/Music/1-Weavers.GoodnightIrene.FollowT
> heDrinkingGourd.mp3
> http://www.followthedrinkinggourd.org/Music/2-Weavers.GoodnightIrene.FollowT
> heDrinkingGourd.mp3
> http://www.followthedrinkinggourd.org/Music/3-Foster,AlexAndMichelLarue.Foll
> owTheDrinkingGourd.mp3
>
> Etc., etc.
>
> Since my online files are mirrored on my desktop computer, a 2nd choice
> would be some way to generate an exportable list from the Windoze search
> function. I am able to find all the MP3 files on my desktop in a given
> directory (and its subdirectories) but have no idea how to export that list
> in plain text to another program.
>
> Continued thanks!
>
> Joel
>
> Joel Bresler
> 250 E. Emerson Road
> Lexington, MA 02420
> United States
>
> 1-781-862-4104 (Telephone & FAX)
> www.linkedin.com/in/joelbresler
> [log in to unmask]
> IN CASE OF VERIZON EMAIL PROBLEMS, PLEASE USE MY BACK-UP EMAIL:
> joelbresler-at-gmail.com
>
>
> -----Original Message-----
> From: Association for Recorded Sound Discussion List
> [mailto:[log in to unmask]] On Behalf Of Alex Hartov
> Sent: Sunday, April 04, 2010 11:04 PM
> To: [log in to unmask]
> Subject: Re: [ARSCLIST] Trying to find all MP3 files in a given website
>
> HI Joel
>
> Try "PageSucker." Downloadable for free somewhere on the internet. I have
> used it successfully on many occasions to download all the files form a
> site. One can setup filters and selectively download based on file types
> (mime types).
>
> Take care
>
> Alex Hartov
>
> On Apr 4, 2010, at 8:32 PM, Thatcher Graham wrote:
>
>> If you browse in Firefox, you can use the Firebug plug in to see all the
> page components.
>> Most of this is HTML of course.
>>
>> -- Thatcher
>>
>>
>>
>> Joel Bresler wrote:
>>> Dear friends:
>>>
>>> Mildly OT, but it does have to do with managing an online sound
>>> collection...
>>>
>>> Can anyone advise of a utility, online or desktop, that will locate all
> the
>>> MP3 files in a given website? There are many "sitemap" services on the
> web,
>>> but the ones I've seen index just the HTML content. Meanwhile, Google
> allows
>>> searching in a particular site for particular file formats, but NOT
> Mp3's.
>>> Thanks in advance for any assistance!!
>>>
>>> Happy Passover and Happy Easter!
>>>
>>> Joel Bresler
>>> 250 E. Emerson Road
>>> Lexington, MA 02420
>>> United States
>>>
>>> 1-781-862-4104 (Telephone & FAX)
>>> www.linkedin.com/in/joelbresler
>>> [log in to unmask]
>>> IN CASE OF VERIZON EMAIL PROBLEMS, PLEASE USE MY BACK-UP EMAIL:
>>>
> No virus found in this incoming message.
> Checked by AVG - www.avg.com
> Version: 9.0.800 / Virus Database: 271.1.1/2787 - Release Date: 04/05/10
> 02:32:00
|